Jul 08 22:41:36.245483 ip-10-0-132-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 22:41:36.245494 ip-10-0-132-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 22:41:36.245501 ip-10-0-132-102 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 22:41:36.245716 ip-10-0-132-102 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 22:41:46.381894 ip-10-0-132-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 08 22:41:46.381913 ip-10-0-132-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 357550c002aa446bb52fa616128445bf -- Jul 08 22:43:35.630481 ip-10-0-132-102 systemd[1]: Starting Kubernetes Kubelet... Jul 08 22:43:36.015793 ip-10-0-132-102 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 22:43:36.015793 ip-10-0-132-102 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 22:43:36.015793 ip-10-0-132-102 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 22:43:36.015793 ip-10-0-132-102 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 22:43:36.015793 ip-10-0-132-102 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 22:43:36.016643 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.016273 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030558 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030571 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030575 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030578 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030581 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030584 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030587 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030591 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030594 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030597 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030599 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030602 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030604 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030607 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030609 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030612 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030614 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030617 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030619 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:43:36.096267 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030621 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:43:36.096579 ip-10-0-132-102 systemd[1]: Started Kubernetes Kubelet. Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030631 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030634 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030636 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030639 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030641 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030644 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030647 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030649 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030652 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030655 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030657 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030660 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030663 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030666 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030669 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030671 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030674 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030677 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030679 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:43:36.096998 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030682 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030684 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030687 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030689 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030692 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030694 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030697 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030700 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030702 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030705 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030707 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030715 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030718 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030721 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030724 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030727 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030729 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030732 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030734 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030737 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:43:36.097809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030739 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030742 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030744 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030747 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030749 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030751 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030754 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030756 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030759 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030761 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030764 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030766 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030769 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030772 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030774 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030776 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030782 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030786 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030788 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:43:36.098469 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030791 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030793 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030796 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030799 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030802 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030806 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030808 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030811 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030813 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030816 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030819 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030821 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030824 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030826 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030829 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030834 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030838 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030843 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030846 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:43:36.099135 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030849 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.030852 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031548 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031555 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031558 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031561 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031564 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031567 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031569 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031572 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031575 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031577 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031580 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031582 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031585 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031587 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031590 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031593 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031595 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031598 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:43:36.099772 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031601 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031604 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031606 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031609 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031611 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031614 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031616 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031619 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031621 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031624 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031627 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031629 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031632 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031634 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031637 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031639 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031644 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031649 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031653 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:43:36.100578 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031657 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031659 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031662 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031665 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031668 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031671 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031675 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031678 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031681 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031684 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031687 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031689 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031692 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031695 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031698 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031700 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031703 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031705 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031708 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:43:36.101489 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031711 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031714 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031717 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031719 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031722 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031725 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031727 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031729 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031732 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031735 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031737 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031740 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031742 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031745 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031747 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031750 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031753 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031755 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031757 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031760 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:43:36.102364 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031762 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031766 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031768 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031771 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031773 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031776 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031779 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031782 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031785 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031788 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031790 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031793 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031796 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031798 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031801 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031803 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031806 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031808 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031811 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031813 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:43:36.103186 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031815 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031818 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.031821 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032195 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032200 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032218 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032223 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032226 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032230 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032233 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032240 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032242 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032245 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032248 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032251 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032253 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032256 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032258 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032261 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032268 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:43:36.104699 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032271 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032273 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032275 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032278 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032280 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032283 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032285 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032288 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032290 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032293 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032295 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032298 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032300 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032303 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032305 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032308 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032310 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032313 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032315 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032318 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:43:36.105882 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032321 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032323 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032329 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032333 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032336 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032339 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032342 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032344 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032347 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032349 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032351 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032354 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032357 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032360 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032362 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032364 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032367 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032371 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032375 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:43:36.106807 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032379 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032382 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032384 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032387 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032389 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032392 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032394 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032397 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032399 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032402 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032405 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032407 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032410 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032413 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032415 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032419 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032422 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032424 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032427 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032431 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:43:36.107693 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032433 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032435 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032438 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032441 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032443 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032446 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032455 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032458 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032460 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032463 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032465 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032468 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032470 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032473 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032475 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032478 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032480 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032483 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032486 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032488 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:43:36.108551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032490 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032493 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.032495 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032564 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032571 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032578 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032584 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032591 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032595 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032599 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032605 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032608 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032611 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032615 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032618 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032621 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032623 2583 flags.go:64] FLAG: --cgroup-root="" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032626 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032629 2583 flags.go:64] FLAG: --client-ca-file="" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032633 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032636 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032641 2583 flags.go:64] FLAG: --cluster-domain="" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032643 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032646 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 22:43:36.109423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032649 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032654 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032658 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032661 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032664 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032667 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032670 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032673 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032676 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032679 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032682 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032686 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032689 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032692 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032694 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032698 2583 flags.go:64] FLAG: --enable-server="true" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032701 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032705 2583 flags.go:64] FLAG: --event-burst="100" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032708 2583 flags.go:64] FLAG: --event-qps="50" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032711 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032714 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032717 2583 flags.go:64] FLAG: --eviction-hard="" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032720 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032723 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032726 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 22:43:36.110477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032729 2583 flags.go:64] FLAG: --eviction-soft="" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032732 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032735 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032738 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032741 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032744 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032747 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032750 2583 flags.go:64] FLAG: --feature-gates="" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032755 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032758 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032761 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032764 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032767 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032770 2583 flags.go:64] FLAG: --help="false" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032773 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032776 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032779 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032782 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032785 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032788 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032791 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032794 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032798 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 22:43:36.111380 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032801 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032804 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032807 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032810 2583 flags.go:64] FLAG: --kube-reserved="" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032813 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032815 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032818 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032821 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032824 2583 flags.go:64] FLAG: --lock-file="" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032827 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032830 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032832 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032837 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032840 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032843 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032846 2583 flags.go:64] FLAG: --logging-format="text" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032849 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032854 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032857 2583 flags.go:64] FLAG: --manifest-url="" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032859 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032863 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032866 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032870 2583 flags.go:64] FLAG: --max-pods="110" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032873 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032876 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 22:43:36.112480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032879 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032881 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032884 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032887 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032890 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032897 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032901 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032904 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032907 2583 flags.go:64] FLAG: --pod-cidr="" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032910 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032916 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032918 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032921 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032924 2583 flags.go:64] FLAG: --port="10250" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032927 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032930 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-006f0769163b986d6" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032933 2583 flags.go:64] FLAG: --qos-reserved="" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032936 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032939 2583 flags.go:64] FLAG: --register-node="true" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032941 2583 flags.go:64] FLAG: --register-with-taints="" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032945 2583 flags.go:64] FLAG: --registry-burst="10" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032948 2583 flags.go:64] FLAG: --registry-qps="5" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032951 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032954 2583 flags.go:64] FLAG: --reserved-memory="" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032958 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 22:43:36.116091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032961 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032964 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032967 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032970 2583 flags.go:64] FLAG: --runonce="false" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032973 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032976 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032979 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032982 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032984 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032987 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032990 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032993 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032996 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.032998 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033003 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033005 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033008 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033011 2583 flags.go:64] FLAG: --system-cgroups="" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033014 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033019 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033022 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033024 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033029 2583 flags.go:64] FLAG: --tls-min-version="" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033031 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033034 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 22:43:36.116959 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033037 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033040 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033042 2583 flags.go:64] FLAG: --v="2" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033046 2583 flags.go:64] FLAG: --version="false" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033050 2583 flags.go:64] FLAG: --vmodule="" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033054 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033059 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033166 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033169 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033172 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033175 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033178 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033181 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033184 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033187 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033190 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033192 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033195 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033197 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033200 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033220 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:43:36.208928 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033224 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033227 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033230 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033232 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033235 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033238 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033240 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033243 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033246 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033248 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033251 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033253 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033256 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033258 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033261 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033263 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033267 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033270 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033273 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033276 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:43:36.210130 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033278 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033282 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033286 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033289 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033293 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033296 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033299 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033302 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033305 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033308 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033310 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033314 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033319 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033322 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033324 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033327 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033329 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033332 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033334 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:43:36.211074 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033337 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033339 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033342 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033344 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033347 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033349 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033352 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033354 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033357 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033359 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033364 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033367 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033369 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033372 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033374 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033377 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033380 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033382 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033385 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033387 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:43:36.211945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033390 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033393 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033395 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033398 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033400 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033404 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033407 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033410 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033412 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033415 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033417 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033420 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033423 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033425 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033428 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033430 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033432 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033435 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033438 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033440 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:43:36.212624 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033442 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033445 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033449 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033452 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033455 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.033457 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.033463 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.040345 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.040360 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.041231 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.041246 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041314 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041320 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041323 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041326 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:43:36.213306 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041328 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041331 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041334 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041336 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041339 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041344 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041346 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041349 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041351 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041354 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041357 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041359 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041361 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041364 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041367 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041369 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041372 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041374 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041377 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041379 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:43:36.213817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041382 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041388 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041391 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041395 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041399 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041403 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041406 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041409 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041412 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041414 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041417 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041419 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041422 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041424 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041427 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041430 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041433 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041436 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041439 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:43:36.214476 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041442 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041444 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041447 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041450 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041452 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041455 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041457 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041460 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041462 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041465 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041467 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041470 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041473 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041475 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041479 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041482 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041484 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041487 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041490 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041498 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:43:36.215031 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041501 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041505 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041509 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041511 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041514 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041517 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041520 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041523 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041526 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041528 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041532 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041535 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041538 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041541 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041544 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041546 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041549 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041552 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041555 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:43:36.215659 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041557 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041560 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041563 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041565 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041568 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041570 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041573 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041577 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041579 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041582 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041585 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041587 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041591 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041601 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041604 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041606 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:43:36.216551 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041609 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.041614 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041770 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041775 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041778 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041781 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041784 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041788 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041793 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041795 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041798 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041801 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041804 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041807 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:43:36.217244 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041809 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041812 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041818 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041821 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041823 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041826 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041829 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041832 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041834 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041839 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041842 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041845 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041847 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041850 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041852 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041855 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041863 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041866 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041868 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:43:36.217712 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041871 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041875 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041878 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041881 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041883 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041886 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041889 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041895 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041898 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041901 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041904 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041907 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041909 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041912 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041914 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041917 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041920 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041922 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041925 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:43:36.218614 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041927 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041929 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041932 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041936 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041938 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041941 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041943 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041946 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041949 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041951 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041954 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041961 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041964 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041967 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041969 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041972 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041975 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041977 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041980 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041982 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:43:36.219541 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041986 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041989 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041991 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041994 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041996 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.041999 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042001 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042004 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042006 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042009 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042011 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042014 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042016 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042019 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042021 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042025 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042028 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042030 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042034 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042037 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:43:36.220250 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042040 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042042 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042044 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042047 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042056 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042059 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042061 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042064 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:36.042067 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.042071 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.042164 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.044112 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.045320 2583 server.go:1019] "Starting client certificate rotation" Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.045424 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 22:43:36.220983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.046730 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.048877 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.051526 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.060961 2583 log.go:25] "Validated CRI v1 runtime API" Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.064627 2583 log.go:25] "Validated CRI v1 image API" Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.065229 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.072817 2583 fs.go:135] Filesystem UUIDs: map[73bb7830-1621-4e8f-90e3-3b4e29516003:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c7af6c48-b226-4ec3-9ba7-139be704f902:/dev/nvme0n1p3] Jul 08 22:43:36.221447 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.072834 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.077704 2583 manager.go:216] Machine: {Timestamp:2026-07-08 22:43:36.076677354 +0000 UTC m=+0.327659668 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108637 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26d6f74a0ece4131f5606129278a6d SystemUUID:ec26d6f7-4a0e-ce41-31f5-606129278a6d BootID:357550c0-02aa-446b-b52f-a616128445bf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8f:05:24:00:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8f:05:24:00:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:9a:a7:03:c1:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.077800 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.077868 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.078887 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.078921 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.079082 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.079555 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.079566 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.079573 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.079596 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.080805 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085514 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085649 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085680 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085692 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085709 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 22:43:36.221909 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085720 2583 kubelet.go:398] "Adding apiserver pod source" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.085730 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.086094 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.086112 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.088530 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.090234 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.090271 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091219 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091236 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091245 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091254 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091266 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091274 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091286 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091294 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091302 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091310 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091321 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.091338 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.092470 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.092480 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.095129 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-454hl" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.095926 2583 server.go:1268] "Started kubelet" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.096336 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.098188 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.099184 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.099238 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.100967 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.102427 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-454hl" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.103680 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.104364 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.104704 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.104819 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.105294 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.106301 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.106710 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.106748 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.106759 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.107672 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.107829 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.108337 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 08 22:43:36.224711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.108346 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.107676 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-102.ec2.internal.18c071d5ef534798 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-102.ec2.internal,UID:ip-10-0-132-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-102.ec2.internal,},FirstTimestamp:2026-07-08 22:43:36.095901592 +0000 UTC m=+0.346883868,LastTimestamp:2026-07-08 22:43:36.095901592 +0000 UTC m=+0.346883868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-102.ec2.internal,}" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.108969 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110240 2583 factory.go:55] Registering systemd factory Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110254 2583 factory.go:223] Registration of the systemd container factory successfully Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110605 2583 factory.go:153] Registering CRI-O factory Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110617 2583 factory.go:223] Registration of the crio container factory successfully Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110655 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110675 2583 factory.go:103] Registering Raw factory Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110692 2583 manager.go:1196] Started watching for new ooms in manager Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.110936 2583 manager.go:349] Starting recovery of all containers Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.135573 2583 manager.go:354] Recovery completed Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.139817 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.143181 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.143198 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.143222 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.143712 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.143719 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.143735 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145002 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.145109 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-102.ec2.internal.18c071d5f224d984 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-102.ec2.internal,UID:ip-10-0-132-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-102.ec2.internal,},FirstTimestamp:2026-07-08 22:43:36.143190404 +0000 UTC m=+0.394172678,LastTimestamp:2026-07-08 22:43:36.143190404 +0000 UTC m=+0.394172678,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-102.ec2.internal,}" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145666 2583 policy_none.go:49] "None policy: Start" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145677 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145686 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145872 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145896 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.145910 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.147684 2583 policy_none.go:47] "Start" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.193913 2583 manager.go:337] "Starting Device Plugin manager" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.194057 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.194070 2583 server.go:87] "Starting device plugin registration server" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.194352 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.194368 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.194498 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.194593 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.194605 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 22:43:36.226039 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.195142 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 22:43:36.227846 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.195185 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.295558 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.296765 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.296800 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.296812 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.296841 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.305337 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.305721 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.305748 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-102.ec2.internal\": node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.306688 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.306719 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.306738 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.306771 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 22:43:36.319104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.308794 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.353649 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.408081 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal"] Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.408144 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.412958 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.412983 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.413007 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.415453 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.415581 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.415614 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.417273 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.417280 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.417300 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.417305 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.417316 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.417318 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.419717 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.419741 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.421845 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.421874 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:43:36.436981 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.421886 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:43:36.527956 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.445991 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-102.ec2.internal\" not found" node="ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.527956 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.452522 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-102.ec2.internal\" not found" node="ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.527956 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.454575 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.527956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.512963 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39075cd2ef36173f182863b8b08c612c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-102.ec2.internal\" (UID: \"39075cd2ef36173f182863b8b08c612c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.527956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.512985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8766ae8315f29d3f1f891302840c96e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal\" (UID: \"8766ae8315f29d3f1f891302840c96e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.527956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.513004 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8766ae8315f29d3f1f891302840c96e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal\" (UID: \"8766ae8315f29d3f1f891302840c96e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.556160 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.613709 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8766ae8315f29d3f1f891302840c96e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal\" (UID: \"8766ae8315f29d3f1f891302840c96e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.613744 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8766ae8315f29d3f1f891302840c96e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal\" (UID: \"8766ae8315f29d3f1f891302840c96e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.613762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39075cd2ef36173f182863b8b08c612c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-102.ec2.internal\" (UID: \"39075cd2ef36173f182863b8b08c612c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.613807 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39075cd2ef36173f182863b8b08c612c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-102.ec2.internal\" (UID: \"39075cd2ef36173f182863b8b08c612c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.613813 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8766ae8315f29d3f1f891302840c96e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal\" (UID: \"8766ae8315f29d3f1f891302840c96e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.646498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.613824 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8766ae8315f29d3f1f891302840c96e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal\" (UID: \"8766ae8315f29d3f1f891302840c96e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.772837 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.658580 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.772837 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.751138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.772837 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:36.756262 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" Jul 08 22:43:36.772837 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.759581 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:36.871813 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.859727 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.029568 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:36.961665 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.164928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.045140 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 22:43:37.164928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.045298 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 22:43:37.164928 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:37.062690 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.164928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.125558 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 22:38:36 +0000 UTC" deadline="2027-12-06 05:45:18.662187592 +0000 UTC" Jul 08 22:43:37.164928 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.125580 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12367h1m41.536611252s" Jul 08 22:43:37.164928 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:37.162775 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.283969 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.207446 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:43:37.283969 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:37.263601 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.382061 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:37.363719 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.382061 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.380595 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:43:37.423883 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:37.423856 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39075cd2ef36173f182863b8b08c612c.slice/crio-96b7e97dfe40a81501ee4ed4ed8a8da58ddcbfed37b3bed6f9b0525968603c33 WatchSource:0}: Error finding container 96b7e97dfe40a81501ee4ed4ed8a8da58ddcbfed37b3bed6f9b0525968603c33: Status 404 returned error can't find the container with id 96b7e97dfe40a81501ee4ed4ed8a8da58ddcbfed37b3bed6f9b0525968603c33 Jul 08 22:43:37.424520 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:37.424505 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8766ae8315f29d3f1f891302840c96e4.slice/crio-a6a9ad23f910fb21bcb9c779a99ee58f1cc3647cd7053acfd2f43d81d6652081 WatchSource:0}: Error finding container a6a9ad23f910fb21bcb9c779a99ee58f1cc3647cd7053acfd2f43d81d6652081: Status 404 returned error can't find the container with id a6a9ad23f910fb21bcb9c779a99ee58f1cc3647cd7053acfd2f43d81d6652081 Jul 08 22:43:37.433022 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.433005 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 22:43:37.465149 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:37.465124 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.566191 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:37.566133 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-102.ec2.internal\" not found" Jul 08 22:43:37.609715 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.609696 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:43:37.707778 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.707743 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" Jul 08 22:43:37.717610 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.717587 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 22:43:37.718598 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.718585 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" Jul 08 22:43:37.729993 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:37.729975 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 22:43:38.087974 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.087945 2583 apiserver.go:52] "Watching apiserver" Jul 08 22:43:38.094778 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.094756 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 22:43:38.095239 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.095205 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal","openshift-multus/multus-additional-cni-plugins-8v2pw","openshift-multus/multus-jrj4k","openshift-network-operator/iptables-alerter-rqwsd","openshift-ovn-kubernetes/ovnkube-node-lrds9","kube-system/global-pull-secret-syncer-n7zlk","kube-system/konnectivity-agent-2mhm9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458","openshift-dns/node-resolver-6mggh","openshift-multus/network-metrics-daemon-flbdz","openshift-network-diagnostics/network-check-target-99q8d","kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dtklw","openshift-image-registry/node-ca-pxg9c"] Jul 08 22:43:38.098002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.097954 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.100404 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.100379 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.101112 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.100883 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 22:43:38.101112 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.100921 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s2r49\"" Jul 08 22:43:38.101112 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.101031 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 22:43:38.106563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.103775 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.106563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.103963 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6fm2l\"" Jul 08 22:43:38.106563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.104350 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.106563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.104640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.106563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.105081 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 22:43:38.106563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.106470 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.106908 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.106669 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8hltl\"" Jul 08 22:43:38.106908 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.106896 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 22:43:38.107206 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.107162 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 22:43:38.107602 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.107569 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.109427 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.109406 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.111203 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.111184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.111935 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.111905 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.111935 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.111933 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.112383 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.112214 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 22:43:38.112708 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.112687 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fmfbs\"" Jul 08 22:43:38.113724 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.113690 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.113864 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.113834 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:38.114470 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.114449 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f4jns\"" Jul 08 22:43:38.114935 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.114912 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.115393 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.115284 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 22:43:38.115393 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.115337 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 22:43:38.115572 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.115532 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.115572 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.115555 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 22:43:38.115572 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.115561 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 22:43:38.116519 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.116501 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.118630 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.118611 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.118885 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.118865 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n5skr\"" Jul 08 22:43:38.118984 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.118964 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.119055 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.118968 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.120453 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.120429 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 22:43:38.121211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.121193 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.121519 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.121497 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.121733 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.121708 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 22:43:38.121955 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.121933 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dcsmm\"" Jul 08 22:43:38.122046 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.122026 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.123827 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.123771 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 22:43:38.123938 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.123849 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7d42z\"" Jul 08 22:43:38.123938 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.123890 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 22:43:38.124176 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.124161 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.124440 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.124281 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:38.126764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.126744 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:38.126863 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.126824 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:38.129374 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.129350 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.131843 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.131818 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 22:43:38.131938 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.131880 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 22:43:38.132008 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.131934 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nbd9w\"" Jul 08 22:43:38.132008 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.131948 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 22:43:38.137416 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137385 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-tmp\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.137506 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137423 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-cnibin\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.137506 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137456 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-host-slash\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.137506 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525dcfc5-9998-4b49-91bd-06c5eff7d742-agent-certs\") pod \"konnectivity-agent-2mhm9\" (UID: \"525dcfc5-9998-4b49-91bd-06c5eff7d742\") " pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.137676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525dcfc5-9998-4b49-91bd-06c5eff7d742-konnectivity-ca\") pod \"konnectivity-agent-2mhm9\" (UID: \"525dcfc5-9998-4b49-91bd-06c5eff7d742\") " pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.137676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137534 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-tuned\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.137676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-cni-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.137676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-daemon-config\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.137676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137607 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-iptables-alerter-script\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.137676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137649 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs4fp\" (UniqueName: \"kubernetes.io/projected/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-kube-api-access-bs4fp\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137676 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-kubernetes\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137734 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysctl-d\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-hostroot\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-run\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137841 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-lib-modules\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-socket-dir-parent\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.137978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmq7s\" (UniqueName: \"kubernetes.io/projected/06606831-048b-480b-be44-3d2b1f2c0bb6-kube-api-access-kmq7s\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.137980 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06606831-048b-480b-be44-3d2b1f2c0bb6-cni-binary-copy\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138028 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-netns\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138049 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-etc-kubernetes\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138082 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-host\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-multus-certs\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-cni-bin\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-modprobe-d\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138198 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysconfig\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-var-lib-kubelet\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138287 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfx5l\" (UniqueName: \"kubernetes.io/projected/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-kube-api-access-jfx5l\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138314 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-os-release\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-cni-multus\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-kubelet\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138467 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysctl-conf\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138506 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-systemd\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138532 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-sys\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-system-cni-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-k8s-cni-cncf-io\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.138917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.138627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-conf-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.143742 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.143720 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pggs8" Jul 08 22:43:38.151571 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.151545 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pggs8" Jul 08 22:43:38.208615 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.208583 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239400 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-host-slash\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239445 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovnkube-config\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-env-overrides\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwt9\" (UniqueName: \"kubernetes.io/projected/d2c502bd-45c4-4182-bc60-2bb286399958-kube-api-access-ppwt9\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239523 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-host-slash\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239530 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-device-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239552 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239587 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525dcfc5-9998-4b49-91bd-06c5eff7d742-agent-certs\") pod \"konnectivity-agent-2mhm9\" (UID: \"525dcfc5-9998-4b49-91bd-06c5eff7d742\") " pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-tuned\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239638 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-cni-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-daemon-config\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-iptables-alerter-script\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs4fp\" (UniqueName: \"kubernetes.io/projected/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-kube-api-access-bs4fp\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-kubelet\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239767 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-slash\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovnkube-script-lib\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.240307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.241211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239858 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23de7db5-e96d-4739-826b-7bba6b4204f9-kubelet-config\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.241211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239883 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-registration-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.241211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239910 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx46q\" (UniqueName: \"kubernetes.io/projected/353c70ec-e086-46d3-b0cd-63bb7d480fbf-kube-api-access-wx46q\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.241211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-run\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.241211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239961 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 22:43:38.241211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.240561 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06606831-048b-480b-be44-3d2b1f2c0bb6-cni-binary-copy\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.241882 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-cni-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242047 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-run\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.239978 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06606831-048b-480b-be44-3d2b1f2c0bb6-cni-binary-copy\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242107 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-netns\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-cni-netd\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-host\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-multus-certs\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242241 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-iptables-alerter-script\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242268 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-log-socket\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242317 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-netns\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242342 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-cnibin\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242376 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-host\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242391 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242415 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-multus-certs\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242418 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-daemon-config\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.242449 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dcf\" (UniqueName: \"kubernetes.io/projected/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-kube-api-access-r7dcf\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysconfig\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242504 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-var-lib-kubelet\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-os-release\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-cni-multus\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242591 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysconfig\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242626 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-cni-multus\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242650 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-os-release\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-kubelet\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242704 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-run-netns\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-ovn\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242746 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-var-lib-kubelet\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-k8s-cni-cncf-io\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242789 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-kubelet\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242809 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-conf-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2c502bd-45c4-4182-bc60-2bb286399958-hosts-file\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49rgm\" (UniqueName: \"kubernetes.io/projected/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-kube-api-access-49rgm\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242907 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-conf-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.243361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-cnibin\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242955 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-run-k8s-cni-cncf-io\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.242964 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-etc-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243003 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-host\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243012 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-cnibin\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243029 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525dcfc5-9998-4b49-91bd-06c5eff7d742-konnectivity-ca\") pod \"konnectivity-agent-2mhm9\" (UID: \"525dcfc5-9998-4b49-91bd-06c5eff7d742\") " pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243112 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-system-cni-dir\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-socket-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243353 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-kubernetes\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysctl-d\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-hostroot\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-lib-modules\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-socket-dir-parent\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243503 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmq7s\" (UniqueName: \"kubernetes.io/projected/06606831-048b-480b-be44-3d2b1f2c0bb6-kube-api-access-kmq7s\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovn-node-metrics-cert\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243553 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-os-release\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.244246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243591 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-etc-kubernetes\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243631 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525dcfc5-9998-4b49-91bd-06c5eff7d742-konnectivity-ca\") pod \"konnectivity-agent-2mhm9\" (UID: \"525dcfc5-9998-4b49-91bd-06c5eff7d742\") " pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-systemd-units\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243691 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-hostroot\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243733 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-etc-kubernetes\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243744 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-multus-socket-dir-parent\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243837 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-lib-modules\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243885 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-kubernetes\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244015 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysctl-d\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.243694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244052 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-var-lib-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244129 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-cni-bin\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244180 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244208 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c502bd-45c4-4182-bc60-2bb286399958-tmp-dir\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.245123 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244270 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-serviceca\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244323 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-sys-fs\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244363 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244401 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-node-log\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-cni-bin\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244475 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-host-var-lib-cni-bin\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244509 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-modprobe-d\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244544 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx5l\" (UniqueName: \"kubernetes.io/projected/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-kube-api-access-jfx5l\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-systemd\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244620 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-modprobe-d\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwq9r\" (UniqueName: \"kubernetes.io/projected/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-kube-api-access-bwq9r\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23de7db5-e96d-4739-826b-7bba6b4204f9-dbus\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysctl-conf\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-systemd\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-sys\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244838 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-system-cni-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244864 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx5bh\" (UniqueName: \"kubernetes.io/projected/1426a6b8-f0f0-4459-93b4-c6092610cb05-kube-api-access-vx5bh\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.246002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:38.246948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244893 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-sysctl-conf\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244901 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-systemd\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244915 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-tmp\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244960 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06606831-048b-480b-be44-3d2b1f2c0bb6-system-cni-dir\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.246948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.244961 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-sys\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.246948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.245842 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525dcfc5-9998-4b49-91bd-06c5eff7d742-agent-certs\") pod \"konnectivity-agent-2mhm9\" (UID: \"525dcfc5-9998-4b49-91bd-06c5eff7d742\") " pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.248890 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.248815 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-etc-tuned\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.250015 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.249988 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-tmp\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.252211 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.251994 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs4fp\" (UniqueName: \"kubernetes.io/projected/ff59e947-6f17-4a09-a949-1e36b3bfc2c3-kube-api-access-bs4fp\") pod \"iptables-alerter-rqwsd\" (UID: \"ff59e947-6f17-4a09-a949-1e36b3bfc2c3\") " pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.252975 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.252923 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmq7s\" (UniqueName: \"kubernetes.io/projected/06606831-048b-480b-be44-3d2b1f2c0bb6-kube-api-access-kmq7s\") pod \"multus-jrj4k\" (UID: \"06606831-048b-480b-be44-3d2b1f2c0bb6\") " pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.254623 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.254593 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfx5l\" (UniqueName: \"kubernetes.io/projected/2e751c03-ab8a-4fd0-8b85-af13ac1f21c2-kube-api-access-jfx5l\") pod \"tuned-dtklw\" (UID: \"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2\") " pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.314033 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.313971 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" event={"ID":"8766ae8315f29d3f1f891302840c96e4","Type":"ContainerStarted","Data":"a6a9ad23f910fb21bcb9c779a99ee58f1cc3647cd7053acfd2f43d81d6652081"} Jul 08 22:43:38.318714 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.318686 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" event={"ID":"39075cd2ef36173f182863b8b08c612c","Type":"ContainerStarted","Data":"96b7e97dfe40a81501ee4ed4ed8a8da58ddcbfed37b3bed6f9b0525968603c33"} Jul 08 22:43:38.345665 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345599 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-etc-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.345665 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-host\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345668 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-system-cni-dir\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-socket-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345750 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovn-node-metrics-cert\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-os-release\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345787 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-etc-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345799 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-systemd-units\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.345856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-var-lib-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-cni-bin\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345953 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-socket-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.345992 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346009 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-cni-bin\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346022 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c502bd-45c4-4182-bc60-2bb286399958-tmp-dir\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346089 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-serviceca\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346115 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-sys-fs\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-node-log\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-systemd\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346269 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwq9r\" (UniqueName: \"kubernetes.io/projected/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-kube-api-access-bwq9r\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23de7db5-e96d-4739-826b-7bba6b4204f9-dbus\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346324 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx5bh\" (UniqueName: \"kubernetes.io/projected/1426a6b8-f0f0-4459-93b4-c6092610cb05-kube-api-access-vx5bh\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346383 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovnkube-config\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-env-overrides\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346434 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwt9\" (UniqueName: \"kubernetes.io/projected/d2c502bd-45c4-4182-bc60-2bb286399958-kube-api-access-ppwt9\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-device-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346494 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-kubelet\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-slash\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovnkube-script-lib\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346628 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23de7db5-e96d-4739-826b-7bba6b4204f9-kubelet-config\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-registration-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx46q\" (UniqueName: \"kubernetes.io/projected/353c70ec-e086-46d3-b0cd-63bb7d480fbf-kube-api-access-wx46q\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346727 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-cni-netd\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.346950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346782 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-log-socket\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-cnibin\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dcf\" (UniqueName: \"kubernetes.io/projected/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-kube-api-access-r7dcf\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-run-netns\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-ovn\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.346974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2c502bd-45c4-4182-bc60-2bb286399958-hosts-file\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347007 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49rgm\" (UniqueName: \"kubernetes.io/projected/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-kube-api-access-49rgm\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347065 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-os-release\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347243 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-device-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347283 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-node-log\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-systemd\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347351 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-host\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347403 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347447 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-system-cni-dir\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347640 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.347897 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347665 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-cni-netd\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347747 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-kubelet\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347805 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-slash\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347873 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-systemd-units\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347952 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347966 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347966 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.347642 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23de7db5-e96d-4739-826b-7bba6b4204f9-dbus\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.348044 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348047 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-sys-fs\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348092 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.348118 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:38.848096918 +0000 UTC m=+3.099079187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348331 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-env-overrides\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348364 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23de7db5-e96d-4739-826b-7bba6b4204f9-kubelet-config\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348398 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c502bd-45c4-4182-bc60-2bb286399958-tmp-dir\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348413 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348408 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovnkube-script-lib\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.348814 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348481 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-var-lib-openvswitch\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348518 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/353c70ec-e086-46d3-b0cd-63bb7d480fbf-registration-dir\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.348595 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348615 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-serviceca\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348682 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-log-socket\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.348695 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:38.848675423 +0000 UTC m=+3.099657706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348748 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-host-run-netns\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348792 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-cnibin\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348839 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-run-ovn\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348825 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1426a6b8-f0f0-4459-93b4-c6092610cb05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348891 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovnkube-config\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348901 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2c502bd-45c4-4182-bc60-2bb286399958-hosts-file\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.349764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.348953 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1426a6b8-f0f0-4459-93b4-c6092610cb05-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.350591 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.350570 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-ovn-node-metrics-cert\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.362295 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.362252 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:43:38.362295 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.362287 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:43:38.362468 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.362302 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:38.362468 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.362449 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:43:38.86242357 +0000 UTC m=+3.113405866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:38.366108 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.366058 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwq9r\" (UniqueName: \"kubernetes.io/projected/637817b3-ba19-4dc4-bd5d-8a1f4be5f068-kube-api-access-bwq9r\") pod \"ovnkube-node-lrds9\" (UID: \"637817b3-ba19-4dc4-bd5d-8a1f4be5f068\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.366200 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.366173 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx5bh\" (UniqueName: \"kubernetes.io/projected/1426a6b8-f0f0-4459-93b4-c6092610cb05-kube-api-access-vx5bh\") pod \"multus-additional-cni-plugins-8v2pw\" (UID: \"1426a6b8-f0f0-4459-93b4-c6092610cb05\") " pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.367558 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.367533 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49rgm\" (UniqueName: \"kubernetes.io/projected/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-kube-api-access-49rgm\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.368088 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.368061 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwt9\" (UniqueName: \"kubernetes.io/projected/d2c502bd-45c4-4182-bc60-2bb286399958-kube-api-access-ppwt9\") pod \"node-resolver-6mggh\" (UID: \"d2c502bd-45c4-4182-bc60-2bb286399958\") " pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.369637 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.369617 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dcf\" (UniqueName: \"kubernetes.io/projected/daec4e02-5cf1-4ed7-b72b-30d06ab21d93-kube-api-access-r7dcf\") pod \"node-ca-pxg9c\" (UID: \"daec4e02-5cf1-4ed7-b72b-30d06ab21d93\") " pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.369637 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.369627 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx46q\" (UniqueName: \"kubernetes.io/projected/353c70ec-e086-46d3-b0cd-63bb7d480fbf-kube-api-access-wx46q\") pod \"aws-ebs-csi-driver-node-lb458\" (UID: \"353c70ec-e086-46d3-b0cd-63bb7d480fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.412564 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.412472 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:43:38.421520 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.421499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtklw" Jul 08 22:43:38.426064 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:38.426034 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525dcfc5_9998_4b49_91bd_06c5eff7d742.slice/crio-dfb14734559bc6e331c1692b2260a659931ee2c5362808ae978a032ac77e9017 WatchSource:0}: Error finding container dfb14734559bc6e331c1692b2260a659931ee2c5362808ae978a032ac77e9017: Status 404 returned error can't find the container with id dfb14734559bc6e331c1692b2260a659931ee2c5362808ae978a032ac77e9017 Jul 08 22:43:38.431842 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.431819 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrj4k" Jul 08 22:43:38.433821 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:38.433787 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e751c03_ab8a_4fd0_8b85_af13ac1f21c2.slice/crio-aba50f0fbb63824756dbe7f5ef31a905b713a9901ac769f19a2b1e26ceeca6dc WatchSource:0}: Error finding container aba50f0fbb63824756dbe7f5ef31a905b713a9901ac769f19a2b1e26ceeca6dc: Status 404 returned error can't find the container with id aba50f0fbb63824756dbe7f5ef31a905b713a9901ac769f19a2b1e26ceeca6dc Jul 08 22:43:38.438913 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.438888 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rqwsd" Jul 08 22:43:38.444836 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:38.444806 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06606831_048b_480b_be44_3d2b1f2c0bb6.slice/crio-2c39e0a7f21295497458cbd2c22d94bfd778c68d76cd25fdcc0e44536db3f9e9 WatchSource:0}: Error finding container 2c39e0a7f21295497458cbd2c22d94bfd778c68d76cd25fdcc0e44536db3f9e9: Status 404 returned error can't find the container with id 2c39e0a7f21295497458cbd2c22d94bfd778c68d76cd25fdcc0e44536db3f9e9 Jul 08 22:43:38.447786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.447606 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:43:38.455125 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:38.455099 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff59e947_6f17_4a09_a949_1e36b3bfc2c3.slice/crio-8ab7bf7d4295da0efa41e920bda60d048cc00062cc7cb49b06fac1db7a691ae0 WatchSource:0}: Error finding container 8ab7bf7d4295da0efa41e920bda60d048cc00062cc7cb49b06fac1db7a691ae0: Status 404 returned error can't find the container with id 8ab7bf7d4295da0efa41e920bda60d048cc00062cc7cb49b06fac1db7a691ae0 Jul 08 22:43:38.456626 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.456475 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mggh" Jul 08 22:43:38.462147 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:38.461841 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637817b3_ba19_4dc4_bd5d_8a1f4be5f068.slice/crio-670ecd588396fe84e349f1a9ea4dfbe37eda2666c54a10391c9797ce3bd9652e WatchSource:0}: Error finding container 670ecd588396fe84e349f1a9ea4dfbe37eda2666c54a10391c9797ce3bd9652e: Status 404 returned error can't find the container with id 670ecd588396fe84e349f1a9ea4dfbe37eda2666c54a10391c9797ce3bd9652e Jul 08 22:43:38.467592 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.467570 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pxg9c" Jul 08 22:43:38.469417 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:38.469390 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c502bd_45c4_4182_bc60_2bb286399958.slice/crio-0b53b4d943c735532f4faaf8350b4c7a6442d33bf237f74105af99fbaa05cd47 WatchSource:0}: Error finding container 0b53b4d943c735532f4faaf8350b4c7a6442d33bf237f74105af99fbaa05cd47: Status 404 returned error can't find the container with id 0b53b4d943c735532f4faaf8350b4c7a6442d33bf237f74105af99fbaa05cd47 Jul 08 22:43:38.476668 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.476647 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" Jul 08 22:43:38.483879 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.483845 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" Jul 08 22:43:38.509762 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.509738 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:43:38.850098 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.850069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:38.850271 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.850155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:38.850271 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.850248 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:38.850271 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.850255 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:38.850419 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.850323 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:39.850301253 +0000 UTC m=+4.101283743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:38.850419 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.850338 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:39.850331726 +0000 UTC m=+4.101313989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:38.950579 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:38.950537 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:38.950769 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.950728 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:43:38.950769 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.950746 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:43:38.950769 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.950756 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:38.950925 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:38.950815 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:43:39.950796692 +0000 UTC m=+4.201778973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:39.155953 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.155836 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:38:38 +0000 UTC" deadline="2028-03-04 17:31:18.910772165 +0000 UTC" Jul 08 22:43:39.155953 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.155896 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14514h47m39.754880548s" Jul 08 22:43:39.212294 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:39.212205 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaec4e02_5cf1_4ed7_b72b_30d06ab21d93.slice/crio-6ddfcbaed769a42073c0463a2de8c3f1e5463257f47bfb287f26fe1c8b55c0b5 WatchSource:0}: Error finding container 6ddfcbaed769a42073c0463a2de8c3f1e5463257f47bfb287f26fe1c8b55c0b5: Status 404 returned error can't find the container with id 6ddfcbaed769a42073c0463a2de8c3f1e5463257f47bfb287f26fe1c8b55c0b5 Jul 08 22:43:39.307446 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.307106 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:39.307446 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.307262 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:39.307446 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.307307 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:39.307446 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.307432 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:39.322789 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.322687 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"670ecd588396fe84e349f1a9ea4dfbe37eda2666c54a10391c9797ce3bd9652e"} Jul 08 22:43:39.325204 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.325141 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rqwsd" event={"ID":"ff59e947-6f17-4a09-a949-1e36b3bfc2c3","Type":"ContainerStarted","Data":"8ab7bf7d4295da0efa41e920bda60d048cc00062cc7cb49b06fac1db7a691ae0"} Jul 08 22:43:39.327201 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.327129 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrj4k" event={"ID":"06606831-048b-480b-be44-3d2b1f2c0bb6","Type":"ContainerStarted","Data":"2c39e0a7f21295497458cbd2c22d94bfd778c68d76cd25fdcc0e44536db3f9e9"} Jul 08 22:43:39.328473 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.328407 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mggh" event={"ID":"d2c502bd-45c4-4182-bc60-2bb286399958","Type":"ContainerStarted","Data":"0b53b4d943c735532f4faaf8350b4c7a6442d33bf237f74105af99fbaa05cd47"} Jul 08 22:43:39.331990 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.331962 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtklw" event={"ID":"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2","Type":"ContainerStarted","Data":"aba50f0fbb63824756dbe7f5ef31a905b713a9901ac769f19a2b1e26ceeca6dc"} Jul 08 22:43:39.334467 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.334404 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mhm9" event={"ID":"525dcfc5-9998-4b49-91bd-06c5eff7d742","Type":"ContainerStarted","Data":"dfb14734559bc6e331c1692b2260a659931ee2c5362808ae978a032ac77e9017"} Jul 08 22:43:39.336437 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.336350 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pxg9c" event={"ID":"daec4e02-5cf1-4ed7-b72b-30d06ab21d93","Type":"ContainerStarted","Data":"6ddfcbaed769a42073c0463a2de8c3f1e5463257f47bfb287f26fe1c8b55c0b5"} Jul 08 22:43:39.858870 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.858833 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:39.859059 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.859023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:39.859123 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.859068 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:39.859198 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.859152 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:41.859131224 +0000 UTC m=+6.110113513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:39.859263 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.859213 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:39.859346 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.859299 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:41.859275304 +0000 UTC m=+6.110257581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:39.930696 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:39.930666 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353c70ec_e086_46d3_b0cd_63bb7d480fbf.slice/crio-b5db10433b3b0f9ff8cad45e795a612cd82084b82ffb419e74da70692e15d7d2 WatchSource:0}: Error finding container b5db10433b3b0f9ff8cad45e795a612cd82084b82ffb419e74da70692e15d7d2: Status 404 returned error can't find the container with id b5db10433b3b0f9ff8cad45e795a612cd82084b82ffb419e74da70692e15d7d2 Jul 08 22:43:39.937809 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:43:39.937779 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1426a6b8_f0f0_4459_93b4_c6092610cb05.slice/crio-1fdb2acd17ac9c221bd7fe4301c5614ed6a00d4723b669fb043076c26b5608bc WatchSource:0}: Error finding container 1fdb2acd17ac9c221bd7fe4301c5614ed6a00d4723b669fb043076c26b5608bc: Status 404 returned error can't find the container with id 1fdb2acd17ac9c221bd7fe4301c5614ed6a00d4723b669fb043076c26b5608bc Jul 08 22:43:39.959906 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:39.959691 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:39.960003 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.959923 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:43:39.960003 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.959949 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:43:39.960003 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.959962 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:39.960187 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:39.960016 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:43:41.959997152 +0000 UTC m=+6.210979431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:40.156496 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:40.156351 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:38:38 +0000 UTC" deadline="2028-02-28 04:36:40.545665928 +0000 UTC" Jul 08 22:43:40.156496 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:40.156415 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14381h53m0.389256312s" Jul 08 22:43:40.308468 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:40.308436 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:40.308636 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:40.308590 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:40.346222 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:40.346146 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerStarted","Data":"1fdb2acd17ac9c221bd7fe4301c5614ed6a00d4723b669fb043076c26b5608bc"} Jul 08 22:43:40.353452 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:40.353419 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" event={"ID":"353c70ec-e086-46d3-b0cd-63bb7d480fbf","Type":"ContainerStarted","Data":"b5db10433b3b0f9ff8cad45e795a612cd82084b82ffb419e74da70692e15d7d2"} Jul 08 22:43:41.308292 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:41.307566 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:41.308292 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.307701 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:41.308292 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:41.308108 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:41.308292 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.308212 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:41.877703 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:41.877664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:41.877910 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:41.877734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:41.877910 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.877885 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:41.878033 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.877953 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:45.877932891 +0000 UTC m=+10.128915160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:41.878441 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.878417 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:41.878556 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.878483 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:45.878466311 +0000 UTC m=+10.129448578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:41.978602 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:41.978419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:41.978602 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.978586 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:43:41.978602 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.978610 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:43:41.978908 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.978625 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:41.978908 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:41.978692 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:43:45.978668374 +0000 UTC m=+10.229650680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:42.309542 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:42.308716 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:42.309542 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:42.308863 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:43.307393 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:43.307358 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:43.307557 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:43.307504 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:43.307918 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:43.307895 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:43.308038 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:43.308016 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:44.307919 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:44.307834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:44.308420 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:44.308003 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:45.307971 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:45.307935 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:45.308464 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:45.308074 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:45.308464 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:45.308137 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:45.308464 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:45.308265 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:45.908778 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:45.908745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:45.908965 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:45.908823 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:45.908965 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:45.908905 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:45.908965 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:45.908921 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:45.909112 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:45.908972 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:53.908951923 +0000 UTC m=+18.159934200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:45.909112 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:45.908992 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:43:53.908982146 +0000 UTC m=+18.159964411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:46.010064 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:46.010030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:46.010260 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:46.010218 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:43:46.010260 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:46.010244 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:43:46.010260 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:46.010257 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:46.010406 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:46.010314 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:43:54.010297401 +0000 UTC m=+18.261279667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:46.308961 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:46.308883 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:46.309326 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:46.309019 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:47.307477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:47.307445 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:47.307640 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:47.307593 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:47.307750 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:47.307672 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:47.307802 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:47.307787 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:48.308402 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:48.308135 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:48.308792 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:48.308530 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:49.307419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:49.307336 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:49.307574 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:49.307338 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:49.307574 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:49.307457 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:49.307574 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:49.307518 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:50.307785 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:50.307744 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:50.308183 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:50.307898 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:51.307877 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:51.307850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:51.308324 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:51.307879 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:51.308324 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:51.307969 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:51.308324 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:51.308150 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:51.379603 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:51.379563 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" event={"ID":"8766ae8315f29d3f1f891302840c96e4","Type":"ContainerStarted","Data":"95a20280d1d641b679dbc88ac48df7fd4a5778ec82d7cca6ee4a00244030978e"} Jul 08 22:43:52.307429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:52.307373 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:52.307619 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:52.307500 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:53.307379 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:53.307345 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:53.307758 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:53.307347 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:53.307758 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:53.307445 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:53.307758 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:53.307532 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:53.975870 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:53.975789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:53.976033 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:53.975870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:53.976033 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:53.975958 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:53.976033 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:53.976013 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:09.975997175 +0000 UTC m=+34.226979442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:43:53.976181 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:53.975962 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:53.976181 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:53.976124 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:09.976102865 +0000 UTC m=+34.227085132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:43:54.076698 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:54.076667 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:54.076887 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:54.076866 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:43:54.076948 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:54.076897 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:43:54.076948 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:54.076909 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:54.077047 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:54.076954 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:44:10.076940722 +0000 UTC m=+34.327922984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:43:54.307182 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:54.307095 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:54.307363 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:54.307263 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:55.307324 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:55.307288 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:55.307697 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:55.307302 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:55.307697 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:55.307438 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:55.307697 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:55.307495 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:56.308216 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:56.308172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:56.308658 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:56.308302 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:57.307445 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:57.307410 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:57.307619 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:57.307410 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:57.307619 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:57.307513 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:57.307721 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:57.307639 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:58.308105 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.307608 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:43:58.308105 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:58.307748 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:43:58.394931 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.394696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" event={"ID":"39075cd2ef36173f182863b8b08c612c","Type":"ContainerStarted","Data":"0724c54c7fa1d5e3aae683e153111229c06f13a17799d0d16e52fbae0cbc1e64"} Jul 08 22:43:58.398599 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.398499 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pxg9c" event={"ID":"daec4e02-5cf1-4ed7-b72b-30d06ab21d93","Type":"ContainerStarted","Data":"2b44d5e1832827fe60e302f17419e93af0e0b06d6ce7788836b74f551e4ce21e"} Jul 08 22:43:58.400143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.400122 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"1e006a35be676a3834a07c317d826d6073455914bb420b4211a4d23ef441aea0"} Jul 08 22:43:58.401396 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.401376 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" event={"ID":"353c70ec-e086-46d3-b0cd-63bb7d480fbf","Type":"ContainerStarted","Data":"3453c0765c0cfeba44910a3117eee30eb9614d1ee975597ceaf5683f12616acc"} Jul 08 22:43:58.402769 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.402748 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mggh" event={"ID":"d2c502bd-45c4-4182-bc60-2bb286399958","Type":"ContainerStarted","Data":"6b7465bd0ae53e791bda058c246d6e4ad6026977d8f7bc29f0299c10af7ac3b1"} Jul 08 22:43:58.404259 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.404238 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtklw" event={"ID":"2e751c03-ab8a-4fd0-8b85-af13ac1f21c2","Type":"ContainerStarted","Data":"578e4f5a498fe79015130c9fdd4c326fb50e50d7a2d166c62c8c06351ed91fbf"} Jul 08 22:43:58.405691 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.405665 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mhm9" event={"ID":"525dcfc5-9998-4b49-91bd-06c5eff7d742","Type":"ContainerStarted","Data":"2f32c970698196353b00b31ecf91e6d5f13600a6294c2330773da3771eec710c"} Jul 08 22:43:58.407349 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.407297 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerStarted","Data":"379afc90bf4cc80ba6c90635b1f198d8cb774726250b6292de5318713d8f2e71"} Jul 08 22:43:58.407973 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.407928 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-102.ec2.internal" podStartSLOduration=20.407912886 podStartE2EDuration="20.407912886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:58.407017122 +0000 UTC m=+22.657999409" watchObservedRunningTime="2026-07-08 22:43:58.407912886 +0000 UTC m=+22.658895170" Jul 08 22:43:58.408868 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.408848 2583 generic.go:356] "Generic (PLEG): container finished" podID="8766ae8315f29d3f1f891302840c96e4" containerID="95a20280d1d641b679dbc88ac48df7fd4a5778ec82d7cca6ee4a00244030978e" exitCode=0 Jul 08 22:43:58.408944 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.408874 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" event={"ID":"8766ae8315f29d3f1f891302840c96e4","Type":"ContainerDied","Data":"95a20280d1d641b679dbc88ac48df7fd4a5778ec82d7cca6ee4a00244030978e"} Jul 08 22:43:58.419875 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.419838 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mhm9" podStartSLOduration=1.87099473 podStartE2EDuration="21.419826236s" totalImagesPullingTime="19.548831506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:58.419321529 +0000 UTC m=+22.670303812" watchObservedRunningTime="2026-07-08 22:43:58.419826236 +0000 UTC m=+22.670808519" Jul 08 22:43:58.433389 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.433352 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dtklw" podStartSLOduration=1.903305362 podStartE2EDuration="21.433336647s" totalImagesPullingTime="19.530031285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:58.433180839 +0000 UTC m=+22.684163124" watchObservedRunningTime="2026-07-08 22:43:58.433336647 +0000 UTC m=+22.684318932" Jul 08 22:43:58.445798 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.445766 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6mggh" podStartSLOduration=1.92578484 podStartE2EDuration="21.445755424s" totalImagesPullingTime="19.519970584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:58.445730864 +0000 UTC m=+22.696713148" watchObservedRunningTime="2026-07-08 22:43:58.445755424 +0000 UTC m=+22.696737708" Jul 08 22:43:58.457991 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:58.457958 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pxg9c" podStartSLOduration=2.683127668 podStartE2EDuration="21.457946755s" totalImagesPullingTime="18.774819087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:58.457767698 +0000 UTC m=+22.708749984" watchObservedRunningTime="2026-07-08 22:43:58.457946755 +0000 UTC m=+22.708929040" Jul 08 22:43:59.223034 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.222879 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 22:43:59.307619 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.307590 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:43:59.307619 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.307610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:43:59.307761 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:59.307700 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:43:59.307868 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:43:59.307848 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:43:59.412850 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.412795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" event={"ID":"8766ae8315f29d3f1f891302840c96e4","Type":"ContainerStarted","Data":"90b64680937766e56507fabd2b8563bdef27585776ff178ed0ad06be7c303a91"} Jul 08 22:43:59.415611 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.415588 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"d0da86a497ee28820a8fc917075416d8ecbe40291d95bf3aa4ae0da59fd24c4e"} Jul 08 22:43:59.415729 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.415662 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"be97e953108421df198853595c7638eafa211e2164b86e2c11142036e2a90e49"} Jul 08 22:43:59.415729 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.415717 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"b16d66dff2308ff88f3a578d0b1844c7f7da44944f4e2f7e975147fa0ef3fb3c"} Jul 08 22:43:59.415831 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.415767 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"2b33a5ceb77931aacc5b9d45faf08a505cc3ae2578542090a1639dde594ff239"} Jul 08 22:43:59.415831 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.415811 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"b0733ec51e3a21e3472fedfec6d2c55daac8303b7423d08222ffa986e9f5c3c3"} Jul 08 22:43:59.417126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.417106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rqwsd" event={"ID":"ff59e947-6f17-4a09-a949-1e36b3bfc2c3","Type":"ContainerStarted","Data":"03a67375417745a23c942258d18ff7b193343dcb25ff3c65f59e62c2d2b288c4"} Jul 08 22:43:59.418498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.418473 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrj4k" event={"ID":"06606831-048b-480b-be44-3d2b1f2c0bb6","Type":"ContainerStarted","Data":"b82f538b4b9995c14ba5b4bab96f4ea135ae0c5dcccf359afae74678a93a0874"} Jul 08 22:43:59.420091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.420070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" event={"ID":"353c70ec-e086-46d3-b0cd-63bb7d480fbf","Type":"ContainerStarted","Data":"9f73a58f62b27110620ae5f3c84bf57e45e893a6a591ff631791164fda35b158"} Jul 08 22:43:59.421460 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.421442 2583 generic.go:356] "Generic (PLEG): container finished" podID="1426a6b8-f0f0-4459-93b4-c6092610cb05" containerID="379afc90bf4cc80ba6c90635b1f198d8cb774726250b6292de5318713d8f2e71" exitCode=0 Jul 08 22:43:59.421541 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.421510 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerDied","Data":"379afc90bf4cc80ba6c90635b1f198d8cb774726250b6292de5318713d8f2e71"} Jul 08 22:43:59.426817 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.426782 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-102.ec2.internal" podStartSLOduration=21.42677108 podStartE2EDuration="21.42677108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:59.426297761 +0000 UTC m=+23.677280046" watchObservedRunningTime="2026-07-08 22:43:59.42677108 +0000 UTC m=+23.677753364" Jul 08 22:43:59.442279 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.442244 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jrj4k" podStartSLOduration=2.437804015 podStartE2EDuration="22.442231877s" totalImagesPullingTime="20.004427862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:59.441789397 +0000 UTC m=+23.692771681" watchObservedRunningTime="2026-07-08 22:43:59.442231877 +0000 UTC m=+23.693214152" Jul 08 22:43:59.460361 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:43:59.460327 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rqwsd" podStartSLOduration=2.912334071 podStartE2EDuration="22.460314183s" totalImagesPullingTime="19.547980112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:59.459960393 +0000 UTC m=+23.710942676" watchObservedRunningTime="2026-07-08 22:43:59.460314183 +0000 UTC m=+23.711296467" Jul 08 22:44:00.211843 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:00.211746 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T22:43:59.223030536Z","UUID":"4b4624b0-e94a-42e4-b79f-7fd62900a2e7","Handler":null,"Name":"","Endpoint":""} Jul 08 22:44:00.213230 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:00.213192 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 22:44:00.213329 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:00.213252 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 22:44:00.307601 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:00.307579 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:00.307807 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:00.307710 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:44:00.427051 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:00.426854 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" event={"ID":"353c70ec-e086-46d3-b0cd-63bb7d480fbf","Type":"ContainerStarted","Data":"d600ab4593ab2690d1d73ce77ff8fde42cbdc38beedb3398ab8bfcf999c04658"} Jul 08 22:44:00.447905 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:00.447865 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb458" podStartSLOduration=3.430403337 podStartE2EDuration="23.447851604s" totalImagesPullingTime="20.017448267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:00.447599393 +0000 UTC m=+24.698581676" watchObservedRunningTime="2026-07-08 22:44:00.447851604 +0000 UTC m=+24.698833888" Jul 08 22:44:01.307845 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:01.307772 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:01.307845 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:01.307785 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:01.308081 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:01.307896 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:44:01.308081 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:01.308033 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:44:01.432390 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:01.432350 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"2e90a70c50225861b9604e3ae0dbea6cf488e43615664bfaaf5b36fdfbb1d244"} Jul 08 22:44:02.307602 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:02.307567 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:02.307786 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:02.307720 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:44:03.307813 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:03.307732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:03.308496 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:03.307732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:03.308496 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:03.307839 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:44:03.308496 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:03.307942 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:44:03.326058 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:03.326027 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:44:03.326638 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:03.326617 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:44:04.307168 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.307006 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:04.307306 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:04.307280 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:44:04.440846 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.440782 2583 generic.go:356] "Generic (PLEG): container finished" podID="1426a6b8-f0f0-4459-93b4-c6092610cb05" containerID="e13e38e88f66454b0da198549232487d253f8b9a4cc41e44007dda606ac00357" exitCode=0 Jul 08 22:44:04.441498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.440863 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerDied","Data":"e13e38e88f66454b0da198549232487d253f8b9a4cc41e44007dda606ac00357"} Jul 08 22:44:04.445155 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.445132 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" event={"ID":"637817b3-ba19-4dc4-bd5d-8a1f4be5f068","Type":"ContainerStarted","Data":"5b67231f4841610f6838a10ab76a62de75e6568c05482819b28f7a60d3c07ed2"} Jul 08 22:44:04.445440 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.445420 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:44:04.445544 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.445476 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:44:04.459894 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.459872 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:44:04.483313 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:04.483277 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" podStartSLOduration=7.675471179 podStartE2EDuration="27.483265565s" totalImagesPullingTime="19.807794386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:04.482730869 +0000 UTC m=+28.733713153" watchObservedRunningTime="2026-07-08 22:44:04.483265565 +0000 UTC m=+28.734247849" Jul 08 22:44:05.307306 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.307279 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:05.307507 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.307279 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:05.307507 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:05.307375 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:44:05.307507 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:05.307438 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:44:05.447527 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.447503 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:44:05.461835 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.461801 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:44:05.782328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.782133 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7zlk"] Jul 08 22:44:05.782543 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.782470 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:05.782617 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:05.782584 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:44:05.784744 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.784716 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99q8d"] Jul 08 22:44:05.784881 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.784818 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:05.784947 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:05.784911 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:44:05.795405 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.795379 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flbdz"] Jul 08 22:44:05.795486 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:05.795465 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:05.795553 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:05.795535 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:44:06.451053 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:06.451017 2583 generic.go:356] "Generic (PLEG): container finished" podID="1426a6b8-f0f0-4459-93b4-c6092610cb05" containerID="86772925f2c38e5a0dec0e171ba96e20e8e145125dc23e6fe9a190d941a36644" exitCode=0 Jul 08 22:44:06.451510 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:06.451106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerDied","Data":"86772925f2c38e5a0dec0e171ba96e20e8e145125dc23e6fe9a190d941a36644"} Jul 08 22:44:06.720168 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:06.720089 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:44:06.720343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:06.720200 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 22:44:06.720761 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:06.720743 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mhm9" Jul 08 22:44:07.307307 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:07.307277 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:07.307452 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:07.307318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:07.307452 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:07.307383 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:07.307452 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:07.307396 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:44:07.307569 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:07.307452 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:44:07.307569 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:07.307546 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:44:08.457450 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:08.457411 2583 generic.go:356] "Generic (PLEG): container finished" podID="1426a6b8-f0f0-4459-93b4-c6092610cb05" containerID="a533fef1808e8b5f0dee2abbf28ca969b60709c2015af4525e05627e4c6de3e8" exitCode=0 Jul 08 22:44:08.458178 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:08.457480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerDied","Data":"a533fef1808e8b5f0dee2abbf28ca969b60709c2015af4525e05627e4c6de3e8"} Jul 08 22:44:09.307474 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:09.307436 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:09.307474 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:09.307478 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:09.307716 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:09.307544 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:09.307716 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.307561 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7zlk" podUID="23de7db5-e96d-4739-826b-7bba6b4204f9" Jul 08 22:44:09.307716 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.307624 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flbdz" podUID="7cfead3c-7c2e-4ab2-b972-20b32f35bfc7" Jul 08 22:44:09.307826 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.307713 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99q8d" podUID="79af2cbc-7770-467d-af80-93bde326be2b" Jul 08 22:44:09.995442 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:09.995356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:09.995442 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:09.995423 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:09.995857 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.995528 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:44:09.995857 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.995600 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs podName:7cfead3c-7c2e-4ab2-b972-20b32f35bfc7 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:41.995580915 +0000 UTC m=+66.246563191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs") pod "network-metrics-daemon-flbdz" (UID: "7cfead3c-7c2e-4ab2-b972-20b32f35bfc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:44:09.995857 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.995531 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:44:09.995857 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:09.995689 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret podName:23de7db5-e96d-4739-826b-7bba6b4204f9 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:41.995669544 +0000 UTC m=+66.246651825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret") pod "global-pull-secret-syncer-n7zlk" (UID: "23de7db5-e96d-4739-826b-7bba6b4204f9") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:44:10.095931 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:10.095902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:10.096079 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:10.096053 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:44:10.096079 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:10.096072 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:44:10.096151 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:10.096085 2583 projected.go:196] Error preparing data for projected volume kube-api-access-kbsbb for pod openshift-network-diagnostics/network-check-target-99q8d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:44:10.096151 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:10.096142 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb podName:79af2cbc-7770-467d-af80-93bde326be2b nodeName:}" failed. No retries permitted until 2026-07-08 22:44:42.09612584 +0000 UTC m=+66.347108115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbsbb" (UniqueName: "kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb") pod "network-check-target-99q8d" (UID: "79af2cbc-7770-467d-af80-93bde326be2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:44:11.085854 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.085669 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-102.ec2.internal" event="NodeReady" Jul 08 22:44:11.086303 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.085945 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 22:44:11.117300 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.117166 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f59b878bf-vx8vw"] Jul 08 22:44:11.119947 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.119926 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.122154 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.122107 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 22:44:11.122394 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.122358 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 22:44:11.122498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.122464 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 22:44:11.122989 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.122702 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2tzj8\"" Jul 08 22:44:11.127500 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.127047 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x7hpx"] Jul 08 22:44:11.128934 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.128913 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m2fc4"] Jul 08 22:44:11.129177 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.129128 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.129865 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.129424 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 22:44:11.131048 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.131028 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f59b878bf-vx8vw"] Jul 08 22:44:11.131182 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.131164 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.132585 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.132048 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 22:44:11.132585 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.132061 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 22:44:11.132585 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.132360 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9mdl5\"" Jul 08 22:44:11.132585 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.132427 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 22:44:11.133322 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.133304 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fb6v\"" Jul 08 22:44:11.133536 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.133519 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 22:44:11.133782 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.133764 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 22:44:11.139431 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.139365 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7hpx"] Jul 08 22:44:11.140197 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.140177 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m2fc4"] Jul 08 22:44:11.204321 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204288 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-image-registry-private-configuration\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vwg\" (UniqueName: \"kubernetes.io/projected/03c57133-2912-49c7-89f2-4236eec922e4-kube-api-access-z5vwg\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.204482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204426 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk678\" (UniqueName: \"kubernetes.io/projected/6a74772e-bfa1-4ae9-badf-03c8c11428f2-kube-api-access-jk678\") pod \"ingress-canary-x7hpx\" (UID: \"6a74772e-bfa1-4ae9-badf-03c8c11428f2\") " pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.204482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204467 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-ca-trust-extracted\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204674 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204494 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-installation-pull-secrets\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204674 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03c57133-2912-49c7-89f2-4236eec922e4-config-volume\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.204674 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204661 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-certificates\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204683 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-trusted-ca\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204699 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.204786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c57133-2912-49c7-89f2-4236eec922e4-tmp-dir\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.204786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-bound-sa-token\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgxgb\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-kube-api-access-lgxgb\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.204950 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.204830 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a74772e-bfa1-4ae9-badf-03c8c11428f2-cert\") pod \"ingress-canary-x7hpx\" (UID: \"6a74772e-bfa1-4ae9-badf-03c8c11428f2\") " pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.305771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.305734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a74772e-bfa1-4ae9-badf-03c8c11428f2-cert\") pod \"ingress-canary-x7hpx\" (UID: \"6a74772e-bfa1-4ae9-badf-03c8c11428f2\") " pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.305944 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.305779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.305944 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.305802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-image-registry-private-configuration\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.305944 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.305882 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vwg\" (UniqueName: \"kubernetes.io/projected/03c57133-2912-49c7-89f2-4236eec922e4-kube-api-access-z5vwg\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.305944 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.305920 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:44:11.305944 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.305945 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f59b878bf-vx8vw: secret "image-registry-tls" not found Jul 08 22:44:11.306293 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.306008 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls podName:61ed51d5-4d59-46a1-b6a0-cffe773ae7e2 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:11.805986372 +0000 UTC m=+36.056968654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls") pod "image-registry-f59b878bf-vx8vw" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2") : secret "image-registry-tls" not found Jul 08 22:44:11.306293 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.305927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk678\" (UniqueName: \"kubernetes.io/projected/6a74772e-bfa1-4ae9-badf-03c8c11428f2-kube-api-access-jk678\") pod \"ingress-canary-x7hpx\" (UID: \"6a74772e-bfa1-4ae9-badf-03c8c11428f2\") " pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.306293 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306184 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-ca-trust-extracted\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306293 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306228 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-installation-pull-secrets\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306293 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03c57133-2912-49c7-89f2-4236eec922e4-config-volume\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.306545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-certificates\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-trusted-ca\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.306545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c57133-2912-49c7-89f2-4236eec922e4-tmp-dir\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.306545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306430 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-bound-sa-token\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgxgb\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-kube-api-access-lgxgb\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306875 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306619 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-ca-trust-extracted\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.306875 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.306752 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:44:11.306875 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.306801 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls podName:03c57133-2912-49c7-89f2-4236eec922e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:11.806784003 +0000 UTC m=+36.057766285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls") pod "dns-default-m2fc4" (UID: "03c57133-2912-49c7-89f2-4236eec922e4") : secret "dns-default-metrics-tls" not found Jul 08 22:44:11.307020 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306941 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-certificates\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.307020 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306970 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:11.307020 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.306978 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c57133-2912-49c7-89f2-4236eec922e4-tmp-dir\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.307273 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.307190 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:11.307529 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.307474 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03c57133-2912-49c7-89f2-4236eec922e4-config-volume\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.307529 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.307508 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:11.307684 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.307664 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-trusted-ca\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.310138 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310111 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 22:44:11.310253 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310168 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 22:44:11.310843 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310147 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 22:44:11.310843 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310525 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7n7k5\"" Jul 08 22:44:11.310843 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310740 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 22:44:11.311037 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310852 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-image-registry-private-configuration\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.311037 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310852 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-installation-pull-secrets\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.311037 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310884 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a74772e-bfa1-4ae9-badf-03c8c11428f2-cert\") pod \"ingress-canary-x7hpx\" (UID: \"6a74772e-bfa1-4ae9-badf-03c8c11428f2\") " pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.311037 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.310962 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x678z\"" Jul 08 22:44:11.316899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.316875 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-bound-sa-token\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.317346 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.317324 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vwg\" (UniqueName: \"kubernetes.io/projected/03c57133-2912-49c7-89f2-4236eec922e4-kube-api-access-z5vwg\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.317422 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.317405 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgxgb\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-kube-api-access-lgxgb\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.317542 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.317499 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk678\" (UniqueName: \"kubernetes.io/projected/6a74772e-bfa1-4ae9-badf-03c8c11428f2-kube-api-access-jk678\") pod \"ingress-canary-x7hpx\" (UID: \"6a74772e-bfa1-4ae9-badf-03c8c11428f2\") " pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.445370 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.445292 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7hpx" Jul 08 22:44:11.755027 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.754928 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:11.810990 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.810943 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:11.811153 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.811035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:11.811153 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.811122 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:44:11.811305 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.811169 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:44:11.811305 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.811183 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f59b878bf-vx8vw: secret "image-registry-tls" not found Jul 08 22:44:11.811305 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.811189 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls podName:03c57133-2912-49c7-89f2-4236eec922e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:12.811171338 +0000 UTC m=+37.062153616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls") pod "dns-default-m2fc4" (UID: "03c57133-2912-49c7-89f2-4236eec922e4") : secret "dns-default-metrics-tls" not found Jul 08 22:44:11.811305 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:11.811256 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls podName:61ed51d5-4d59-46a1-b6a0-cffe773ae7e2 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:12.811240657 +0000 UTC m=+37.062222920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls") pod "image-registry-f59b878bf-vx8vw" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2") : secret "image-registry-tls" not found Jul 08 22:44:11.844234 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:11.844191 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:12.452031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:12.451959 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7hpx"] Jul 08 22:44:12.457284 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:12.457249 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a74772e_bfa1_4ae9_badf_03c8c11428f2.slice/crio-5a95025a357f8d345dedb79cee92226e4833130176ee8305b61adc215e31ad7b WatchSource:0}: Error finding container 5a95025a357f8d345dedb79cee92226e4833130176ee8305b61adc215e31ad7b: Status 404 returned error can't find the container with id 5a95025a357f8d345dedb79cee92226e4833130176ee8305b61adc215e31ad7b Jul 08 22:44:12.468129 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:12.468089 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7hpx" event={"ID":"6a74772e-bfa1-4ae9-badf-03c8c11428f2","Type":"ContainerStarted","Data":"5a95025a357f8d345dedb79cee92226e4833130176ee8305b61adc215e31ad7b"} Jul 08 22:44:12.471329 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:12.471302 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerStarted","Data":"b085700a947a0ee2f3563df51b0cfe0acce4119a7f06c39d402e45ec6c7abc26"} Jul 08 22:44:12.820369 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:12.820291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:12.820369 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:12.820348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:12.820529 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:12.820442 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:44:12.820529 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:12.820453 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:44:12.820529 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:12.820461 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f59b878bf-vx8vw: secret "image-registry-tls" not found Jul 08 22:44:12.820529 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:12.820503 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls podName:03c57133-2912-49c7-89f2-4236eec922e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:14.820490676 +0000 UTC m=+39.071472939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls") pod "dns-default-m2fc4" (UID: "03c57133-2912-49c7-89f2-4236eec922e4") : secret "dns-default-metrics-tls" not found Jul 08 22:44:12.820529 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:12.820515 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls podName:61ed51d5-4d59-46a1-b6a0-cffe773ae7e2 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:14.820509958 +0000 UTC m=+39.071492220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls") pod "image-registry-f59b878bf-vx8vw" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2") : secret "image-registry-tls" not found Jul 08 22:44:13.476882 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:13.476842 2583 generic.go:356] "Generic (PLEG): container finished" podID="1426a6b8-f0f0-4459-93b4-c6092610cb05" containerID="b085700a947a0ee2f3563df51b0cfe0acce4119a7f06c39d402e45ec6c7abc26" exitCode=0 Jul 08 22:44:13.477312 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:13.476907 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerDied","Data":"b085700a947a0ee2f3563df51b0cfe0acce4119a7f06c39d402e45ec6c7abc26"} Jul 08 22:44:14.483484 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:14.483446 2583 generic.go:356] "Generic (PLEG): container finished" podID="1426a6b8-f0f0-4459-93b4-c6092610cb05" containerID="47f41e8124ed3257aae5707154a89151dfe166041901700a0bd87eec9e1ec536" exitCode=0 Jul 08 22:44:14.483903 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:14.483524 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerDied","Data":"47f41e8124ed3257aae5707154a89151dfe166041901700a0bd87eec9e1ec536"} Jul 08 22:44:14.837267 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:14.836928 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:14.837267 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:14.837016 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:14.837267 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:14.837173 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:44:14.837267 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:14.837188 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f59b878bf-vx8vw: secret "image-registry-tls" not found Jul 08 22:44:14.837267 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:14.837255 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls podName:61ed51d5-4d59-46a1-b6a0-cffe773ae7e2 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:18.837237358 +0000 UTC m=+43.088219637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls") pod "image-registry-f59b878bf-vx8vw" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2") : secret "image-registry-tls" not found Jul 08 22:44:14.837536 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:14.837392 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:44:14.837536 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:14.837473 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls podName:03c57133-2912-49c7-89f2-4236eec922e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:18.837453632 +0000 UTC m=+43.088435915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls") pod "dns-default-m2fc4" (UID: "03c57133-2912-49c7-89f2-4236eec922e4") : secret "dns-default-metrics-tls" not found Jul 08 22:44:15.249010 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.248924 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:15.304956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.304924 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:15.487008 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.486963 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7hpx" event={"ID":"6a74772e-bfa1-4ae9-badf-03c8c11428f2","Type":"ContainerStarted","Data":"f24c90898b96fb87ca603ccf7c9fd957175400cbb25492f97532ebc00cd21030"} Jul 08 22:44:15.490373 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.490345 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" event={"ID":"1426a6b8-f0f0-4459-93b4-c6092610cb05","Type":"ContainerStarted","Data":"c4e35cbf855e9bc86fe67e64fdda1c93ca9aa807248975c27f91a95a80c5934d"} Jul 08 22:44:15.501344 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.501260 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x7hpx" podStartSLOduration=2.104813458 podStartE2EDuration="4.501242831s" totalImagesPullingTime="2.396429373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:15.500960057 +0000 UTC m=+39.751942344" watchObservedRunningTime="2026-07-08 22:44:15.501242831 +0000 UTC m=+39.752225117" Jul 08 22:44:15.522412 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.522373 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8v2pw" podStartSLOduration=9.845572147 podStartE2EDuration="38.522356263s" totalImagesPullingTime="28.676784116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:15.522302401 +0000 UTC m=+39.773284686" watchObservedRunningTime="2026-07-08 22:44:15.522356263 +0000 UTC m=+39.773338548" Jul 08 22:44:15.641429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.641397 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:15.715485 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:15.715459 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:16.379292 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:16.379257 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:16.444302 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:16.444276 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:16.580965 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:16.580930 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:16.638034 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:16.637963 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:18.500354 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.500309 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:18.600513 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.600475 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:18.722498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.722463 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ph6m5"] Jul 08 22:44:18.765943 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.765878 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ph6m5"] Jul 08 22:44:18.766067 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.765998 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.768534 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.768512 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 22:44:18.768672 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.768541 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 22:44:18.769460 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.769442 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 22:44:18.769552 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.769483 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-msmwz\"" Jul 08 22:44:18.769552 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.769507 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 22:44:18.774896 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.774876 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:18.866114 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:18.866256 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866127 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.866256 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsn44\" (UniqueName: \"kubernetes.io/projected/e360e629-882d-47b8-ac99-b8ac90087fac-kube-api-access-gsn44\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.866376 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866258 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:18.866376 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866280 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e360e629-882d-47b8-ac99-b8ac90087fac-data-volume\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.866376 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.866283 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:44:18.866376 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.866303 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f59b878bf-vx8vw: secret "image-registry-tls" not found Jul 08 22:44:18.866376 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866311 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e360e629-882d-47b8-ac99-b8ac90087fac-crio-socket\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.866376 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.866363 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls podName:61ed51d5-4d59-46a1-b6a0-cffe773ae7e2 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:26.866341775 +0000 UTC m=+51.117324043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls") pod "image-registry-f59b878bf-vx8vw" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2") : secret "image-registry-tls" not found Jul 08 22:44:18.866601 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.866399 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:44:18.866601 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.866414 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.866601 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.866452 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls podName:03c57133-2912-49c7-89f2-4236eec922e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:26.866438241 +0000 UTC m=+51.117420505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls") pod "dns-default-m2fc4" (UID: "03c57133-2912-49c7-89f2-4236eec922e4") : secret "dns-default-metrics-tls" not found Jul 08 22:44:18.900717 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.900691 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:18.966871 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.966850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e360e629-882d-47b8-ac99-b8ac90087fac-crio-socket\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.966948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.966886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.966948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.966919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.967050 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.966990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsn44\" (UniqueName: \"kubernetes.io/projected/e360e629-882d-47b8-ac99-b8ac90087fac-kube-api-access-gsn44\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.967050 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.967032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e360e629-882d-47b8-ac99-b8ac90087fac-data-volume\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.967134 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.966996 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:44:18.967134 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.967099 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e360e629-882d-47b8-ac99-b8ac90087fac-crio-socket\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.967134 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.967128 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:19.467116258 +0000 UTC m=+43.718098520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : secret "insights-runtime-extractor-tls" not found Jul 08 22:44:18.967134 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.967010 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:44:18.967319 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:18.967193 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:19.467175975 +0000 UTC m=+43.718158254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : configmap "kube-rbac-proxy" not found Jul 08 22:44:18.967356 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.967317 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e360e629-882d-47b8-ac99-b8ac90087fac-data-volume\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:18.977840 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:18.977816 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsn44\" (UniqueName: \"kubernetes.io/projected/e360e629-882d-47b8-ac99-b8ac90087fac-kube-api-access-gsn44\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:19.004680 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:19.004660 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:19.341790 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:19.341764 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:19.470571 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:19.470547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:19.470696 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:19.470587 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:19.470696 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:19.470657 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:44:19.470696 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:19.470686 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:44:19.470794 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:19.470721 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:20.470705063 +0000 UTC m=+44.721687344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : configmap "kube-rbac-proxy" not found Jul 08 22:44:19.470794 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:19.470738 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:20.470730471 +0000 UTC m=+44.721712733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : secret "insights-runtime-extractor-tls" not found Jul 08 22:44:19.625456 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:19.625382 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:19.718547 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:19.718510 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:20.474266 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:20.474230 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:20.479164 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:20.479141 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:20.479303 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:20.479195 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:20.479303 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:20.479275 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:44:20.479385 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:20.479303 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:44:20.479385 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:20.479328 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:22.479315388 +0000 UTC m=+46.730297650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : configmap "kube-rbac-proxy" not found Jul 08 22:44:20.479385 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:20.479349 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:22.479333857 +0000 UTC m=+46.730316120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : secret "insights-runtime-extractor-tls" not found Jul 08 22:44:20.574822 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:20.574788 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:20.724333 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:20.724258 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mggh_d2c502bd-45c4-4182-bc60-2bb286399958/dns-node-resolver/0.log" Jul 08 22:44:21.206863 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.206837 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tlz8r"] Jul 08 22:44:21.235886 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.235862 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tlz8r"] Jul 08 22:44:21.236034 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.235951 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.238436 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.238414 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 22:44:21.238568 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.238417 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 22:44:21.239219 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.239176 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 22:44:21.239219 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.239182 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 22:44:21.239371 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.239251 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2h6cx\"" Jul 08 22:44:21.246913 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.246889 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:21.286363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.286340 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-signing-key\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.286445 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.286425 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9jx2\" (UniqueName: \"kubernetes.io/projected/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-kube-api-access-m9jx2\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.286507 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.286454 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-signing-cabundle\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.347791 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.347767 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:21.386990 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.386965 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-signing-key\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.387107 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.387092 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9jx2\" (UniqueName: \"kubernetes.io/projected/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-kube-api-access-m9jx2\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.387171 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.387142 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-signing-cabundle\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.387716 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.387694 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-signing-cabundle\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.389274 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.389258 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-signing-key\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.394709 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.394686 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9jx2\" (UniqueName: \"kubernetes.io/projected/ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7-kube-api-access-m9jx2\") pod \"service-ca-758f599c5-tlz8r\" (UID: \"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7\") " pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.503728 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.503674 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:21.524095 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.524078 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pxg9c_daec4e02-5cf1-4ed7-b72b-30d06ab21d93/node-ca/0.log" Jul 08 22:44:21.544483 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.544460 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-tlz8r" Jul 08 22:44:21.558016 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.557994 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:21.693084 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.693053 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tlz8r"] Jul 08 22:44:21.697309 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:21.697285 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbc3a7a_9082_4952_9cf5_046cf3cbe4f7.slice/crio-e9e61fd2643da60f9a2292f949272f78d8c155859683422827aabfb721777b0f WatchSource:0}: Error finding container e9e61fd2643da60f9a2292f949272f78d8c155859683422827aabfb721777b0f: Status 404 returned error can't find the container with id e9e61fd2643da60f9a2292f949272f78d8c155859683422827aabfb721777b0f Jul 08 22:44:21.914352 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.914271 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:21.969386 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:21.969358 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:22.096534 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:22.096509 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:22.496588 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:22.496551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:22.496759 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:22.496600 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:22.496759 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:22.496674 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:44:22.496759 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:22.496737 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:26.496720971 +0000 UTC m=+50.747703234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : configmap "kube-rbac-proxy" not found Jul 08 22:44:22.496759 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:22.496742 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:44:22.496912 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:22.496785 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:26.496772218 +0000 UTC m=+50.747754479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : secret "insights-runtime-extractor-tls" not found Jul 08 22:44:22.506322 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:22.506287 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-tlz8r" event={"ID":"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7","Type":"ContainerStarted","Data":"e9e61fd2643da60f9a2292f949272f78d8c155859683422827aabfb721777b0f"} Jul 08 22:44:22.726459 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:22.726431 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7hpx_6a74772e-bfa1-4ae9-badf-03c8c11428f2/serve-healthcheck-canary/0.log" Jul 08 22:44:22.802925 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:22.802835 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:24.670899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:24.670855 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:25.483540 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.483501 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:25.514886 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.514850 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-tlz8r" event={"ID":"ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7","Type":"ContainerStarted","Data":"847939aaf42aefe8f4fa0c758824d9cc4de88c64565cc1c879ebf314dcce6438"} Jul 08 22:44:25.528872 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.528816 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-tlz8r" podStartSLOduration=1.688151481 podStartE2EDuration="4.528800752s" totalImagesPullingTime="2.840649271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:25.528670831 +0000 UTC m=+49.779653118" watchObservedRunningTime="2026-07-08 22:44:25.528800752 +0000 UTC m=+49.779783038" Jul 08 22:44:25.584332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.584301 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:25.687556 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.687503 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:25.790735 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.790655 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:25.864947 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.864904 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:25.938835 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:25.938803 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:26.181527 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:26.181496 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:26.530456 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:26.530384 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:26.530456 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:26.530428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:26.530628 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.530582 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:44:26.530666 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.530646 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls podName:e360e629-882d-47b8-ac99-b8ac90087fac nodeName:}" failed. No retries permitted until 2026-07-08 22:44:34.530628188 +0000 UTC m=+58.781610449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ph6m5" (UID: "e360e629-882d-47b8-ac99-b8ac90087fac") : secret "insights-runtime-extractor-tls" not found Jul 08 22:44:26.531059 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:26.531041 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e360e629-882d-47b8-ac99-b8ac90087fac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:26.933848 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:26.933825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:26.934197 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:26.933889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") pod \"image-registry-f59b878bf-vx8vw\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:26.934197 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.933975 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:44:26.934197 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.934036 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls podName:03c57133-2912-49c7-89f2-4236eec922e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:42.934023067 +0000 UTC m=+67.185005332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls") pod "dns-default-m2fc4" (UID: "03c57133-2912-49c7-89f2-4236eec922e4") : secret "dns-default-metrics-tls" not found Jul 08 22:44:26.934197 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.933977 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:44:26.934197 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.934073 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f59b878bf-vx8vw: secret "image-registry-tls" not found Jul 08 22:44:26.934197 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:26.934133 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls podName:61ed51d5-4d59-46a1-b6a0-cffe773ae7e2 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:42.934118232 +0000 UTC m=+67.185100496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls") pod "image-registry-f59b878bf-vx8vw" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2") : secret "image-registry-tls" not found Jul 08 22:44:27.183549 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:27.183495 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:27.580884 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:27.580852 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:27.780272 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:27.780239 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:27.980802 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:27.980772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:28.378117 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:28.378042 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:28.980004 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:28.979973 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:29.179056 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:29.179009 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:29.581417 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:29.581384 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:29.683007 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:29.682972 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:29.782451 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:29.782418 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:30.183591 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:30.183551 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:30.378465 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:30.378431 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:30.431690 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:30.431662 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:30.983542 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:30.983481 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:31.084502 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:31.084470 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:31.133081 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:31.133043 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:31.185819 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:31.185787 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:31.584556 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:31.584518 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:31.829656 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:31.829627 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:32.179116 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:32.179088 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:32.579335 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:32.579307 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:32.976049 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:32.976021 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:33.376423 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:33.376335 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:33.782657 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:33.782618 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:33.932065 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:33.932036 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:33.986320 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:33.986289 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:34.381884 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:34.381843 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:34.592457 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:34.592425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:34.594632 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:34.594608 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e360e629-882d-47b8-ac99-b8ac90087fac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ph6m5\" (UID: \"e360e629-882d-47b8-ac99-b8ac90087fac\") " pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:34.674604 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:34.674550 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ph6m5" Jul 08 22:44:34.795691 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:34.795658 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ph6m5"] Jul 08 22:44:34.798549 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:34.798520 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode360e629_882d_47b8_ac99_b8ac90087fac.slice/crio-7750a4f820d21d2a8ac5617ca8ec9d23f27942a4243ae0d89bf5abece70648b0 WatchSource:0}: Error finding container 7750a4f820d21d2a8ac5617ca8ec9d23f27942a4243ae0d89bf5abece70648b0: Status 404 returned error can't find the container with id 7750a4f820d21d2a8ac5617ca8ec9d23f27942a4243ae0d89bf5abece70648b0 Jul 08 22:44:35.176649 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:35.176603 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:35.388697 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:35.388645 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:35.542247 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:35.542195 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ph6m5" event={"ID":"e360e629-882d-47b8-ac99-b8ac90087fac","Type":"ContainerStarted","Data":"7750a4f820d21d2a8ac5617ca8ec9d23f27942a4243ae0d89bf5abece70648b0"} Jul 08 22:44:35.577347 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:35.577270 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:35.784159 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:35.784110 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:36.183243 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:36.183176 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:36.907122 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:36.907076 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:37.019365 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:37.019294 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:37.472856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:37.472822 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrds9" Jul 08 22:44:39.401843 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:39.401813 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:39.464864 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:39.464840 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:39.553700 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:39.553673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ph6m5" event={"ID":"e360e629-882d-47b8-ac99-b8ac90087fac","Type":"ContainerStarted","Data":"cf8356be8cb6e23b2f2a0a93d76fecee3768872b35ef0e904c45fdfd8793c26a"} Jul 08 22:44:39.553791 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:39.553722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ph6m5" event={"ID":"e360e629-882d-47b8-ac99-b8ac90087fac","Type":"ContainerStarted","Data":"8d90e9be1b687f36a78c1af76f21bf58b75837e3c508419cf42dd28ce742007c"} Jul 08 22:44:39.664338 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:39.664265 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:39.851923 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:39.851890 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:40.025278 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:40.025238 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:40.078907 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:40.078878 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:40.218754 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:40.218718 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:40.272572 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:40.272540 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:40.435072 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:40.435037 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.043748 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.043713 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.105646 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.105607 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.227908 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.227875 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f59b878bf-vx8vw"] Jul 08 22:44:41.228133 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:41.228109 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" podUID="61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" Jul 08 22:44:41.239994 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.239967 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4"] Jul 08 22:44:41.242961 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.242937 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.246798 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.246769 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 22:44:41.246938 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.246879 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 22:44:41.247483 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.247421 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 22:44:41.247593 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.247491 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jmwmm\"" Jul 08 22:44:41.248809 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.248791 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 22:44:41.254253 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.254230 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4"] Jul 08 22:44:41.276626 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.276597 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.340117 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.340034 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-b22mx"] Jul 08 22:44:41.343565 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.343509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f0790b5-765c-48f7-bd8d-b693a21aeaf6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bc878598d-8b5x4\" (UID: \"8f0790b5-765c-48f7-bd8d-b693a21aeaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.343747 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.343720 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-758rb\" (UniqueName: \"kubernetes.io/projected/8f0790b5-765c-48f7-bd8d-b693a21aeaf6-kube-api-access-758rb\") pod \"managed-serviceaccount-addon-agent-6bc878598d-8b5x4\" (UID: \"8f0790b5-765c-48f7-bd8d-b693a21aeaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.345019 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.344996 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7896b7cc8-xd5q5"] Jul 08 22:44:41.345136 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.345125 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:44:41.347466 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.347284 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.347466 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.347387 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7f4jb\"" Jul 08 22:44:41.347466 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.347400 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 22:44:41.347466 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.347404 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 22:44:41.353243 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.353185 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b22mx"] Jul 08 22:44:41.369504 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.369481 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7896b7cc8-xd5q5"] Jul 08 22:44:41.372841 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.372807 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.444738 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.444710 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/778f055a-a91c-4d91-8c58-0d19dcf724e2-trusted-ca\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.444754 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-registry-tls\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.444799 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-758rb\" (UniqueName: \"kubernetes.io/projected/8f0790b5-765c-48f7-bd8d-b693a21aeaf6-kube-api-access-758rb\") pod \"managed-serviceaccount-addon-agent-6bc878598d-8b5x4\" (UID: \"8f0790b5-765c-48f7-bd8d-b693a21aeaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.444837 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/778f055a-a91c-4d91-8c58-0d19dcf724e2-installation-pull-secrets\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.444869 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/778f055a-a91c-4d91-8c58-0d19dcf724e2-image-registry-private-configuration\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.444957 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/778f055a-a91c-4d91-8c58-0d19dcf724e2-registry-certificates\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.445005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f0790b5-765c-48f7-bd8d-b693a21aeaf6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bc878598d-8b5x4\" (UID: \"8f0790b5-765c-48f7-bd8d-b693a21aeaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.445065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5gq\" (UniqueName: \"kubernetes.io/projected/464e350a-0067-49b4-9e71-4d99d99af42e-kube-api-access-lq5gq\") pod \"downloads-685bfb5f64-b22mx\" (UID: \"464e350a-0067-49b4-9e71-4d99d99af42e\") " pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.445106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-bound-sa-token\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445143 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.445147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzx8t\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-kube-api-access-jzx8t\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.445628 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.445173 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/778f055a-a91c-4d91-8c58-0d19dcf724e2-ca-trust-extracted\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.447779 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.447757 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f0790b5-765c-48f7-bd8d-b693a21aeaf6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bc878598d-8b5x4\" (UID: \"8f0790b5-765c-48f7-bd8d-b693a21aeaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.455393 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.455370 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-758rb\" (UniqueName: \"kubernetes.io/projected/8f0790b5-765c-48f7-bd8d-b693a21aeaf6-kube-api-access-758rb\") pod \"managed-serviceaccount-addon-agent-6bc878598d-8b5x4\" (UID: \"8f0790b5-765c-48f7-bd8d-b693a21aeaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.477465 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.477434 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.545985 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.545745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5gq\" (UniqueName: \"kubernetes.io/projected/464e350a-0067-49b4-9e71-4d99d99af42e-kube-api-access-lq5gq\") pod \"downloads-685bfb5f64-b22mx\" (UID: \"464e350a-0067-49b4-9e71-4d99d99af42e\") " pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:44:41.545985 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.545800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-bound-sa-token\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.545985 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.545825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzx8t\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-kube-api-access-jzx8t\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.545985 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.545855 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/778f055a-a91c-4d91-8c58-0d19dcf724e2-ca-trust-extracted\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.545985 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.545953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/778f055a-a91c-4d91-8c58-0d19dcf724e2-trusted-ca\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.545985 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.545980 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-registry-tls\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.546509 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.546018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/778f055a-a91c-4d91-8c58-0d19dcf724e2-installation-pull-secrets\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.546509 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.546046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/778f055a-a91c-4d91-8c58-0d19dcf724e2-image-registry-private-configuration\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.546509 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.546087 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/778f055a-a91c-4d91-8c58-0d19dcf724e2-registry-certificates\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.546509 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.546377 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/778f055a-a91c-4d91-8c58-0d19dcf724e2-ca-trust-extracted\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.547038 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.546964 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/778f055a-a91c-4d91-8c58-0d19dcf724e2-registry-certificates\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.548056 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.548021 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/778f055a-a91c-4d91-8c58-0d19dcf724e2-trusted-ca\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.549542 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.549516 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/778f055a-a91c-4d91-8c58-0d19dcf724e2-installation-pull-secrets\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.549657 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.549546 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-registry-tls\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.549657 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.549557 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/778f055a-a91c-4d91-8c58-0d19dcf724e2-image-registry-private-configuration\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.560614 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.560571 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-bound-sa-token\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.560904 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.560884 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:41.561522 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.561499 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5gq\" (UniqueName: \"kubernetes.io/projected/464e350a-0067-49b4-9e71-4d99d99af42e-kube-api-access-lq5gq\") pod \"downloads-685bfb5f64-b22mx\" (UID: \"464e350a-0067-49b4-9e71-4d99d99af42e\") " pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:44:41.562172 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.562154 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzx8t\" (UniqueName: \"kubernetes.io/projected/778f055a-a91c-4d91-8c58-0d19dcf724e2-kube-api-access-jzx8t\") pod \"image-registry-7896b7cc8-xd5q5\" (UID: \"778f055a-a91c-4d91-8c58-0d19dcf724e2\") " pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.564248 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.564184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" Jul 08 22:44:41.567717 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.567678 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.574922 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.574903 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:41.646416 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646338 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-trusted-ca\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.646416 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646409 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgxgb\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-kube-api-access-lgxgb\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.646616 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646448 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-image-registry-private-configuration\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.646616 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646471 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-bound-sa-token\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.646616 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646512 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-installation-pull-secrets\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.646616 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646542 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-certificates\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.646616 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646575 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-ca-trust-extracted\") pod \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\" (UID: \"61ed51d5-4d59-46a1-b6a0-cffe773ae7e2\") " Jul 08 22:44:41.647020 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646942 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:44:41.647020 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.646857 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:44:41.647270 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.647202 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:44:41.649520 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.649466 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:44:41.649628 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.649516 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-kube-api-access-lgxgb" (OuterVolumeSpecName: "kube-api-access-lgxgb") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "kube-api-access-lgxgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:44:41.649628 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.649604 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:44:41.649757 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.649729 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" (UID: "61ed51d5-4d59-46a1-b6a0-cffe773ae7e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:44:41.657825 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.657784 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:44:41.665185 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.665165 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2tzj8\"" Jul 08 22:44:41.673239 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.673197 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:41.718912 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.718881 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:41.747850 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747818 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-ca-trust-extracted\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.747850 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747852 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-trusted-ca\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.748031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747868 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgxgb\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-kube-api-access-lgxgb\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.748031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747878 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-image-registry-private-configuration\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.748031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747887 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-bound-sa-token\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.748031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747896 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-installation-pull-secrets\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.748031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.747904 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-certificates\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:41.819948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:41.819918 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:42.051396 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.051080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:42.051396 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.051163 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:42.053964 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.053479 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 22:44:42.053964 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.053795 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 22:44:42.065233 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.065011 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23de7db5-e96d-4739-826b-7bba6b4204f9-original-pull-secret\") pod \"global-pull-secret-syncer-n7zlk\" (UID: \"23de7db5-e96d-4739-826b-7bba6b4204f9\") " pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:42.065680 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.065629 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfead3c-7c2e-4ab2-b972-20b32f35bfc7-metrics-certs\") pod \"network-metrics-daemon-flbdz\" (UID: \"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7\") " pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:42.130702 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.130678 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7896b7cc8-xd5q5"] Jul 08 22:44:42.132817 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:42.132790 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778f055a_a91c_4d91_8c58_0d19dcf724e2.slice/crio-ff105ee780801b359b58a0e769081da07e6e7f4d75d96fe1002bb8e469f10c6f WatchSource:0}: Error finding container ff105ee780801b359b58a0e769081da07e6e7f4d75d96fe1002bb8e469f10c6f: Status 404 returned error can't find the container with id ff105ee780801b359b58a0e769081da07e6e7f4d75d96fe1002bb8e469f10c6f Jul 08 22:44:42.151722 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.151699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:42.153870 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.153856 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 22:44:42.164809 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.164757 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 22:44:42.175470 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.175451 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbsbb\" (UniqueName: \"kubernetes.io/projected/79af2cbc-7770-467d-af80-93bde326be2b-kube-api-access-kbsbb\") pod \"network-check-target-99q8d\" (UID: \"79af2cbc-7770-467d-af80-93bde326be2b\") " pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:42.233185 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.233163 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7zlk" Jul 08 22:44:42.242825 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.242806 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x678z\"" Jul 08 22:44:42.248792 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.248746 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7n7k5\"" Jul 08 22:44:42.251430 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.251411 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:42.257093 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.257071 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flbdz" Jul 08 22:44:42.359151 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.358923 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4"] Jul 08 22:44:42.361162 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.361084 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b22mx"] Jul 08 22:44:42.363492 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:42.363456 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f0790b5_765c_48f7_bd8d_b693a21aeaf6.slice/crio-f8659f13a7d0f8c1062783c20c7299c412d51b03563ae51a5790b7cd0323fe4c WatchSource:0}: Error finding container f8659f13a7d0f8c1062783c20c7299c412d51b03563ae51a5790b7cd0323fe4c: Status 404 returned error can't find the container with id f8659f13a7d0f8c1062783c20c7299c412d51b03563ae51a5790b7cd0323fe4c Jul 08 22:44:42.374016 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:42.373984 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464e350a_0067_49b4_9e71_4d99d99af42e.slice/crio-62c6b032cab4f03a2eb4eb7e4db5370983e05b2e40ecbd3b189aa1953291c8c1 WatchSource:0}: Error finding container 62c6b032cab4f03a2eb4eb7e4db5370983e05b2e40ecbd3b189aa1953291c8c1: Status 404 returned error can't find the container with id 62c6b032cab4f03a2eb4eb7e4db5370983e05b2e40ecbd3b189aa1953291c8c1 Jul 08 22:44:42.384314 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.384197 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7zlk"] Jul 08 22:44:42.388197 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:42.388163 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23de7db5_e96d_4739_826b_7bba6b4204f9.slice/crio-bf7f86f1616eb02bd20556f0a8be65ca23069de5e2deb6f1d5a6bb551789cf9c WatchSource:0}: Error finding container bf7f86f1616eb02bd20556f0a8be65ca23069de5e2deb6f1d5a6bb551789cf9c: Status 404 returned error can't find the container with id bf7f86f1616eb02bd20556f0a8be65ca23069de5e2deb6f1d5a6bb551789cf9c Jul 08 22:44:42.411701 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.411666 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99q8d"] Jul 08 22:44:42.415445 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:42.415415 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79af2cbc_7770_467d_af80_93bde326be2b.slice/crio-9f4e6f970f1e888f9abc1d14eaadade7245c0bfe8768da05ca624eb8b6284796 WatchSource:0}: Error finding container 9f4e6f970f1e888f9abc1d14eaadade7245c0bfe8768da05ca624eb8b6284796: Status 404 returned error can't find the container with id 9f4e6f970f1e888f9abc1d14eaadade7245c0bfe8768da05ca624eb8b6284796 Jul 08 22:44:42.427635 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.427609 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flbdz"] Jul 08 22:44:42.430576 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:42.430553 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfead3c_7c2e_4ab2_b972_20b32f35bfc7.slice/crio-1910ed92efc3b27ddc2876967ac35749728235925e3efe9c408eca8e817e8bd8 WatchSource:0}: Error finding container 1910ed92efc3b27ddc2876967ac35749728235925e3efe9c408eca8e817e8bd8: Status 404 returned error can't find the container with id 1910ed92efc3b27ddc2876967ac35749728235925e3efe9c408eca8e817e8bd8 Jul 08 22:44:42.567977 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.567896 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" event={"ID":"8f0790b5-765c-48f7-bd8d-b693a21aeaf6","Type":"ContainerStarted","Data":"f8659f13a7d0f8c1062783c20c7299c412d51b03563ae51a5790b7cd0323fe4c"} Jul 08 22:44:42.569521 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.569490 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" event={"ID":"778f055a-a91c-4d91-8c58-0d19dcf724e2","Type":"ContainerStarted","Data":"6f1f8c16adc30e204555708f7178028ec2e4d19d4ac6d8c657932a584a4efcae"} Jul 08 22:44:42.569651 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.569548 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" event={"ID":"778f055a-a91c-4d91-8c58-0d19dcf724e2","Type":"ContainerStarted","Data":"ff105ee780801b359b58a0e769081da07e6e7f4d75d96fe1002bb8e469f10c6f"} Jul 08 22:44:42.569651 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.569589 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:44:42.570732 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.570713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b22mx" event={"ID":"464e350a-0067-49b4-9e71-4d99d99af42e","Type":"ContainerStarted","Data":"62c6b032cab4f03a2eb4eb7e4db5370983e05b2e40ecbd3b189aa1953291c8c1"} Jul 08 22:44:42.572760 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.572732 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ph6m5" event={"ID":"e360e629-882d-47b8-ac99-b8ac90087fac","Type":"ContainerStarted","Data":"2995eda7ce9d4deadf3d5e209f0af58352e2ab0e647b89d1af44620d2a6aeb30"} Jul 08 22:44:42.573901 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.573869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flbdz" event={"ID":"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7","Type":"ContainerStarted","Data":"1910ed92efc3b27ddc2876967ac35749728235925e3efe9c408eca8e817e8bd8"} Jul 08 22:44:42.574946 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.574927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99q8d" event={"ID":"79af2cbc-7770-467d-af80-93bde326be2b","Type":"ContainerStarted","Data":"9f4e6f970f1e888f9abc1d14eaadade7245c0bfe8768da05ca624eb8b6284796"} Jul 08 22:44:42.576052 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.576031 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f59b878bf-vx8vw" Jul 08 22:44:42.576138 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.576033 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7zlk" event={"ID":"23de7db5-e96d-4739-826b-7bba6b4204f9","Type":"ContainerStarted","Data":"bf7f86f1616eb02bd20556f0a8be65ca23069de5e2deb6f1d5a6bb551789cf9c"} Jul 08 22:44:42.603026 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.602979 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ph6m5" podStartSLOduration=17.501199384 podStartE2EDuration="24.60296479s" totalImagesPullingTime="7.101765406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:44:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:42.602034398 +0000 UTC m=+66.853016683" watchObservedRunningTime="2026-07-08 22:44:42.60296479 +0000 UTC m=+66.853947074" Jul 08 22:44:42.603144 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.603096 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" podStartSLOduration=1.603089161 podStartE2EDuration="1.603089161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:42.586780539 +0000 UTC m=+66.837762824" watchObservedRunningTime="2026-07-08 22:44:42.603089161 +0000 UTC m=+66.854071445" Jul 08 22:44:42.625676 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.625646 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f59b878bf-vx8vw"] Jul 08 22:44:42.628820 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.628796 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f59b878bf-vx8vw"] Jul 08 22:44:42.756785 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.756755 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2-registry-tls\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:44:42.958016 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.957983 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:42.966242 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:42.966191 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03c57133-2912-49c7-89f2-4236eec922e4-metrics-tls\") pod \"dns-default-m2fc4\" (UID: \"03c57133-2912-49c7-89f2-4236eec922e4\") " pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:43.253251 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:43.252972 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fb6v\"" Jul 08 22:44:43.261295 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:43.261018 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:43.947180 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:43.946878 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m2fc4"] Jul 08 22:44:44.314375 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.314134 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61ed51d5-4d59-46a1-b6a0-cffe773ae7e2" path="/var/lib/kubelet/pods/61ed51d5-4d59-46a1-b6a0-cffe773ae7e2/volumes" Jul 08 22:44:44.587261 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.587216 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m2fc4" event={"ID":"03c57133-2912-49c7-89f2-4236eec922e4","Type":"ContainerStarted","Data":"4fd8d3f5601306bfbd64f95edb0144ce373f86e54acd06975d9d34a55d5e9c16"} Jul 08 22:44:44.591428 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.590922 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flbdz" event={"ID":"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7","Type":"ContainerStarted","Data":"0f21ee268b808e272092632e7c3c8f9ad8b3137e83bbf167ce21b7b1f9b9c91b"} Jul 08 22:44:44.591428 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.590973 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flbdz" event={"ID":"7cfead3c-7c2e-4ab2-b972-20b32f35bfc7","Type":"ContainerStarted","Data":"2559a61a5d4e36a2b981f58cf390e818ad8bb3630f13d048896e1eed703a5afd"} Jul 08 22:44:44.607083 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.607033 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-flbdz" podStartSLOduration=65.886575647 podStartE2EDuration="1m7.6070132s" totalImagesPullingTime="1.720437553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:44.606128658 +0000 UTC m=+68.857110943" watchObservedRunningTime="2026-07-08 22:44:44.6070132 +0000 UTC m=+68.857995487" Jul 08 22:44:44.690217 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.690156 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:44.745979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:44.745879 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.031435 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.031361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.173880 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.173822 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.183387 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.182256 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755"] Jul 08 22:44:47.184656 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.184584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:47.187064 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.186822 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 22:44:47.187064 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.186901 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5vglp\"" Jul 08 22:44:47.193592 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.193567 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755"] Jul 08 22:44:47.294353 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.294258 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9bb9475-5eb6-401f-b690-24cb8b0787be-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9h755\" (UID: \"d9bb9475-5eb6-401f-b690-24cb8b0787be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:47.394865 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.394809 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9bb9475-5eb6-401f-b690-24cb8b0787be-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9h755\" (UID: \"d9bb9475-5eb6-401f-b690-24cb8b0787be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:47.395035 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:47.394965 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 08 22:44:47.395120 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:47.395050 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9bb9475-5eb6-401f-b690-24cb8b0787be-tls-certificates podName:d9bb9475-5eb6-401f-b690-24cb8b0787be nodeName:}" failed. No retries permitted until 2026-07-08 22:44:47.895028272 +0000 UTC m=+72.146010536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d9bb9475-5eb6-401f-b690-24cb8b0787be-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-9h755" (UID: "d9bb9475-5eb6-401f-b690-24cb8b0787be") : secret "prometheus-operator-admission-webhook-tls" not found Jul 08 22:44:47.515649 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.515570 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.653596 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.653512 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.752927 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.752885 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.806512 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.806472 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:47.900244 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.900193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9bb9475-5eb6-401f-b690-24cb8b0787be-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9h755\" (UID: \"d9bb9475-5eb6-401f-b690-24cb8b0787be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:47.903262 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:47.903235 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9bb9475-5eb6-401f-b690-24cb8b0787be-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9h755\" (UID: \"d9bb9475-5eb6-401f-b690-24cb8b0787be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:48.013834 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.013789 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:48.097224 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.097178 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:48.408628 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.408548 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:48.465222 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.465174 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585c9c4d69-zc5tw"] Jul 08 22:44:48.467834 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.467810 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.470288 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.470260 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8vkv\"" Jul 08 22:44:48.470385 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.470272 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 22:44:48.470385 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.470351 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 22:44:48.471335 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.471137 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 22:44:48.471335 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.471285 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 22:44:48.471506 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.471385 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 22:44:48.479582 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.479563 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585c9c4d69-zc5tw"] Jul 08 22:44:48.485796 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.485764 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:48.606598 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.606563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-service-ca\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.606772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.606634 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gltmf\" (UniqueName: \"kubernetes.io/projected/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-kube-api-access-gltmf\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.606772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.606673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-config\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.606772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.606712 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-serving-cert\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.607018 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.606776 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-oauth-serving-cert\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.607018 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.606805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-oauth-config\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.707790 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.707759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-service-ca\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.707979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.707824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gltmf\" (UniqueName: \"kubernetes.io/projected/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-kube-api-access-gltmf\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.707979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.707866 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-config\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.707979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.707890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-serving-cert\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.707979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.707925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-oauth-serving-cert\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.707979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.707953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-oauth-config\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.708699 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.708660 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-config\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.708834 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.708732 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-service-ca\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.708834 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.708827 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-oauth-serving-cert\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.711300 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.711250 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-oauth-config\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.711477 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.711432 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-serving-cert\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.715915 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.715891 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gltmf\" (UniqueName: \"kubernetes.io/projected/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-kube-api-access-gltmf\") pod \"console-585c9c4d69-zc5tw\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:48.780657 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:48.780551 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:49.981246 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:49.981018 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755"] Jul 08 22:44:49.984617 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:49.984574 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bb9475_5eb6_401f_b690_24cb8b0787be.slice/crio-97d7fd4a2b99a1135a1be27a95c5aac56a37668811f7b091b7aa84cbb6724c55 WatchSource:0}: Error finding container 97d7fd4a2b99a1135a1be27a95c5aac56a37668811f7b091b7aa84cbb6724c55: Status 404 returned error can't find the container with id 97d7fd4a2b99a1135a1be27a95c5aac56a37668811f7b091b7aa84cbb6724c55 Jul 08 22:44:50.005588 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.005558 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585c9c4d69-zc5tw"] Jul 08 22:44:50.012020 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:50.011911 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode772fe4b_1c51_4cf4_94fa_9c527f7c29f5.slice/crio-5745b7cbecf534de4a0a3a8b1e5a114e64e249ff7d7734f35efdbba0684813df WatchSource:0}: Error finding container 5745b7cbecf534de4a0a3a8b1e5a114e64e249ff7d7734f35efdbba0684813df: Status 404 returned error can't find the container with id 5745b7cbecf534de4a0a3a8b1e5a114e64e249ff7d7734f35efdbba0684813df Jul 08 22:44:50.617279 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.617132 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9c4d69-zc5tw" event={"ID":"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5","Type":"ContainerStarted","Data":"5745b7cbecf534de4a0a3a8b1e5a114e64e249ff7d7734f35efdbba0684813df"} Jul 08 22:44:50.620105 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.619660 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99q8d" event={"ID":"79af2cbc-7770-467d-af80-93bde326be2b","Type":"ContainerStarted","Data":"47ce7e27ba5d61df8449b27bddba349d34e8d4eeae674878e5ce5f8597ca53d7"} Jul 08 22:44:50.620260 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.620173 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:44:50.623034 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.623004 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7zlk" event={"ID":"23de7db5-e96d-4739-826b-7bba6b4204f9","Type":"ContainerStarted","Data":"84faf237380237af65077fb9b408878ca60cba06617e94400a6af1fd88549964"} Jul 08 22:44:50.625332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.625286 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" event={"ID":"d9bb9475-5eb6-401f-b690-24cb8b0787be","Type":"ContainerStarted","Data":"97d7fd4a2b99a1135a1be27a95c5aac56a37668811f7b091b7aa84cbb6724c55"} Jul 08 22:44:50.628255 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.627903 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" event={"ID":"8f0790b5-765c-48f7-bd8d-b693a21aeaf6","Type":"ContainerStarted","Data":"78f5224f4b9071a88f6ecfb62f9ce3fe17437356fafa7d477e434a99d36dda15"} Jul 08 22:44:50.631783 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.631184 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m2fc4" event={"ID":"03c57133-2912-49c7-89f2-4236eec922e4","Type":"ContainerStarted","Data":"b07c1468f08ad002b1864afe72cdf0c30d396882630c9afcbc437cff453108d5"} Jul 08 22:44:50.631783 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.631247 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m2fc4" event={"ID":"03c57133-2912-49c7-89f2-4236eec922e4","Type":"ContainerStarted","Data":"84f8db15bc4aad7bef9192964e96e5f18dea7a3ae55e299026149098d0945af1"} Jul 08 22:44:50.631783 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.631684 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m2fc4" Jul 08 22:44:50.635482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.635433 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99q8d" podStartSLOduration=66.240391184 podStartE2EDuration="1m13.635409492s" totalImagesPullingTime="7.395018308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:50.635266217 +0000 UTC m=+74.886248502" watchObservedRunningTime="2026-07-08 22:44:50.635409492 +0000 UTC m=+74.886391777" Jul 08 22:44:50.649755 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.649698 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n7zlk" podStartSLOduration=66.218499289 podStartE2EDuration="1m13.649681727s" totalImagesPullingTime="7.431182438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:50.64814056 +0000 UTC m=+74.899122844" watchObservedRunningTime="2026-07-08 22:44:50.649681727 +0000 UTC m=+74.900664012" Jul 08 22:44:50.663048 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.662187 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bc878598d-8b5x4" podStartSLOduration=2.220535409 podStartE2EDuration="9.662171491s" totalImagesPullingTime="7.441636082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:50.661917232 +0000 UTC m=+74.912899518" watchObservedRunningTime="2026-07-08 22:44:50.662171491 +0000 UTC m=+74.913153756" Jul 08 22:44:50.680320 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:50.679056 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m2fc4" podStartSLOduration=34.015603703 podStartE2EDuration="39.679046196s" totalImagesPullingTime="5.663442493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:50.677475877 +0000 UTC m=+74.928458172" watchObservedRunningTime="2026-07-08 22:44:50.679046196 +0000 UTC m=+74.930028481" Jul 08 22:44:51.636677 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:51.636598 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" event={"ID":"d9bb9475-5eb6-401f-b690-24cb8b0787be","Type":"ContainerStarted","Data":"0fd55fda62a8efb2990e7910c5e7facb9111c44513eb1569cc00f141a895712d"} Jul 08 22:44:51.646970 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:51.646944 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:51.651986 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:51.651506 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" podStartSLOduration=3.449684124 podStartE2EDuration="4.651486829s" totalImagesPullingTime="1.201802705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:51.650898516 +0000 UTC m=+75.901880800" watchObservedRunningTime="2026-07-08 22:44:51.651486829 +0000 UTC m=+75.902469113" Jul 08 22:44:51.748386 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:51.748307 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:51.905957 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:51.905810 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:51.957647 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:51.957614 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:52.641424 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:52.641392 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:52.647876 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:52.647699 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9h755" Jul 08 22:44:53.207832 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.207798 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:53.239398 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.239358 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq"] Jul 08 22:44:53.242687 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.242671 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.245060 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.245039 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 22:44:53.245825 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.245805 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-k8f74\"" Jul 08 22:44:53.245920 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.245838 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 22:44:53.246001 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.245987 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 22:44:53.246096 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.246075 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 22:44:53.246250 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.246159 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 22:44:53.252626 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.252568 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq"] Jul 08 22:44:53.270404 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.270348 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:53.345649 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.345608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.345804 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.345703 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.345804 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.345737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsf6\" (UniqueName: \"kubernetes.io/projected/72ec60bc-0513-4666-8548-ffa28da34ea7-kube-api-access-dcsf6\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.345804 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.345763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ec60bc-0513-4666-8548-ffa28da34ea7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.447149 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.446871 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.447149 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.446957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.447149 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.446993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsf6\" (UniqueName: \"kubernetes.io/projected/72ec60bc-0513-4666-8548-ffa28da34ea7-kube-api-access-dcsf6\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.447149 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.447031 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ec60bc-0513-4666-8548-ffa28da34ea7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.447573 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:53.447406 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 22:44:53.447573 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:44:53.447484 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-tls podName:72ec60bc-0513-4666-8548-ffa28da34ea7 nodeName:}" failed. No retries permitted until 2026-07-08 22:44:53.947462831 +0000 UTC m=+78.198445114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-w9xtq" (UID: "72ec60bc-0513-4666-8548-ffa28da34ea7") : secret "prometheus-operator-tls" not found Jul 08 22:44:53.447869 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.447842 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ec60bc-0513-4666-8548-ffa28da34ea7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.449553 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.449532 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.455499 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.455477 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsf6\" (UniqueName: \"kubernetes.io/projected/72ec60bc-0513-4666-8548-ffa28da34ea7-kube-api-access-dcsf6\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.647892 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.647808 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:53.650932 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.650892 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9c4d69-zc5tw" event={"ID":"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5","Type":"ContainerStarted","Data":"b18ee64ec83f166ded3decb991c4617290983f5544de43aa6c43bcc5d114f91b"} Jul 08 22:44:53.670188 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.669961 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585c9c4d69-zc5tw" podStartSLOduration=2.522164089 podStartE2EDuration="5.669944479s" totalImagesPullingTime="3.14778039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:53.669885391 +0000 UTC m=+77.920867676" watchObservedRunningTime="2026-07-08 22:44:53.669944479 +0000 UTC m=+77.920926764" Jul 08 22:44:53.746365 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.746245 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:53.951518 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.951484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:53.954141 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:53.954114 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ec60bc-0513-4666-8548-ffa28da34ea7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w9xtq\" (UID: \"72ec60bc-0513-4666-8548-ffa28da34ea7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:54.155815 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:54.155736 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" Jul 08 22:44:54.282250 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:54.282223 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq"] Jul 08 22:44:54.284556 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:44:54.284524 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ec60bc_0513_4666_8548_ffa28da34ea7.slice/crio-7d7f8b48d78aa80fe0bda417ea55325861d60c1c894ad9bab31ebd4f52890a64 WatchSource:0}: Error finding container 7d7f8b48d78aa80fe0bda417ea55325861d60c1c894ad9bab31ebd4f52890a64: Status 404 returned error can't find the container with id 7d7f8b48d78aa80fe0bda417ea55325861d60c1c894ad9bab31ebd4f52890a64 Jul 08 22:44:54.655941 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:54.655901 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" event={"ID":"72ec60bc-0513-4666-8548-ffa28da34ea7","Type":"ContainerStarted","Data":"7d7f8b48d78aa80fe0bda417ea55325861d60c1c894ad9bab31ebd4f52890a64"} Jul 08 22:44:57.856735 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:57.856673 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:57.906703 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:57.906660 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:44:58.781566 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:58.781527 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:58.781751 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:58.781588 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:58.787148 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:58.787123 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:44:59.685015 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:44:59.684985 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:45:00.679282 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:00.679238 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:00.756802 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:00.756748 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:01.643439 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:01.643407 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m2fc4" Jul 08 22:45:01.679955 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:01.679918 2583 patch_prober.go:28] interesting pod/image-registry-7896b7cc8-xd5q5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 22:45:01.680129 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:01.679971 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" podUID="778f055a-a91c-4d91-8c58-0d19dcf724e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 22:45:02.697613 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:02.697574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b22mx" event={"ID":"464e350a-0067-49b4-9e71-4d99d99af42e","Type":"ContainerStarted","Data":"93d512c25a812d80f6463ed16e57f856d2c44db6b31f9a09f2fcb6b023faa553"} Jul 08 22:45:02.698369 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:02.698307 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:45:02.712793 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:02.712763 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-b22mx" Jul 08 22:45:02.716383 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:02.716268 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-b22mx" podStartSLOduration=2.177731215 podStartE2EDuration="21.71625003s" totalImagesPullingTime="19.538518815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:02.715509536 +0000 UTC m=+86.966491825" watchObservedRunningTime="2026-07-08 22:45:02.71625003 +0000 UTC m=+86.967232315" Jul 08 22:45:03.586913 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:03.586889 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7896b7cc8-xd5q5" Jul 08 22:45:03.703220 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:03.703167 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" event={"ID":"72ec60bc-0513-4666-8548-ffa28da34ea7","Type":"ContainerStarted","Data":"97539ffe00e3b1463ad33fd717abe8ba26d85718c3806b93f905a2f995127f4e"} Jul 08 22:45:03.713537 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:03.713502 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:03.811472 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:03.811396 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:03.943578 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:03.943542 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:04.709031 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:04.708988 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" event={"ID":"72ec60bc-0513-4666-8548-ffa28da34ea7","Type":"ContainerStarted","Data":"7c63b5824616f3de0233a1de0b52c7492c45309f2a291ada0b6013f8e1c98164"} Jul 08 22:45:04.724581 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:04.724532 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w9xtq" podStartSLOduration=2.468797201 podStartE2EDuration="11.724514646s" totalImagesPullingTime="9.255717445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:04.723957308 +0000 UTC m=+88.974939594" watchObservedRunningTime="2026-07-08 22:45:04.724514646 +0000 UTC m=+88.975496931" Jul 08 22:45:05.458431 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:05.458399 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.363866 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.363775 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.563860 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.563815 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.616106 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.616035 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lnkp5"] Jul 08 22:45:06.643419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.643394 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.646138 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.646114 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 22:45:06.646600 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.646391 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 22:45:06.646735 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.646406 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 22:45:06.646861 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.646436 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rr5gk\"" Jul 08 22:45:06.662064 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.661981 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.759792 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.759750 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.762630 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762600 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-sys\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.762762 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762674 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-textfile\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.762762 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.762864 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762765 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhxb5\" (UniqueName: \"kubernetes.io/projected/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-kube-api-access-bhxb5\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.762864 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762850 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-root\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.762960 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-wtmp\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.762960 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-metrics-client-ca\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.763055 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762957 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-tls\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.763055 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.762997 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.859766 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.859735 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-metrics-client-ca\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863461 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-tls\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-sys\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-textfile\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhxb5\" (UniqueName: \"kubernetes.io/projected/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-kube-api-access-bhxb5\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-root\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-wtmp\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.863872 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-wtmp\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.864847 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.864471 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-metrics-client-ca\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.865510 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.865048 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-textfile\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.865510 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.865495 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.865611 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.865566 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-sys\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.866095 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.866075 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-root\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.867633 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.867567 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-tls\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.868223 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.868184 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.874122 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.874077 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhxb5\" (UniqueName: \"kubernetes.io/projected/536cafa5-2e0e-47a6-8aa9-1b8e4033116f-kube-api-access-bhxb5\") pod \"node-exporter-lnkp5\" (UID: \"536cafa5-2e0e-47a6-8aa9-1b8e4033116f\") " pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.955908 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.955874 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lnkp5" Jul 08 22:45:06.959569 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:06.959535 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:06.991366 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:45:06.991089 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536cafa5_2e0e_47a6_8aa9_1b8e4033116f.slice/crio-1719d52ad1c0a322445cc44344ff76af1d825101652586428e25e9843c0a9986 WatchSource:0}: Error finding container 1719d52ad1c0a322445cc44344ff76af1d825101652586428e25e9843c0a9986: Status 404 returned error can't find the container with id 1719d52ad1c0a322445cc44344ff76af1d825101652586428e25e9843c0a9986 Jul 08 22:45:07.062685 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.062651 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:07.160756 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.160670 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:07.577505 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.577470 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:07.665641 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.665578 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:07.689646 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.689615 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585c9c4d69-zc5tw"] Jul 08 22:45:07.724893 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.724775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lnkp5" event={"ID":"536cafa5-2e0e-47a6-8aa9-1b8e4033116f","Type":"ContainerStarted","Data":"1719d52ad1c0a322445cc44344ff76af1d825101652586428e25e9843c0a9986"} Jul 08 22:45:07.884710 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:07.884604 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:08.569600 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.567850 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dc99d8d64-n5zdb"] Jul 08 22:45:08.586151 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.586120 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dc99d8d64-n5zdb"] Jul 08 22:45:08.586608 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.586252 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.589122 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.588927 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 22:45:08.589122 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.588969 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jszkk\"" Jul 08 22:45:08.589348 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.589137 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 22:45:08.589348 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.589242 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 22:45:08.589348 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.589318 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 22:45:08.589508 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.589375 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 22:45:08.589965 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.589904 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-o6del7t1hvgp\"" Jul 08 22:45:08.678848 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.678812 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.678848 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.678849 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07ae1852-9c00-46ba-87b4-59f69ecf2977-metrics-client-ca\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.679097 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.678900 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.679097 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.678984 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-grpc-tls\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.679097 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.679092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-tls\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.679291 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.679127 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.679291 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.679162 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.679291 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.679244 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn2l4\" (UniqueName: \"kubernetes.io/projected/07ae1852-9c00-46ba-87b4-59f69ecf2977-kube-api-access-kn2l4\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780355 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780322 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-tls\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780479 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780479 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780479 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn2l4\" (UniqueName: \"kubernetes.io/projected/07ae1852-9c00-46ba-87b4-59f69ecf2977-kube-api-access-kn2l4\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780479 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780703 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780496 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07ae1852-9c00-46ba-87b4-59f69ecf2977-metrics-client-ca\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780703 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.780703 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.780557 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-grpc-tls\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.781665 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.781637 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07ae1852-9c00-46ba-87b4-59f69ecf2977-metrics-client-ca\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.783734 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.783704 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.783841 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.783785 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-grpc-tls\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.783905 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.783837 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.784182 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.784161 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-tls\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.784294 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.784229 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.784692 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.784665 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07ae1852-9c00-46ba-87b4-59f69ecf2977-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.789766 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.789738 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn2l4\" (UniqueName: \"kubernetes.io/projected/07ae1852-9c00-46ba-87b4-59f69ecf2977-kube-api-access-kn2l4\") pod \"thanos-querier-dc99d8d64-n5zdb\" (UID: \"07ae1852-9c00-46ba-87b4-59f69ecf2977\") " pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:08.899353 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:08.899328 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:09.058552 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.058519 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:09.081194 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.080962 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dc99d8d64-n5zdb"] Jul 08 22:45:09.083281 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:45:09.083250 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ae1852_9c00_46ba_87b4_59f69ecf2977.slice/crio-40e93438600ade1a9bd2688e6c6ade2efbf62745f8879602b4aa7ea346c6019d WatchSource:0}: Error finding container 40e93438600ade1a9bd2688e6c6ade2efbf62745f8879602b4aa7ea346c6019d: Status 404 returned error can't find the container with id 40e93438600ade1a9bd2688e6c6ade2efbf62745f8879602b4aa7ea346c6019d Jul 08 22:45:09.533452 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.533362 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:09.637402 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.637319 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:09.736348 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.736310 2583 generic.go:356] "Generic (PLEG): container finished" podID="536cafa5-2e0e-47a6-8aa9-1b8e4033116f" containerID="3e964f58d7e318edcc4550313803b85fe6f5a08d8994f04f1c6515633b00db19" exitCode=0 Jul 08 22:45:09.736502 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.736431 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lnkp5" event={"ID":"536cafa5-2e0e-47a6-8aa9-1b8e4033116f","Type":"ContainerDied","Data":"3e964f58d7e318edcc4550313803b85fe6f5a08d8994f04f1c6515633b00db19"} Jul 08 22:45:09.743254 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.743149 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"40e93438600ade1a9bd2688e6c6ade2efbf62745f8879602b4aa7ea346c6019d"} Jul 08 22:45:09.863156 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.863071 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:09.963486 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:09.963386 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:10.064608 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.064577 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:10.279821 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.279726 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:10.750529 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.750494 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lnkp5" event={"ID":"536cafa5-2e0e-47a6-8aa9-1b8e4033116f","Type":"ContainerStarted","Data":"623bd63b3cfdd1ad6725e18740d21c43a8d62ab80394ef7dbdc678c509dd9f4e"} Jul 08 22:45:10.751033 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.750547 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lnkp5" event={"ID":"536cafa5-2e0e-47a6-8aa9-1b8e4033116f","Type":"ContainerStarted","Data":"0d772e3c0cee47872478db5031c5fa3b7ef813f6bfabd79d017fa56583aa27f2"} Jul 08 22:45:10.773078 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.773016 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lnkp5" podStartSLOduration=2.864891366 podStartE2EDuration="4.772998615s" totalImagesPullingTime="1.773116733s" totalInitContainerRuntime="134.990516ms" isStatefulPod=true podCreationTimestamp="2026-07-08 22:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:10.771354128 +0000 UTC m=+95.022336413" watchObservedRunningTime="2026-07-08 22:45:10.772998615 +0000 UTC m=+95.023980901" Jul 08 22:45:10.892336 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.892300 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7499558545-pbpk7"] Jul 08 22:45:10.904770 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.904742 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:10.905295 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.905271 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7499558545-pbpk7"] Jul 08 22:45:10.906842 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.906819 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ghwv8\"" Jul 08 22:45:10.907241 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.907193 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 22:45:10.907565 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.907375 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 22:45:10.907565 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.907421 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-44mplcctii5h1\"" Jul 08 22:45:10.907565 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.907438 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 22:45:10.907565 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:10.907375 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 22:45:11.002365 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-secret-metrics-server-tls\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.002365 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9801c318-0b53-43c0-b582-fb5df34be864-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.002590 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002369 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvf9s\" (UniqueName: \"kubernetes.io/projected/9801c318-0b53-43c0-b582-fb5df34be864-kube-api-access-xvf9s\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.002590 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002470 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-secret-metrics-server-client-certs\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.002590 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9801c318-0b53-43c0-b582-fb5df34be864-audit-log\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.002590 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002586 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-client-ca-bundle\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.002750 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.002625 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9801c318-0b53-43c0-b582-fb5df34be864-metrics-server-audit-profiles\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104072 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-client-ca-bundle\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104286 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104085 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9801c318-0b53-43c0-b582-fb5df34be864-metrics-server-audit-profiles\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104286 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-secret-metrics-server-tls\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104286 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9801c318-0b53-43c0-b582-fb5df34be864-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104286 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvf9s\" (UniqueName: \"kubernetes.io/projected/9801c318-0b53-43c0-b582-fb5df34be864-kube-api-access-xvf9s\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104286 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-secret-metrics-server-client-certs\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.104556 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.104306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9801c318-0b53-43c0-b582-fb5df34be864-audit-log\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.105392 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.105307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9801c318-0b53-43c0-b582-fb5df34be864-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.105392 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.105310 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9801c318-0b53-43c0-b582-fb5df34be864-audit-log\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.105574 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.105447 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9801c318-0b53-43c0-b582-fb5df34be864-metrics-server-audit-profiles\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.107080 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.107058 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-secret-metrics-server-client-certs\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.107294 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.107277 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-client-ca-bundle\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.107294 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.107287 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9801c318-0b53-43c0-b582-fb5df34be864-secret-metrics-server-tls\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.111067 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.111017 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:11.112116 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.112094 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvf9s\" (UniqueName: \"kubernetes.io/projected/9801c318-0b53-43c0-b582-fb5df34be864-kube-api-access-xvf9s\") pod \"metrics-server-7499558545-pbpk7\" (UID: \"9801c318-0b53-43c0-b582-fb5df34be864\") " pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.161764 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.161737 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:11.217454 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.217416 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:11.367194 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.367111 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:11.378799 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.378765 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5"] Jul 08 22:45:11.396021 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.395994 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5"] Jul 08 22:45:11.396171 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.396118 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.399738 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.398406 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 22:45:11.399738 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.398425 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gjfkx\"" Jul 08 22:45:11.422513 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.422480 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:11.476119 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.476094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:11.508271 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.508242 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhdc\" (UniqueName: \"kubernetes.io/projected/e9f4d9cc-5c56-47e1-b6b7-b71d0616326e-kube-api-access-mwhdc\") pod \"monitoring-plugin-d5dcff7cf-tc7r5\" (UID: \"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.508389 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.508341 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9f4d9cc-5c56-47e1-b6b7-b71d0616326e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tc7r5\" (UID: \"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.610441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.609822 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhdc\" (UniqueName: \"kubernetes.io/projected/e9f4d9cc-5c56-47e1-b6b7-b71d0616326e-kube-api-access-mwhdc\") pod \"monitoring-plugin-d5dcff7cf-tc7r5\" (UID: \"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.610441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.609905 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9f4d9cc-5c56-47e1-b6b7-b71d0616326e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tc7r5\" (UID: \"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.612768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.612741 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9f4d9cc-5c56-47e1-b6b7-b71d0616326e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tc7r5\" (UID: \"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.617559 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.617493 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhdc\" (UniqueName: \"kubernetes.io/projected/e9f4d9cc-5c56-47e1-b6b7-b71d0616326e-kube-api-access-mwhdc\") pod \"monitoring-plugin-d5dcff7cf-tc7r5\" (UID: \"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.637653 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.637629 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7499558545-pbpk7"] Jul 08 22:45:11.641690 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:45:11.641669 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9801c318_0b53_43c0_b582_fb5df34be864.slice/crio-99cc205739f4561ed8151f221ac40d1038f3cc694c3d4c86454ddb124973c96e WatchSource:0}: Error finding container 99cc205739f4561ed8151f221ac40d1038f3cc694c3d4c86454ddb124973c96e: Status 404 returned error can't find the container with id 99cc205739f4561ed8151f221ac40d1038f3cc694c3d4c86454ddb124973c96e Jul 08 22:45:11.714054 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.714031 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:11.754690 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.754660 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" event={"ID":"9801c318-0b53-43c0-b582-fb5df34be864","Type":"ContainerStarted","Data":"99cc205739f4561ed8151f221ac40d1038f3cc694c3d4c86454ddb124973c96e"} Jul 08 22:45:11.952783 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:11.952758 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5"] Jul 08 22:45:11.955159 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:45:11.955136 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f4d9cc_5c56_47e1_b6b7_b71d0616326e.slice/crio-509403ffeb86bd824e8740dc96f1ff7069288ffbedaeb6c29772d8a7ec56b404 WatchSource:0}: Error finding container 509403ffeb86bd824e8740dc96f1ff7069288ffbedaeb6c29772d8a7ec56b404: Status 404 returned error can't find the container with id 509403ffeb86bd824e8740dc96f1ff7069288ffbedaeb6c29772d8a7ec56b404 Jul 08 22:45:12.461627 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.461589 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84dfdfdb9-m9m87"] Jul 08 22:45:12.477196 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.477164 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84dfdfdb9-m9m87"] Jul 08 22:45:12.477360 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.477303 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.485130 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.485107 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 22:45:12.516987 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.516963 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcrgw\" (UniqueName: \"kubernetes.io/projected/104fa20f-8482-45ee-992e-da001f20143f-kube-api-access-tcrgw\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.517126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.517027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-service-ca\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.517126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.517105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-oauth-config\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.517241 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.517139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-trusted-ca-bundle\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.517241 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.517167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-oauth-serving-cert\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.517241 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.517200 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-serving-cert\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.517358 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.517268 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-console-config\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618562 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618519 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcrgw\" (UniqueName: \"kubernetes.io/projected/104fa20f-8482-45ee-992e-da001f20143f-kube-api-access-tcrgw\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-service-ca\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618657 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-oauth-config\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618693 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-trusted-ca-bundle\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-oauth-serving-cert\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618767 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-serving-cert\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.618786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.618792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-console-config\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.620003 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.619600 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-console-config\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.620110 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.620084 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-service-ca\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.620830 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.620258 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-oauth-serving-cert\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.620932 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.620884 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-trusted-ca-bundle\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.623437 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.623382 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-oauth-config\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.623546 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.623513 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-serving-cert\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.629589 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.629568 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcrgw\" (UniqueName: \"kubernetes.io/projected/104fa20f-8482-45ee-992e-da001f20143f-kube-api-access-tcrgw\") pod \"console-84dfdfdb9-m9m87\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.687514 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.687474 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:12.763599 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.763504 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"e498f9e047350fdf362cd48b7ce1da28e7a435d32c42781da39b852cf5a74987"} Jul 08 22:45:12.764056 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.763601 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"b57b0ccb2ee2a925ae77d4a0385f410a4b8142a974c79e9b902cf185edb3b9b3"} Jul 08 22:45:12.764056 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.763643 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"44544f9fc348438db9cf33d273cb1fd116081f5f8dbeadfd606c1e35c50867cf"} Jul 08 22:45:12.767782 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.767713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" event={"ID":"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e","Type":"ContainerStarted","Data":"509403ffeb86bd824e8740dc96f1ff7069288ffbedaeb6c29772d8a7ec56b404"} Jul 08 22:45:12.783974 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.783901 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:12.789615 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.789551 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:12.830150 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.828125 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:45:12.856987 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.855823 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:45:12.856987 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.855995 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.859341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.858405 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 22:45:12.859341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.859249 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 22:45:12.864006 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.863018 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rp82t\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864398 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864406 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864592 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864663 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864776 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864851 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.864951 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3jcjq3a9tvkun\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.865146 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.865150 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.865369 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.865375 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 22:45:12.866605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.865966 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 22:45:12.875511 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.874646 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 22:45:12.894899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.890476 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:12.922280 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922225 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922451 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922451 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922451 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922380 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922451 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922451 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922512 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922601 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922633 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922691 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wx88\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-kube-api-access-6wx88\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.922719 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922717 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.923126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922752 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.923126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922778 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.923126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.923126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922835 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.923126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.923126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.922901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:12.998955 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:12.998755 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84dfdfdb9-m9m87"] Jul 08 22:45:13.002945 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:45:13.002815 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104fa20f_8482_45ee_992e_da001f20143f.slice/crio-245c5a00af6949ebaf7cade2ddc0a30be29c902e94721b624de8a03acc27d885 WatchSource:0}: Error finding container 245c5a00af6949ebaf7cade2ddc0a30be29c902e94721b624de8a03acc27d885: Status 404 returned error can't find the container with id 245c5a00af6949ebaf7cade2ddc0a30be29c902e94721b624de8a03acc27d885 Jul 08 22:45:13.023685 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.023624 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.023685 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.023659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.023899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.023687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.024081 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.023994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.024081 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024041 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.024081 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.024321 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024298 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024742 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024867 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.024988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.025043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wx88\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-kube-api-access-6wx88\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.025330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.025062 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.025070 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.026484 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.027176 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.028061 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.028522 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.028598 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.028886 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029343 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.029152 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.029911 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.029505 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.030389 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.030336 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.030813 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.030790 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.031643 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.031168 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.031643 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.031402 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.031880 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.031728 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.032153 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.032130 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.032683 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.032660 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.034082 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.033988 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.040424 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.040381 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wx88\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-kube-api-access-6wx88\") pod \"prometheus-k8s-0\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.181899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.181742 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:13.774622 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.774590 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfdfdb9-m9m87" event={"ID":"104fa20f-8482-45ee-992e-da001f20143f","Type":"ContainerStarted","Data":"5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368"} Jul 08 22:45:13.775043 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.774640 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfdfdb9-m9m87" event={"ID":"104fa20f-8482-45ee-992e-da001f20143f","Type":"ContainerStarted","Data":"245c5a00af6949ebaf7cade2ddc0a30be29c902e94721b624de8a03acc27d885"} Jul 08 22:45:13.795636 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:13.795583 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84dfdfdb9-m9m87" podStartSLOduration=1.795566564 podStartE2EDuration="1.795566564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:13.795293083 +0000 UTC m=+98.046275367" watchObservedRunningTime="2026-07-08 22:45:13.795566564 +0000 UTC m=+98.046548847" Jul 08 22:45:14.959172 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:14.959099 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:45:14.961741 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:45:14.961677 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f96aea_e5cc_4c19_b139_f400a8b07bfb.slice/crio-d7bea2d91b2cfc351422014a678060f158b1186972691dfec968ca8083b0cc62 WatchSource:0}: Error finding container d7bea2d91b2cfc351422014a678060f158b1186972691dfec968ca8083b0cc62: Status 404 returned error can't find the container with id d7bea2d91b2cfc351422014a678060f158b1186972691dfec968ca8083b0cc62 Jul 08 22:45:15.686935 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.686882 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:15.783903 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.783869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" event={"ID":"9801c318-0b53-43c0-b582-fb5df34be864","Type":"ContainerStarted","Data":"6cc406c4b2f21d65b5dfbc90c9f3d7da91d41d3305d26618fffdd8f57a902ea2"} Jul 08 22:45:15.787104 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.787074 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:15.787290 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.787117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"53902bb8f124d122604ca16eb34a9beb00f2fc98675ac01810e1b19bb4811cc4"} Jul 08 22:45:15.787290 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.787249 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"98c276a5d0d8c88a003f9a52ae8b23107e4a4637f3ea335c92768379622d7603"} Jul 08 22:45:15.787459 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.787290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" event={"ID":"07ae1852-9c00-46ba-87b4-59f69ecf2977","Type":"ContainerStarted","Data":"7b241fd33e781d708067f0daac09b32d80f16c3e730ba317db96d898fa86b107"} Jul 08 22:45:15.787459 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.787336 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:15.788828 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.788804 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" event={"ID":"e9f4d9cc-5c56-47e1-b6b7-b71d0616326e","Type":"ContainerStarted","Data":"73d15d911b1101bb30ebf5cb1334f8dfee78c0423146a338198aaf07d2de750f"} Jul 08 22:45:15.788948 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.788855 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:15.790047 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.790019 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"d7bea2d91b2cfc351422014a678060f158b1186972691dfec968ca8083b0cc62"} Jul 08 22:45:15.793910 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.793889 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" Jul 08 22:45:15.803749 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.803708 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" podStartSLOduration=2.621283171 podStartE2EDuration="5.803696187s" totalImagesPullingTime="3.182413016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:15.802063149 +0000 UTC m=+100.053045432" watchObservedRunningTime="2026-07-08 22:45:15.803696187 +0000 UTC m=+100.054678470" Jul 08 22:45:15.824118 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.824084 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" podStartSLOduration=2.426717949 podStartE2EDuration="7.824071547s" totalImagesPullingTime="5.397353598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:15.823153488 +0000 UTC m=+100.074135769" watchObservedRunningTime="2026-07-08 22:45:15.824071547 +0000 UTC m=+100.075053833" Jul 08 22:45:15.840325 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:15.840287 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tc7r5" podStartSLOduration=1.96752982 podStartE2EDuration="4.840274188s" totalImagesPullingTime="2.872744368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:15.840043763 +0000 UTC m=+100.091026048" watchObservedRunningTime="2026-07-08 22:45:15.840274188 +0000 UTC m=+100.091256471" Jul 08 22:45:16.799798 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:16.799716 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" exitCode=0 Jul 08 22:45:16.800255 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:16.799819 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} Jul 08 22:45:19.058729 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:19.058696 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:19.110366 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:19.110326 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:20.821682 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:20.821655 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} Jul 08 22:45:21.640600 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.640568 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99q8d" Jul 08 22:45:21.807751 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.807726 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dc99d8d64-n5zdb" Jul 08 22:45:21.830267 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.830237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} Jul 08 22:45:21.830629 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.830295 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} Jul 08 22:45:21.830629 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.830320 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} Jul 08 22:45:21.830629 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.830346 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} Jul 08 22:45:21.830629 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.830371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerStarted","Data":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} Jul 08 22:45:21.855336 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.855236 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.476679765 podStartE2EDuration="9.855193597s" totalImagesPullingTime="5.361101236s" totalInitContainerRuntime="17.412596ms" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:21.854220742 +0000 UTC m=+106.105203029" watchObservedRunningTime="2026-07-08 22:45:21.855193597 +0000 UTC m=+106.106175886" Jul 08 22:45:21.907176 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.907112 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:21.964629 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:21.964593 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:22.790739 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:22.790709 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:22.791001 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:22.790770 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:22.796275 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:22.796247 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:22.842424 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:22.842396 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:45:22.999119 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:22.999083 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:23.182041 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:23.182014 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:45:23.201862 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:23.201821 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:23.302126 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:23.302095 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:24.346941 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:24.346900 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7hpx_6a74772e-bfa1-4ae9-badf-03c8c11428f2/serve-healthcheck-canary/0.log" Jul 08 22:45:31.218376 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:31.218343 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:31.218837 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:31.218404 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:32.721769 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:32.721702 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-585c9c4d69-zc5tw" podUID="e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" containerName="console" containerID="cri-o://b18ee64ec83f166ded3decb991c4617290983f5544de43aa6c43bcc5d114f91b" gracePeriod=15 Jul 08 22:45:32.876863 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:32.876829 2583 generic.go:356] "Generic (PLEG): container finished" podID="e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" containerID="b18ee64ec83f166ded3decb991c4617290983f5544de43aa6c43bcc5d114f91b" exitCode=0 Jul 08 22:45:32.876999 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:32.876902 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9c4d69-zc5tw" event={"ID":"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5","Type":"ContainerDied","Data":"b18ee64ec83f166ded3decb991c4617290983f5544de43aa6c43bcc5d114f91b"} Jul 08 22:45:33.008109 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.008077 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:45:33.101432 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101405 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-service-ca\") pod \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " Jul 08 22:45:33.101432 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101431 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-config\") pod \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " Jul 08 22:45:33.101669 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101456 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-oauth-serving-cert\") pod \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " Jul 08 22:45:33.101669 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101481 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gltmf\" (UniqueName: \"kubernetes.io/projected/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-kube-api-access-gltmf\") pod \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " Jul 08 22:45:33.101669 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101624 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-serving-cert\") pod \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " Jul 08 22:45:33.101823 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101704 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-oauth-config\") pod \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\" (UID: \"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5\") " Jul 08 22:45:33.101915 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101865 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" (UID: "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:45:33.101915 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101880 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" (UID: "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:45:33.102023 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.101934 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-config" (OuterVolumeSpecName: "console-config") pod "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" (UID: "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:45:33.102073 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.102033 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-service-ca\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:45:33.102073 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.102051 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-config\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:45:33.102073 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.102064 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-oauth-serving-cert\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:45:33.103886 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.103847 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-kube-api-access-gltmf" (OuterVolumeSpecName: "kube-api-access-gltmf") pod "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" (UID: "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5"). InnerVolumeSpecName "kube-api-access-gltmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:45:33.103886 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.103851 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" (UID: "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:45:33.104022 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.103904 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" (UID: "e772fe4b-1c51-4cf4-94fa-9c527f7c29f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:45:33.202895 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.202870 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gltmf\" (UniqueName: \"kubernetes.io/projected/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-kube-api-access-gltmf\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:45:33.202895 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.202890 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-serving-cert\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:45:33.202895 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.202899 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5-console-oauth-config\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:45:33.881595 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.881558 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9c4d69-zc5tw" event={"ID":"e772fe4b-1c51-4cf4-94fa-9c527f7c29f5","Type":"ContainerDied","Data":"5745b7cbecf534de4a0a3a8b1e5a114e64e249ff7d7734f35efdbba0684813df"} Jul 08 22:45:33.882070 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.881613 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9c4d69-zc5tw" Jul 08 22:45:33.882070 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.881627 2583 scope.go:117] "RemoveContainer" containerID="b18ee64ec83f166ded3decb991c4617290983f5544de43aa6c43bcc5d114f91b" Jul 08 22:45:33.900450 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.900422 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585c9c4d69-zc5tw"] Jul 08 22:45:33.905612 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:33.905590 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-585c9c4d69-zc5tw"] Jul 08 22:45:34.312740 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:34.312707 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" path="/var/lib/kubelet/pods/e772fe4b-1c51-4cf4-94fa-9c527f7c29f5/volumes" Jul 08 22:45:36.910483 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:36.910439 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:37.010191 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:37.010142 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:43.846435 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:43.846399 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:43.947222 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:43.947173 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:44.000883 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:44.000833 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:45:51.222973 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:51.222935 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:45:51.226763 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:45:51.226739 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7499558545-pbpk7" Jul 08 22:46:13.182047 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:13.182016 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:13.200517 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:13.200495 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:14.052082 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:14.052057 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:25.794862 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:25.794781 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:25.996983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:25.996950 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:31.159904 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.159822 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:46:31.160330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.160135 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="prometheus" containerID="cri-o://b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" gracePeriod=600 Jul 08 22:46:31.160330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.160154 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy" containerID="cri-o://9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" gracePeriod=600 Jul 08 22:46:31.160330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.160201 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="config-reloader" containerID="cri-o://5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" gracePeriod=600 Jul 08 22:46:31.160330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.160236 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-web" containerID="cri-o://3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" gracePeriod=600 Jul 08 22:46:31.160330 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.160188 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" gracePeriod=600 Jul 08 22:46:31.160619 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.160390 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="thanos-sidecar" containerID="cri-o://ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" gracePeriod=600 Jul 08 22:46:31.411515 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.411453 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:31.496175 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496145 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-2\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496175 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496178 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-web-config\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496236 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-trusted-ca-bundle\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496279 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wx88\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-kube-api-access-6wx88\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496300 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-0\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496318 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-kubelet-serving-ca-bundle\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496336 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-thanos-prometheus-http-client-file\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496384 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-db\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496429 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496414 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-kube-rbac-proxy\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496445 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-serving-certs-ca-bundle\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496483 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config-out\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496508 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-metrics-client-ca\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496533 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-grpc-tls\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496542 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496557 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496624 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496654 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-tls\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496683 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496680 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496749 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-metrics-client-certs\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.496771 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496776 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-tls-assets\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.497332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496784 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.497332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.496803 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-1\") pod \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\" (UID: \"e6f96aea-e5cc-4c19-b139-f400a8b07bfb\") " Jul 08 22:46:31.497332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.497101 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.497332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.497118 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.497332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.497136 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.497582 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.497448 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.497582 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.497509 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.498356 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.498326 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.498809 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.498783 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:46:31.498899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.498885 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:46:31.499990 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.499960 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-kube-api-access-6wx88" (OuterVolumeSpecName: "kube-api-access-6wx88") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "kube-api-access-6wx88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:46:31.500080 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.500038 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config" (OuterVolumeSpecName: "config") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.500377 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.500353 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.500672 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.500641 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.500988 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.500957 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.501065 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.500985 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.501124 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.501095 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config-out" (OuterVolumeSpecName: "config-out") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:46:31.501124 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.501103 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.501264 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.501243 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.501992 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.501967 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.502563 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.502540 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:46:31.510789 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.510766 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-web-config" (OuterVolumeSpecName: "web-config") pod "e6f96aea-e5cc-4c19-b139-f400a8b07bfb" (UID: "e6f96aea-e5cc-4c19-b139-f400a8b07bfb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:31.598160 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598131 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wx88\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-kube-api-access-6wx88\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598160 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598155 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598160 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598166 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598175 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-db\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598184 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-kube-rbac-proxy\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598192 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598200 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config-out\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598227 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-configmap-metrics-client-ca\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598235 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-grpc-tls\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598245 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-config\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598253 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598262 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598270 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598279 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-secret-metrics-client-certs\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598289 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-tls-assets\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598298 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:31.598363 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:31.598306 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6f96aea-e5cc-4c19-b139-f400a8b07bfb-web-config\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:46:32.108963 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.108931 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" exitCode=0 Jul 08 22:46:32.108963 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.108955 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" exitCode=0 Jul 08 22:46:32.108963 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.108962 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" exitCode=0 Jul 08 22:46:32.108963 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.108968 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" exitCode=0 Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.108975 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" exitCode=0 Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.108981 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" exitCode=0 Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109005 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109021 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109136 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109181 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109198 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109242 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109287 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} Jul 08 22:46:32.109328 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} Jul 08 22:46:32.109742 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.109373 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6f96aea-e5cc-4c19-b139-f400a8b07bfb","Type":"ContainerDied","Data":"d7bea2d91b2cfc351422014a678060f158b1186972691dfec968ca8083b0cc62"} Jul 08 22:46:32.117891 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.117689 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.124508 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.124493 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.130970 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.130949 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.132030 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.131948 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:46:32.136696 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.136675 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:46:32.138341 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.138314 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.144584 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.144567 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.151324 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.151310 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.156618 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156594 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:46:32.156856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156840 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-thanos" Jul 08 22:46:32.156856 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156854 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-thanos" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156870 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="init-config-reloader" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156875 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="init-config-reloader" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156882 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156888 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156897 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="thanos-sidecar" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156903 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="thanos-sidecar" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156909 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-web" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156914 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-web" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156922 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" containerName="console" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156927 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" containerName="console" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156935 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="config-reloader" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156940 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="config-reloader" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156947 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="prometheus" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156952 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="prometheus" Jul 08 22:46:32.156983 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156993 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="config-reloader" Jul 08 22:46:32.157706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.156999 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="thanos-sidecar" Jul 08 22:46:32.157706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.157006 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy" Jul 08 22:46:32.157706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.157012 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e772fe4b-1c51-4cf4-94fa-9c527f7c29f5" containerName="console" Jul 08 22:46:32.157706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.157017 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="prometheus" Jul 08 22:46:32.157706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.157023 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-web" Jul 08 22:46:32.157706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.157029 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" containerName="kube-rbac-proxy-thanos" Jul 08 22:46:32.158385 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.158367 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.158656 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.158637 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.158702 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.158664 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} err="failed to get container status \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" Jul 08 22:46:32.158702 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.158692 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.158924 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.158909 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.158984 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.158926 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} err="failed to get container status \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" Jul 08 22:46:32.158984 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.158938 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.159168 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.159150 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.159223 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.159174 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} err="failed to get container status \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" Jul 08 22:46:32.159223 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.159195 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.159482 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.159464 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.159535 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.159486 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} err="failed to get container status \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" Jul 08 22:46:32.159535 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.159499 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.159720 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.159706 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.159769 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.159722 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} err="failed to get container status \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" Jul 08 22:46:32.159769 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.159733 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.160363 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.160340 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.160772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.160366 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} err="failed to get container status \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" Jul 08 22:46:32.160772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.160383 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.160772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.160417 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.160772 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:46:32.160620 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.160772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.160651 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} err="failed to get container status \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" Jul 08 22:46:32.160772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.160672 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.161069 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161006 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} err="failed to get container status \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" Jul 08 22:46:32.161069 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161024 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.161383 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161364 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} err="failed to get container status \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" Jul 08 22:46:32.161458 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161383 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.161638 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161618 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} err="failed to get container status \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" Jul 08 22:46:32.161638 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161636 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.161869 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161853 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} err="failed to get container status \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" Jul 08 22:46:32.161869 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.161869 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.162093 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162074 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} err="failed to get container status \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" Jul 08 22:46:32.162093 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162093 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.162332 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162306 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} err="failed to get container status \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" Jul 08 22:46:32.162394 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162337 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.162612 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162590 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} err="failed to get container status \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" Jul 08 22:46:32.162612 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162612 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.162770 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162654 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 22:46:32.162770 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162748 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 22:46:32.162960 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162799 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rp82t\"" Jul 08 22:46:32.162960 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162842 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} err="failed to get container status \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" Jul 08 22:46:32.162960 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162865 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.162960 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.162882 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 22:46:32.163223 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163099 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 22:46:32.163223 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163170 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3jcjq3a9tvkun\"" Jul 08 22:46:32.163223 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163192 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 22:46:32.163370 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163291 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 22:46:32.163441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163410 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} err="failed to get container status \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" Jul 08 22:46:32.163441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163436 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.163600 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163505 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 22:46:32.163600 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.163516 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 22:46:32.164112 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164089 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} err="failed to get container status \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" Jul 08 22:46:32.164112 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164111 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.164276 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164223 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 22:46:32.164276 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164258 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 22:46:32.164420 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164383 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} err="failed to get container status \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" Jul 08 22:46:32.164491 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164422 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.164678 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164654 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} err="failed to get container status \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" Jul 08 22:46:32.164790 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164693 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.164790 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164731 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 22:46:32.164917 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164841 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 22:46:32.164979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164937 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} err="failed to get container status \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" Jul 08 22:46:32.164979 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.164958 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.165317 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165293 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} err="failed to get container status \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" Jul 08 22:46:32.165417 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165319 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.165624 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165591 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} err="failed to get container status \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" Jul 08 22:46:32.165624 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165617 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.165885 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165862 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 22:46:32.165988 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165863 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} err="failed to get container status \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" Jul 08 22:46:32.165988 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.165910 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.166176 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.166158 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} err="failed to get container status \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" Jul 08 22:46:32.166272 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.166177 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.166458 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.166431 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} err="failed to get container status \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" Jul 08 22:46:32.166458 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.166457 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.166772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.166747 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} err="failed to get container status \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" Jul 08 22:46:32.166772 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.166768 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.167122 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.167096 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} err="failed to get container status \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" Jul 08 22:46:32.167249 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.167124 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.167441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.167418 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} err="failed to get container status \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" Jul 08 22:46:32.167528 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.167442 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.167791 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.167760 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} err="failed to get container status \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" Jul 08 22:46:32.167891 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.167806 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.168103 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} err="failed to get container status \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.168133 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.168846 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} err="failed to get container status \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.168893 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.169539 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.169535 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} err="failed to get container status \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.169593 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.169841 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} err="failed to get container status \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.169862 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170070 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} err="failed to get container status \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170089 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170316 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} err="failed to get container status \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170336 2583 scope.go:117] "RemoveContainer" containerID="53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170532 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91"} err="failed to get container status \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": rpc error: code = NotFound desc = could not find container \"53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91\": container with ID starting with 53a1b3e2e4d6ee24f848b29e82cfb2bb72c9abc652b59da54255a3ad73b54c91 not found: ID does not exist" Jul 08 22:46:32.170557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170553 2583 scope.go:117] "RemoveContainer" containerID="9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95" Jul 08 22:46:32.171482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170857 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95"} err="failed to get container status \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": rpc error: code = NotFound desc = could not find container \"9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95\": container with ID starting with 9bd37cb9b09fcbcbbcb147b2b1e965596c9dd18a8a8ab1760c1126b286bced95 not found: ID does not exist" Jul 08 22:46:32.171482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.170881 2583 scope.go:117] "RemoveContainer" containerID="3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9" Jul 08 22:46:32.171482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171148 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9"} err="failed to get container status \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": rpc error: code = NotFound desc = could not find container \"3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9\": container with ID starting with 3026b0ed2b45ed200c124ab89754d80ee2e290673aa0819d88071d8eb06d1cb9 not found: ID does not exist" Jul 08 22:46:32.171482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171176 2583 scope.go:117] "RemoveContainer" containerID="ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f" Jul 08 22:46:32.171482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171435 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f"} err="failed to get container status \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": rpc error: code = NotFound desc = could not find container \"ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f\": container with ID starting with ea75aa346e3e20c57e9220d101d12a0782eb5f50c4e1e4dbd628f0d6bc5cce8f not found: ID does not exist" Jul 08 22:46:32.171482 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171456 2583 scope.go:117] "RemoveContainer" containerID="5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81" Jul 08 22:46:32.171711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171676 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81"} err="failed to get container status \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": rpc error: code = NotFound desc = could not find container \"5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81\": container with ID starting with 5dacd16c11967c84e40c35a16301162a08a9b2f54db2fe692ce4e9e33fa67b81 not found: ID does not exist" Jul 08 22:46:32.171711 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171692 2583 scope.go:117] "RemoveContainer" containerID="b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827" Jul 08 22:46:32.171900 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171880 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827"} err="failed to get container status \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": rpc error: code = NotFound desc = could not find container \"b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827\": container with ID starting with b52151141d6014b976358b4248ab96cb3ac6711c3bf792c9fc47432ffc1f0827 not found: ID does not exist" Jul 08 22:46:32.171971 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.171902 2583 scope.go:117] "RemoveContainer" containerID="77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f" Jul 08 22:46:32.172176 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.172158 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f"} err="failed to get container status \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": rpc error: code = NotFound desc = could not find container \"77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f\": container with ID starting with 77117b64059ab9fff3a9418e01263285bd72bc34998fe9131a441bdaaa519b1f not found: ID does not exist" Jul 08 22:46:32.175113 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.175044 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:46:32.303061 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303030 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-config\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303226 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303068 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303226 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303226 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303116 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303226 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303141 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303226 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303226 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303189 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303238 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303280 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303298 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303320 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303362 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303383 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303640 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303470 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc80e062-51c5-48e9-827f-4d4934d56a24-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303640 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303550 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4z6\" (UniqueName: \"kubernetes.io/projected/bc80e062-51c5-48e9-827f-4d4934d56a24-kube-api-access-nf4z6\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303640 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303574 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303640 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303598 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc80e062-51c5-48e9-827f-4d4934d56a24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.303640 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.303615 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.311662 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.311641 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6f96aea-e5cc-4c19-b139-f400a8b07bfb" path="/var/lib/kubelet/pods/e6f96aea-e5cc-4c19-b139-f400a8b07bfb/volumes" Jul 08 22:46:32.404182 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.404182 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.404182 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404176 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.404338 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404227 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.404338 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.404338 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404280 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.404338 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc80e062-51c5-48e9-827f-4d4934d56a24-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4z6\" (UniqueName: \"kubernetes.io/projected/bc80e062-51c5-48e9-827f-4d4934d56a24-kube-api-access-nf4z6\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc80e062-51c5-48e9-827f-4d4934d56a24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-config\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404875 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404941 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.404974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405009 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405076 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405099 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.406768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405118 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.407717 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.405448 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.407717 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.407321 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.407830 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.407768 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.407830 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.407818 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc80e062-51c5-48e9-827f-4d4934d56a24-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.407931 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.407829 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.407931 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.407844 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.408646 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.408408 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.408646 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.408413 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.408980 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.408959 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc80e062-51c5-48e9-827f-4d4934d56a24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.409412 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.409390 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.409706 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.409681 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.409879 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.409855 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.410111 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.410093 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-config\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.410271 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.410255 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc80e062-51c5-48e9-827f-4d4934d56a24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.410554 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.410538 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc80e062-51c5-48e9-827f-4d4934d56a24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.415497 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.415477 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4z6\" (UniqueName: \"kubernetes.io/projected/bc80e062-51c5-48e9-827f-4d4934d56a24-kube-api-access-nf4z6\") pod \"prometheus-k8s-0\" (UID: \"bc80e062-51c5-48e9-827f-4d4934d56a24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.487521 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.487485 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:32.623464 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:32.623440 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 22:46:32.624727 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:46:32.624703 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc80e062_51c5_48e9_827f_4d4934d56a24.slice/crio-eb609c0a16204fd9a3f82bebd88878e8347b6e2c108f3f7b510fa87f6a640a54 WatchSource:0}: Error finding container eb609c0a16204fd9a3f82bebd88878e8347b6e2c108f3f7b510fa87f6a640a54: Status 404 returned error can't find the container with id eb609c0a16204fd9a3f82bebd88878e8347b6e2c108f3f7b510fa87f6a640a54 Jul 08 22:46:33.118949 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:33.118916 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc80e062-51c5-48e9-827f-4d4934d56a24" containerID="086c71bea6b4723a0f5da913427305d94d2b5aa2362eec6b207687406f6feee2" exitCode=0 Jul 08 22:46:33.119099 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:33.118993 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerDied","Data":"086c71bea6b4723a0f5da913427305d94d2b5aa2362eec6b207687406f6feee2"} Jul 08 22:46:33.119099 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:33.119071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"eb609c0a16204fd9a3f82bebd88878e8347b6e2c108f3f7b510fa87f6a640a54"} Jul 08 22:46:34.126666 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.126634 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"53800b7cd5e3a914610dfa255a6eca37d97e65cd5427e26f59854389160d0c8e"} Jul 08 22:46:34.127036 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.126701 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"6b12906e75484fe7cc9c5faf29b96125985927cc482f2467c7ae8c72ba262618"} Jul 08 22:46:34.127036 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.126728 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"9ba5e207d80fe4b4ca4fd25edda0b49b565bd91ad4305259a3aa07d1084edc22"} Jul 08 22:46:34.127036 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.126753 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"aee06fdb480e96e87825e9a3d69cd3811d6ef6f2b03cdd9c52a702bd14dd113c"} Jul 08 22:46:34.127036 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.126779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"508e627c04c48659b6de99dd646d1ea73bb6378b3f71e5701441f3c4c86a4891"} Jul 08 22:46:34.127036 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.126803 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc80e062-51c5-48e9-827f-4d4934d56a24","Type":"ContainerStarted","Data":"be0e69d1b59560b499b727cf8206e18cc50659d106bdd9141cf509976f6e5005"} Jul 08 22:46:34.153782 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.153724 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.131511437 podStartE2EDuration="2.153702133s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.190696ms" isStatefulPod=false podCreationTimestamp="2026-07-08 22:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:46:34.151775204 +0000 UTC m=+178.402757513" watchObservedRunningTime="2026-07-08 22:46:34.153702133 +0000 UTC m=+178.404684482" Jul 08 22:46:34.495265 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:34.495232 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:35.028899 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:35.028859 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:35.128334 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:35.128294 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:37.488138 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:37.488107 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:46:46.147792 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:46.147755 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84dfdfdb9-m9m87"] Jul 08 22:46:46.247963 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:46.247927 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:46.304848 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:46.304821 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:54.489885 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:54.489854 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:46:54.590077 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:46:54.590051 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:47:11.176397 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.176338 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84dfdfdb9-m9m87" podUID="104fa20f-8482-45ee-992e-da001f20143f" containerName="console" containerID="cri-o://5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368" gracePeriod=15 Jul 08 22:47:11.423622 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.423600 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:47:11.519120 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519087 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-console-config\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519304 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519131 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-service-ca\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519304 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519170 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-oauth-config\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519304 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519230 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-oauth-serving-cert\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519304 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519290 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-trusted-ca-bundle\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519516 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519324 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcrgw\" (UniqueName: \"kubernetes.io/projected/104fa20f-8482-45ee-992e-da001f20143f-kube-api-access-tcrgw\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519516 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519369 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-serving-cert\") pod \"104fa20f-8482-45ee-992e-da001f20143f\" (UID: \"104fa20f-8482-45ee-992e-da001f20143f\") " Jul 08 22:47:11.519821 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519535 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-console-config" (OuterVolumeSpecName: "console-config") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:47:11.519821 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519549 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-service-ca" (OuterVolumeSpecName: "service-ca") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:47:11.519821 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519743 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:47:11.519821 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.519782 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:47:11.521397 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.521369 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:47:11.521397 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.521386 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/104fa20f-8482-45ee-992e-da001f20143f-kube-api-access-tcrgw" (OuterVolumeSpecName: "kube-api-access-tcrgw") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "kube-api-access-tcrgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:47:11.521519 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.521435 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "104fa20f-8482-45ee-992e-da001f20143f" (UID: "104fa20f-8482-45ee-992e-da001f20143f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:47:11.619912 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619887 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-trusted-ca-bundle\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:11.619912 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619908 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcrgw\" (UniqueName: \"kubernetes.io/projected/104fa20f-8482-45ee-992e-da001f20143f-kube-api-access-tcrgw\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:11.620040 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619918 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-serving-cert\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:11.620040 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619928 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-console-config\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:11.620040 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619936 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-service-ca\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:11.620040 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619943 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/104fa20f-8482-45ee-992e-da001f20143f-console-oauth-config\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:11.620040 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:11.619951 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/104fa20f-8482-45ee-992e-da001f20143f-oauth-serving-cert\") on node \"ip-10-0-132-102.ec2.internal\" DevicePath \"\"" Jul 08 22:47:12.274901 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.274866 2583 generic.go:356] "Generic (PLEG): container finished" podID="104fa20f-8482-45ee-992e-da001f20143f" containerID="5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368" exitCode=0 Jul 08 22:47:12.275401 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.274913 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfdfdb9-m9m87" Jul 08 22:47:12.275401 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.274917 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfdfdb9-m9m87" event={"ID":"104fa20f-8482-45ee-992e-da001f20143f","Type":"ContainerDied","Data":"5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368"} Jul 08 22:47:12.275401 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.275056 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfdfdb9-m9m87" event={"ID":"104fa20f-8482-45ee-992e-da001f20143f","Type":"ContainerDied","Data":"245c5a00af6949ebaf7cade2ddc0a30be29c902e94721b624de8a03acc27d885"} Jul 08 22:47:12.275401 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.275085 2583 scope.go:117] "RemoveContainer" containerID="5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368" Jul 08 22:47:12.283310 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.283288 2583 scope.go:117] "RemoveContainer" containerID="5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368" Jul 08 22:47:12.283571 ip-10-0-132-102 kubenswrapper[2583]: E0708 22:47:12.283546 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368\": container with ID starting with 5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368 not found: ID does not exist" containerID="5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368" Jul 08 22:47:12.283624 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.283575 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368"} err="failed to get container status \"5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368\": rpc error: code = NotFound desc = could not find container \"5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368\": container with ID starting with 5adf0f354c9f239e7ea0ac5a8de3460816d00a95e62dbf7ac89b0b6ef405f368 not found: ID does not exist" Jul 08 22:47:12.294691 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.294672 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84dfdfdb9-m9m87"] Jul 08 22:47:12.301002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.297573 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84dfdfdb9-m9m87"] Jul 08 22:47:12.311923 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:12.311901 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="104fa20f-8482-45ee-992e-da001f20143f" path="/var/lib/kubelet/pods/104fa20f-8482-45ee-992e-da001f20143f/volumes" Jul 08 22:47:32.488545 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:32.488512 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:47:32.503653 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:32.503627 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:47:33.364783 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:33.364758 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 22:47:41.012805 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:41.012776 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:47:41.063525 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:41.063497 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:47:49.351565 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:49.351530 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:47:49.405557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:49.405524 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:47:52.917078 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:52.917044 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:47:53.019151 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:47:53.019116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:00.538522 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:00.538404 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:00.589088 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:00.589058 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:00.645216 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:00.645166 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:06.917377 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:06.917342 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:07.018002 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:07.017971 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:36.132065 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:36.132037 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 22:48:43.763777 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:43.763729 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:46.678405 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:46.678367 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n7zlk_23de7db5-e96d-4739-826b-7bba6b4204f9/global-pull-secret-syncer/0.log" Jul 08 22:48:46.731678 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:46.731647 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" Jul 08 22:48:46.823786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:46.823754 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-102.ec2.internal_39075cd2ef36173f182863b8b08c612c/haproxy/0.log" Jul 08 22:48:48.947712 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:48.947681 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:48:51.023649 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.023613 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7499558545-pbpk7_9801c318-0b53-43c0-b582-fb5df34be864/metrics-server/0.log" Jul 08 22:48:51.047863 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.047823 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-tc7r5_e9f4d9cc-5c56-47e1-b6b7-b71d0616326e/monitoring-plugin/0.log" Jul 08 22:48:51.075160 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.075139 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lnkp5_536cafa5-2e0e-47a6-8aa9-1b8e4033116f/node-exporter/0.log" Jul 08 22:48:51.095329 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.095307 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lnkp5_536cafa5-2e0e-47a6-8aa9-1b8e4033116f/kube-rbac-proxy/0.log" Jul 08 22:48:51.117634 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.117618 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lnkp5_536cafa5-2e0e-47a6-8aa9-1b8e4033116f/init-textfile/0.log" Jul 08 22:48:51.367768 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.367688 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/prometheus/0.log" Jul 08 22:48:51.387824 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.387784 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/config-reloader/0.log" Jul 08 22:48:51.412181 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.412162 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/thanos-sidecar/0.log" Jul 08 22:48:51.432441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.432416 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/kube-rbac-proxy-web/0.log" Jul 08 22:48:51.456081 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.456062 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/kube-rbac-proxy/0.log" Jul 08 22:48:51.475861 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.475840 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/kube-rbac-proxy-thanos/0.log" Jul 08 22:48:51.496091 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.496061 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc80e062-51c5-48e9-827f-4d4934d56a24/init-config-reloader/0.log" Jul 08 22:48:51.523366 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.523348 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-w9xtq_72ec60bc-0513-4666-8548-ffa28da34ea7/prometheus-operator/0.log" Jul 08 22:48:51.542070 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.542052 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-w9xtq_72ec60bc-0513-4666-8548-ffa28da34ea7/kube-rbac-proxy/0.log" Jul 08 22:48:51.564723 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.564703 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-9h755_d9bb9475-5eb6-401f-b690-24cb8b0787be/prometheus-operator-admission-webhook/0.log" Jul 08 22:48:51.669716 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.669659 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc99d8d64-n5zdb_07ae1852-9c00-46ba-87b4-59f69ecf2977/thanos-query/0.log" Jul 08 22:48:51.690359 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.690337 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc99d8d64-n5zdb_07ae1852-9c00-46ba-87b4-59f69ecf2977/kube-rbac-proxy-web/0.log" Jul 08 22:48:51.709419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.709391 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc99d8d64-n5zdb_07ae1852-9c00-46ba-87b4-59f69ecf2977/kube-rbac-proxy/0.log" Jul 08 22:48:51.736978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.736959 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc99d8d64-n5zdb_07ae1852-9c00-46ba-87b4-59f69ecf2977/prom-label-proxy/0.log" Jul 08 22:48:51.769556 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.769536 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc99d8d64-n5zdb_07ae1852-9c00-46ba-87b4-59f69ecf2977/kube-rbac-proxy-rules/0.log" Jul 08 22:48:51.797108 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:51.797090 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc99d8d64-n5zdb_07ae1852-9c00-46ba-87b4-59f69ecf2977/kube-rbac-proxy-metrics/0.log" Jul 08 22:48:53.730035 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.730007 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls"] Jul 08 22:48:53.730534 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.730456 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="104fa20f-8482-45ee-992e-da001f20143f" containerName="console" Jul 08 22:48:53.730534 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.730474 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="104fa20f-8482-45ee-992e-da001f20143f" containerName="console" Jul 08 22:48:53.730652 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.730539 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="104fa20f-8482-45ee-992e-da001f20143f" containerName="console" Jul 08 22:48:53.733540 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.733517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:53.735721 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.735700 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-956sj\"/\"default-dockercfg-ftqpx\"" Jul 08 22:48:53.735839 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.735704 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-956sj\"/\"kube-root-ca.crt\"" Jul 08 22:48:53.736480 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.736463 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-956sj\"/\"openshift-service-ca.crt\"" Jul 08 22:48:53.741103 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.741085 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls"] Jul 08 22:48:53.831854 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.831829 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-b22mx_464e350a-0067-49b4-9e71-4d99d99af42e/download-server/0.log" Jul 08 22:48:53.900826 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.900799 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-sys\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:53.900956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.900854 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-proc\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:53.900956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.900878 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdrk4\" (UniqueName: \"kubernetes.io/projected/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-kube-api-access-xdrk4\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:53.900956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.900926 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-lib-modules\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:53.900956 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:53.900946 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-podres\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002125 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-sys\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002125 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002117 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-proc\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002309 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdrk4\" (UniqueName: \"kubernetes.io/projected/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-kube-api-access-xdrk4\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002309 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002172 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-lib-modules\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002309 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002188 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-sys\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002309 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002195 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-proc\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002309 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-podres\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002548 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002316 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-podres\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.002548 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.002316 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-lib-modules\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.009458 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.009441 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdrk4\" (UniqueName: \"kubernetes.io/projected/d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9-kube-api-access-xdrk4\") pod \"perf-node-gather-daemonset-6f7ls\" (UID: \"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9\") " pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.044460 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.044436 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.168419 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.168344 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls"] Jul 08 22:48:54.171015 ip-10-0-132-102 kubenswrapper[2583]: W0708 22:48:54.170984 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd27f8c34_9bc0_4eb3_bc26_d33e3f2d90f9.slice/crio-aa25f73ca2808a76b7835a3d52b14b108a8ff2c805a9b972bb6f0284a21ff0fe WatchSource:0}: Error finding container aa25f73ca2808a76b7835a3d52b14b108a8ff2c805a9b972bb6f0284a21ff0fe: Status 404 returned error can't find the container with id aa25f73ca2808a76b7835a3d52b14b108a8ff2c805a9b972bb6f0284a21ff0fe Jul 08 22:48:54.639314 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.639283 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" event={"ID":"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9","Type":"ContainerStarted","Data":"8dc6189d6ef3595987552cfe74458888aeda8045c44ef605cecdd8d2b4e3c2e6"} Jul 08 22:48:54.639486 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.639329 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" event={"ID":"d27f8c34-9bc0-4eb3-bc26-d33e3f2d90f9","Type":"ContainerStarted","Data":"aa25f73ca2808a76b7835a3d52b14b108a8ff2c805a9b972bb6f0284a21ff0fe"} Jul 08 22:48:54.639486 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.639405 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:48:54.654841 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:54.654799 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" podStartSLOduration=1.654784336 podStartE2EDuration="1.654784336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:54.65413211 +0000 UTC m=+318.905114393" watchObservedRunningTime="2026-07-08 22:48:54.654784336 +0000 UTC m=+318.905766617" Jul 08 22:48:55.086234 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:55.086191 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m2fc4_03c57133-2912-49c7-89f2-4236eec922e4/dns/0.log" Jul 08 22:48:55.105618 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:55.105584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m2fc4_03c57133-2912-49c7-89f2-4236eec922e4/kube-rbac-proxy/0.log" Jul 08 22:48:55.193579 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:55.193559 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mggh_d2c502bd-45c4-4182-bc60-2bb286399958/dns-node-resolver/0.log" Jul 08 22:48:55.580993 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:55.580969 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7896b7cc8-xd5q5_778f055a-a91c-4d91-8c58-0d19dcf724e2/registry/0.log" Jul 08 22:48:55.602117 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:55.602090 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pxg9c_daec4e02-5cf1-4ed7-b72b-30d06ab21d93/node-ca/0.log" Jul 08 22:48:56.631125 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:56.631098 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7hpx_6a74772e-bfa1-4ae9-badf-03c8c11428f2/serve-healthcheck-canary/0.log" Jul 08 22:48:56.955829 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:56.955804 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ph6m5_e360e629-882d-47b8-ac99-b8ac90087fac/kube-rbac-proxy/0.log" Jul 08 22:48:56.975067 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:56.975047 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ph6m5_e360e629-882d-47b8-ac99-b8ac90087fac/exporter/0.log" Jul 08 22:48:56.997540 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:56.997520 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ph6m5_e360e629-882d-47b8-ac99-b8ac90087fac/extractor/0.log" Jul 08 22:48:59.186605 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:48:59.186570 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mhm9_525dcfc5-9998-4b49-91bd-06c5eff7d742/konnectivity-agent/0.log" limit=1024 Jul 08 22:49:00.652838 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:00.652809 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-956sj/perf-node-gather-daemonset-6f7ls" Jul 08 22:49:02.386819 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.386737 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/kube-multus-additional-cni-plugins/0.log" Jul 08 22:49:02.406598 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.406569 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/egress-router-binary-copy/0.log" Jul 08 22:49:02.430786 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.430763 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/cni-plugins/0.log" Jul 08 22:49:02.450356 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.450336 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/bond-cni-plugin/0.log" Jul 08 22:49:02.472498 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.472475 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/routeoverride-cni/0.log" Jul 08 22:49:02.495557 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.495537 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/whereabouts-cni-bincopy/0.log" Jul 08 22:49:02.515282 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.515264 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v2pw_1426a6b8-f0f0-4459-93b4-c6092610cb05/whereabouts-cni/0.log" Jul 08 22:49:02.749476 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.749449 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jrj4k_06606831-048b-480b-be44-3d2b1f2c0bb6/kube-multus/0.log" Jul 08 22:49:02.871371 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.871343 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-flbdz_7cfead3c-7c2e-4ab2-b972-20b32f35bfc7/network-metrics-daemon/0.log" Jul 08 22:49:02.890441 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:02.890420 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-flbdz_7cfead3c-7c2e-4ab2-b972-20b32f35bfc7/kube-rbac-proxy/0.log" Jul 08 22:49:03.673357 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.673322 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/ovn-controller/0.log" Jul 08 22:49:03.688978 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.688952 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/ovn-acl-logging/0.log" Jul 08 22:49:03.710783 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.710718 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/kube-rbac-proxy-node/0.log" Jul 08 22:49:03.730489 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.730465 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 22:49:03.750691 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.750666 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/northd/0.log" Jul 08 22:49:03.769549 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.769526 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/nbdb/0.log" Jul 08 22:49:03.791218 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.791191 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/sbdb/0.log" Jul 08 22:49:03.839922 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:03.839900 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrds9_637817b3-ba19-4dc4-bd5d-8a1f4be5f068/ovnkube-controller/0.log" Jul 08 22:49:05.232100 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:05.232063 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-99q8d_79af2cbc-7770-467d-af80-93bde326be2b/network-check-target-container/0.log" Jul 08 22:49:06.149490 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:06.149456 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rqwsd_ff59e947-6f17-4a09-a949-1e36b3bfc2c3/iptables-alerter/0.log" Jul 08 22:49:06.760911 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:06.760883 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dtklw_2e751c03-ab8a-4fd0-8b85-af13ac1f21c2/tuned/0.log" Jul 08 22:49:09.585520 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:09.585488 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-758f599c5-tlz8r_ddbc3a7a-9082-4952-9cf5-046cf3cbe4f7/service-ca-controller/0.log" Jul 08 22:49:09.997021 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:09.996995 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lb458_353c70ec-e086-46d3-b0cd-63bb7d480fbf/csi-driver/0.log" Jul 08 22:49:10.019270 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:10.019237 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lb458_353c70ec-e086-46d3-b0cd-63bb7d480fbf/csi-node-driver-registrar/0.log" Jul 08 22:49:10.040302 ip-10-0-132-102 kubenswrapper[2583]: I0708 22:49:10.040278 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lb458_353c70ec-e086-46d3-b0cd-63bb7d480fbf/csi-liveness-probe/0.log"