Jul 01 19:22:27.248417 ip-10-0-142-179 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:22:27.683913 ip-10-0-142-179 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:27.683913 ip-10-0-142-179 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:22:27.683913 ip-10-0-142-179 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:27.683913 ip-10-0-142-179 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:22:27.683913 ip-10-0-142-179 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:27.684556 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.683924 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:22:27.690765 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690741 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:27.690765 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690762 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:27.690765 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690765 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:27.690765 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690768 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:27.690765 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690771 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:27.690765 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690774 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690779 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690784 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690787 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690791 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690794 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690796 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690800 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690804 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690807 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690810 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690812 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690815 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690817 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690823 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690826 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690829 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690831 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690834 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:27.690991 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690836 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690839 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690842 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690844 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690847 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690849 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690852 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690855 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690860 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690863 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690867 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690871 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690875 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690877 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690880 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690883 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690886 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690888 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690891 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:27.691457 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690894 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690896 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690899 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690901 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690904 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690908 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690910 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690914 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690917 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690919 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690921 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690924 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690926 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690929 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690932 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690934 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690936 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690939 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690941 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690944 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:27.691915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690946 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690949 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690951 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690954 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690956 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690959 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690961 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690965 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690968 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690970 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690974 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690978 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690980 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690983 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690985 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690988 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690990 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690993 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690995 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.690998 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:27.692399 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691002 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691005 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691007 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691010 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691014 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691018 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691020 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691023 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691026 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691028 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691031 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691033 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691036 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691038 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691041 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691044 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691754 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691760 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691763 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691766 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:27.692868 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691769 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691772 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691775 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691777 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691780 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691783 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691785 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691788 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691791 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691793 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691796 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691798 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691801 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691804 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691807 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691809 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691812 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691814 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691817 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691819 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:27.693351 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691822 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691824 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691826 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691829 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691831 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691834 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691837 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691839 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691842 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691845 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691847 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691850 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691853 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691855 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691858 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691860 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691863 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691865 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691868 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691870 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:27.693817 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691873 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691876 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691878 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691880 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691883 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691885 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691889 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691891 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691894 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691896 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691898 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691901 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691903 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691906 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691908 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691911 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691914 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691916 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691919 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691922 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:27.694307 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691924 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691927 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691930 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691932 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691935 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691938 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691942 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691946 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691950 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691955 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691959 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691962 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691965 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691967 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691970 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691972 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691975 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691977 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691980 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:27.694814 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691984 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691986 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691989 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691991 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691994 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691996 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.691999 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692001 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692004 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692007 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692009 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692012 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692017 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692021 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692024 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692027 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692423 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692429 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692432 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:27.695288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692435 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692438 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692440 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692443 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692446 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692448 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692451 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692453 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692456 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692459 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692461 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692463 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692466 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692473 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692476 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692478 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692481 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692483 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692486 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692488 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:27.695731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692491 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692495 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692498 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692501 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692504 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692508 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692510 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692513 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692515 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692517 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692521 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692523 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692526 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692528 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692531 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692533 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692536 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692538 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692540 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:27.696247 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692543 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692545 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692548 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692550 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692552 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692555 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692557 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692560 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692565 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692568 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692571 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692573 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692575 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692578 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692580 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692583 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692585 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692587 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692590 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:27.696689 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692593 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692596 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692598 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692601 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692603 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692606 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692608 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692612 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692617 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692620 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692623 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692625 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692628 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692630 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692633 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692635 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692638 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692640 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692643 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:27.697155 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692645 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692648 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692651 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692654 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692656 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692658 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692661 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692663 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692666 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692668 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692671 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692674 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692676 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692679 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692681 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692684 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692686 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692688 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.692691 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692772 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692792 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:22:27.697620 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692801 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692808 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692812 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692815 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692820 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692824 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692827 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692830 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692833 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692837 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692840 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692843 2574 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692846 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692851 2574 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692855 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692858 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692862 2574 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692865 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692868 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692871 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692875 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692878 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692881 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:22:27.698142 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692884 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692888 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692891 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692894 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692897 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692900 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692903 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692907 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692910 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692913 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692916 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692918 2574 flags.go:64] FLAG: --enable-server="true" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692921 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692926 2574 flags.go:64] FLAG: --event-burst="100" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692929 2574 flags.go:64] FLAG: --event-qps="50" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692932 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692934 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692937 2574 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692941 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692944 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692946 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692949 2574 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692953 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692956 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692960 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:22:27.698682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692963 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692965 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692968 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692973 2574 flags.go:64] FLAG: --feature-gates="" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692977 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692980 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692983 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692986 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692989 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692992 2574 flags.go:64] FLAG: --help="false" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692994 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-179.ec2.internal" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.692998 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693001 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693003 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693007 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693010 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693013 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693016 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693019 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693022 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693025 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693032 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693035 2574 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693037 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:22:27.699308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693040 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693043 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693046 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693049 2574 flags.go:64] FLAG: --lock-file="" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693051 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693055 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693058 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693064 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693068 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693070 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693073 2574 flags.go:64] FLAG: --logging-format="text" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693077 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693081 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693083 2574 flags.go:64] FLAG: --manifest-url="" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693086 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693090 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693093 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693097 2574 flags.go:64] FLAG: --max-pods="110" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693100 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693117 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693122 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693125 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693128 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693132 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693135 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:22:27.699885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693143 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693146 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693149 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693152 2574 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693155 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693160 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693163 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693166 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693169 2574 flags.go:64] FLAG: --port="10250" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693172 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693175 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078fdb94f46267a60" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693178 2574 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693182 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693185 2574 flags.go:64] FLAG: --register-node="true" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693188 2574 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693195 2574 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693198 2574 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693201 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693204 2574 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693209 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693212 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693215 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693218 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693221 2574 flags.go:64] FLAG: --runonce="false" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693224 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:22:27.700477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693227 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693230 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693233 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693235 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693239 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693242 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693245 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693248 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693251 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693253 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693256 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693259 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693262 2574 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693265 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693270 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693273 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693275 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693279 2574 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693282 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693286 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693289 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693292 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693295 2574 flags.go:64] FLAG: --v="2" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693298 2574 flags.go:64] FLAG: --version="false" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693303 2574 flags.go:64] FLAG: --vmodule="" Jul 01 19:22:27.701164 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693307 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.693312 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693425 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693429 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693432 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693434 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693438 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693440 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693443 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693445 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693448 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693451 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693454 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693456 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693459 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693461 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693464 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693466 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693469 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693471 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:27.701839 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693474 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693477 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693479 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693482 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693484 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693487 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693492 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693496 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693498 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693501 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693504 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693507 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693511 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693515 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693518 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693521 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693523 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693527 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693531 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:27.702483 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693534 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693536 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693539 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693541 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693544 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693546 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693549 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693551 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693554 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693556 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693559 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693561 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693563 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693566 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693569 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693571 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693574 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693576 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693578 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693582 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:27.703004 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693584 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693587 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693589 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693592 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693595 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693598 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693603 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693606 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693609 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693612 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693615 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693617 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693620 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693622 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693625 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693627 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693630 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693632 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693635 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:27.703563 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693637 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693640 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693642 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693645 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693647 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693650 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693652 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693655 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693657 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693659 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693662 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693664 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693668 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693671 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693673 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693675 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693678 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693681 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693683 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693688 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:27.704069 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693691 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:27.704637 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693693 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:27.704637 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.693696 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:27.704637 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.695301 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:27.704637 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.703907 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:22:27.704637 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.703924 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:22:27.704795 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.704765 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:22:27.704795 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.704777 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:22:27.704860 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704854 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:27.704860 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704860 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704863 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704867 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704870 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704873 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704877 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704879 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704883 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704885 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704888 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704891 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704894 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704897 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704899 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704902 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704904 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704907 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704909 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704912 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:27.704915 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704916 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704920 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704924 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704927 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704953 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704957 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704960 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704962 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704965 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704967 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704970 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704972 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704975 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704977 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704980 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704983 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704985 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704987 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704990 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704992 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:27.705435 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704995 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.704997 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705000 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705002 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705005 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705008 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705011 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705014 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705016 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705019 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705021 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705024 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705026 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705029 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705032 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705035 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705037 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705045 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705048 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705050 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:27.705929 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705053 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705055 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705058 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705060 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705063 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705065 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705068 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705070 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705073 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705076 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705078 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705081 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705083 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705086 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705088 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705091 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705093 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705096 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705098 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705101 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:27.706431 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705114 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705117 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705120 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705123 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705126 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705129 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705132 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705135 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705138 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705142 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705151 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705155 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705158 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705160 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705163 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705166 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705168 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705171 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:27.706920 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705173 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.705178 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705343 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705348 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705351 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705353 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705356 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705359 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705368 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705370 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705373 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705375 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705378 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705381 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705383 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:27.707359 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705386 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705388 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705390 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705393 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705396 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705399 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705401 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705404 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705406 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705409 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705417 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705420 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705422 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705425 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705427 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705430 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705432 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705435 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705437 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705440 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:27.707731 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705443 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705445 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705448 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705450 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705453 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705455 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705458 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705460 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705463 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705465 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705469 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705472 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705475 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705477 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705480 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705482 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705485 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705488 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705490 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705493 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:27.708234 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705495 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705498 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705500 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705509 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705511 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705514 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705516 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705519 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705521 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705523 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705526 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705528 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705531 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705533 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705536 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705538 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705541 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705543 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705546 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:27.708703 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705550 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705553 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705556 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705559 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705561 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705564 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705567 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705569 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705572 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705575 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705578 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705580 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705583 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705585 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705588 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705590 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705593 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705601 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705604 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:27.709163 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705606 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705610 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705613 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705616 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705619 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705622 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705624 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:27.705627 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.705631 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.705737 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:22:27.709622 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.707888 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:22:27.709884 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.709870 2574 server.go:1019] "Starting client certificate rotation" Jul 01 19:22:27.709999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.709983 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:27.710035 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.710026 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:27.712536 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.712521 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:27.716564 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.716542 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:27.728556 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.728533 2574 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:22:27.730511 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.730496 2574 log.go:25] "Validated CRI v1 image API" Jul 01 19:22:27.731251 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.731236 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:22:27.734659 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.734639 2574 fs.go:135] Filesystem UUIDs: map[2b1c3d98-c474-4b53-afdd-f65293d57fe7:/dev/nvme0n1p4 4d2928fc-1436-44b1-94b2-de80ccaa5455:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 01 19:22:27.734704 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.734660 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:22:27.740023 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.739917 2574 manager.go:216] Machine: {Timestamp:2026-07-01 19:22:27.738334524 +0000 UTC m=+0.356214278 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104595 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c9628ce55e2e66733b16e12d84e53 SystemUUID:ec2c9628-ce55-e2e6-6733-b16e12d84e53 BootID:768257d9-be26-4bc2-add1-db55d093ffa2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:92:26:e5:71:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:92:26:e5:71:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:93:3d:7c:4f:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:22:27.740023 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.740019 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:22:27.740158 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.740146 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:22:27.740743 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.740729 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:27.743853 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.743827 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:22:27.743995 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.743858 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-179.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:22:27.744672 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.744662 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:22:27.744706 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.744675 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:22:27.744706 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.744682 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:27.745559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.745548 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:27.746433 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.746422 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:22:27.749445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749434 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:27.749559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749550 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:22:27.749593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749578 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:22:27.749593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749589 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:22:27.749646 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749602 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:22:27.749646 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749612 2574 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:22:27.749646 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.749621 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:22:27.750053 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.750014 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:27.750053 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.750036 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:27.752189 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.752175 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:22:27.753590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.753578 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:22:27.753626 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.753607 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:22:27.754559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754549 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:22:27.754593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754566 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:22:27.754593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754572 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:22:27.754593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754578 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:22:27.754593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754587 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:22:27.754593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754592 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:22:27.754728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754601 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:22:27.754728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754606 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:22:27.754728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754612 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:22:27.754728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754617 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:22:27.754728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754630 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:22:27.754728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.754636 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:22:27.756373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.756363 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:22:27.756407 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.756374 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:22:27.759393 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.759380 2574 server.go:1268] "Started kubelet" Jul 01 19:22:27.759540 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.759511 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:22:27.759698 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.759637 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:22:27.759893 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.759879 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:22:27.760322 ip-10-0-142-179 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:22:27.763876 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.763847 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:22:27.764296 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.764273 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-179.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:22:27.764374 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.764276 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:22:27.764481 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.764456 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:22:27.765223 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.765204 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:22:27.766063 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.766039 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:22:27.770894 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.770877 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vw8jw" Jul 01 19:22:27.771206 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.770259 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-179.ec2.internal.18be40cc1540acb0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-179.ec2.internal,UID:ip-10-0-142-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-179.ec2.internal,},FirstTimestamp:2026-07-01 19:22:27.7593612 +0000 UTC m=+0.377240942,LastTimestamp:2026-07-01 19:22:27.7593612 +0000 UTC m=+0.377240942,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-179.ec2.internal,}" Jul 01 19:22:27.773565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.773549 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:27.773664 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.773548 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:22:27.773725 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.773686 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:27.774338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774311 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:22:27.774338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774340 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:22:27.774470 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774432 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:22:27.774470 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774446 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:22:27.774470 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774432 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:22:27.774896 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774865 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:22:27.774896 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774886 2574 factory.go:55] Registering systemd factory Jul 01 19:22:27.774896 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.774897 2574 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:22:27.775141 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.775125 2574 factory.go:153] Registering CRI-O factory Jul 01 19:22:27.775201 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.775146 2574 factory.go:223] Registration of the crio container factory successfully Jul 01 19:22:27.775201 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.775170 2574 factory.go:103] Registering Raw factory Jul 01 19:22:27.775201 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.775187 2574 manager.go:1196] Started watching for new ooms in manager Jul 01 19:22:27.775590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.775573 2574 manager.go:349] Starting recovery of all containers Jul 01 19:22:27.777680 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.777661 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vw8jw" Jul 01 19:22:27.778944 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.778898 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:22:27.779055 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.779032 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:22:27.786153 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.786136 2574 manager.go:354] Recovery completed Jul 01 19:22:27.790588 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.790573 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.792312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792296 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.792390 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792324 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.792390 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792337 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.792854 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792840 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:22:27.792854 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792851 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.792946 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792851 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:22:27.792946 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.792929 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:27.793491 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.793475 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.793546 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.793496 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.793546 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.793509 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.794078 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.794065 2574 policy_none.go:49] "None policy: Start" Jul 01 19:22:27.794132 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.794083 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:22:27.794132 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.794094 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:22:27.795331 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.795316 2574 policy_none.go:47] "Start" Jul 01 19:22:27.832726 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.832709 2574 manager.go:337] "Starting Device Plugin manager" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.832741 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.832751 2574 server.go:87] "Starting device plugin registration server" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.833024 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.833035 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.833148 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.833238 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.833248 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.833780 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.833834 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.841016 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.842306 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.842338 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.842360 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.842398 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:22:27.847350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.844420 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:27.933316 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.933269 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.934342 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.934283 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.934342 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.934317 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.934342 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.934331 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.934531 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.934364 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-179.ec2.internal" Jul 01 19:22:27.941700 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.941684 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-179.ec2.internal" Jul 01 19:22:27.941791 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.941709 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-179.ec2.internal\": node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:27.942831 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.942813 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal"] Jul 01 19:22:27.942882 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.942870 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.943673 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.943657 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.943753 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.943688 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.943753 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.943703 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.944849 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.944835 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.944955 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.944941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:27.945002 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.944970 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.945516 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.945494 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.945600 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.945523 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.945600 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.945533 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.946047 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.946023 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.946178 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.946051 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.946178 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.946062 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.947183 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.947169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:27.947240 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.947195 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:27.947807 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.947793 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:27.947906 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.947817 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:27.947906 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:27.947827 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:27.966290 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.966274 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:27.978695 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.978672 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-179.ec2.internal\" not found" node="ip-10-0-142-179.ec2.internal" Jul 01 19:22:27.981962 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:27.981947 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-179.ec2.internal\" not found" node="ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.066965 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.066935 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:28.076396 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.076374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d699610293e38abe1e8442cf82b3271a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal\" (UID: \"d699610293e38abe1e8442cf82b3271a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.076453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.076402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1791cf5791cda6f6876965b4b0ae27a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-179.ec2.internal\" (UID: \"d1791cf5791cda6f6876965b4b0ae27a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.076453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.076420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d699610293e38abe1e8442cf82b3271a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal\" (UID: \"d699610293e38abe1e8442cf82b3271a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.167363 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.167325 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:28.177339 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.177316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1791cf5791cda6f6876965b4b0ae27a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-179.ec2.internal\" (UID: \"d1791cf5791cda6f6876965b4b0ae27a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.177391 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.177344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d699610293e38abe1e8442cf82b3271a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal\" (UID: \"d699610293e38abe1e8442cf82b3271a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.177391 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.177359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d699610293e38abe1e8442cf82b3271a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal\" (UID: \"d699610293e38abe1e8442cf82b3271a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.177450 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.177408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d699610293e38abe1e8442cf82b3271a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal\" (UID: \"d699610293e38abe1e8442cf82b3271a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.177450 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.177416 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1791cf5791cda6f6876965b4b0ae27a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-179.ec2.internal\" (UID: \"d1791cf5791cda6f6876965b4b0ae27a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.177512 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.177444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d699610293e38abe1e8442cf82b3271a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal\" (UID: \"d699610293e38abe1e8442cf82b3271a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.267774 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.267709 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:28.282206 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.282189 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.286424 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.286406 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.368263 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.368233 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:28.468795 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.468767 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:28.569386 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.569326 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-179.ec2.internal\" not found" Jul 01 19:22:28.594525 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.594505 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:28.674572 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.674550 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.694964 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.694942 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:28.697915 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.697901 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.709031 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.709015 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:22:28.709156 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.709137 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:22:28.709221 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.709156 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:22:28.709221 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.709185 2574 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a422f225eeffc421c93fcb6c45c96d86-6f779365d5f73f70.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.142.179:47060->54.204.252.27:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" Jul 01 19:22:28.750336 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.750313 2574 apiserver.go:52] "Watching apiserver" Jul 01 19:22:28.773876 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.773853 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:28.777378 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.777361 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:22:28.777698 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.777677 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lf668","kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal","openshift-image-registry/node-ca-4ct8l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal","openshift-multus/multus-additional-cni-plugins-lrlg9","openshift-multus/multus-gndwh","openshift-multus/network-metrics-daemon-vw95m","openshift-network-diagnostics/network-check-target-kccvx","kube-system/global-pull-secret-syncer-7jmz8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5","openshift-cluster-node-tuning-operator/tuned-qswl8","openshift-dns/node-resolver-lsh9h","openshift-network-operator/iptables-alerter-2pph8","openshift-ovn-kubernetes/ovnkube-node-tq5ps"] Jul 01 19:22:28.779006 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.778990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:28.779097 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.779074 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:28.780291 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.780274 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.782461 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.782435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.782811 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.782757 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:17:29 +0000 UTC" deadline="2027-12-18 17:45:07.919811324 +0000 UTC" Jul 01 19:22:28.782893 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.782814 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12838h22m39.137002359s" Jul 01 19:22:28.783542 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.783523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.784257 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.784236 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.784257 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.784253 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.784654 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.784635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.784752 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.784709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:22:28.785166 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.785151 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqchf\"" Jul 01 19:22:28.785240 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.785167 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.785410 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.785395 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.785811 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.785795 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.786939 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.786920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.788374 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.788359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.788464 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.788424 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:28.789699 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.789677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:28.789790 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.789768 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:28.790645 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.790630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.792012 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.791997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.793148 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.793027 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:22:28.793232 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.793175 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g9s5d\"" Jul 01 19:22:28.793293 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.793251 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.793563 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.793544 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.794437 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794062 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:22:28.794437 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794186 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:22:28.794437 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794242 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.794437 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794310 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.794437 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794430 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.794761 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794533 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:22:28.794761 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794613 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.794840 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794762 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qsng4\"" Jul 01 19:22:28.794891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794861 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:22:28.794938 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.794919 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7sgsx\"" Jul 01 19:22:28.795038 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.795022 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h92cw\"" Jul 01 19:22:28.795095 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.795074 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.795155 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.795102 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:22:28.795425 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.795408 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bs7rx\"" Jul 01 19:22:28.795837 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.795810 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:22:28.796016 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.796004 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.796168 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.796150 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.796218 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.796180 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7qcw\"" Jul 01 19:22:28.800368 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800294 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:22:28.800482 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800415 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:22:28.800613 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800592 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:22:28.800777 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fppgt\"" Jul 01 19:22:28.800913 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800798 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:22:28.800913 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800828 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:22:28.801034 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:22:28.801034 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.800984 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p9ptj\"" Jul 01 19:22:28.801212 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.801203 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:22:28.806340 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.806317 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:28.843172 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.843149 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwg2r" Jul 01 19:22:28.857423 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.857403 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwg2r" Jul 01 19:22:28.875739 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.875719 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:22:28.881175 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.881257 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-device-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.881257 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-kubelet\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.881351 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-kubelet\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881351 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-systemd\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881425 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-lib-modules\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.881425 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-system-cni-dir\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.881425 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-socket-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.881565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-conf-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.881565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-var-lib-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-etc-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881677 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-ovn\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881677 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-node-log\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881677 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxjq\" (UniqueName: \"kubernetes.io/projected/d2bdb3ee-759f-4652-b6d0-c892342e63ef-kube-api-access-wtxjq\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.881677 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-tmp-dir\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.881677 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-registration-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-cni-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-cni-netd\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-kubernetes\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-os-release\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8ls\" (UniqueName: \"kubernetes.io/projected/50ffddd0-9177-4d4a-9610-20ba3522aeb6-kube-api-access-8k8ls\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-run-ovn-kubernetes\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cba2ff8b-bb92-46a6-a975-764a176db0e6-iptables-alerter-script\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.881878 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysconfig\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-sys\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-socket-dir-parent\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50ffddd0-9177-4d4a-9610-20ba3522aeb6-host\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-ovnkube-config\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.881990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b1e295d-c532-4450-80d7-f9fa421f9d1d-dbus\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcbpw\" (UniqueName: \"kubernetes.io/projected/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-kube-api-access-zcbpw\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-system-cni-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734bc79a-4428-43af-ba2a-b6a253df6452-cni-binary-copy\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-netns\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-cni-multus\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882173 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5km4c\" (UniqueName: \"kubernetes.io/projected/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-kube-api-access-5km4c\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/734bc79a-4428-43af-ba2a-b6a253df6452-multus-daemon-config\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-sys-fs\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-cni-bin\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882299 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50ffddd0-9177-4d4a-9610-20ba3522aeb6-serviceca\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-slash\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/523dbf55-bc15-4739-818a-2885a2013a47-ovn-node-metrics-cert\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9-agent-certs\") pod \"konnectivity-agent-lf668\" (UID: \"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9\") " pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-modprobe-d\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7spf\" (UniqueName: \"kubernetes.io/projected/523dbf55-bc15-4739-818a-2885a2013a47-kube-api-access-n7spf\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9-konnectivity-ca\") pod \"konnectivity-agent-lf668\" (UID: \"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9\") " pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dkkm\" (UniqueName: \"kubernetes.io/projected/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-kube-api-access-4dkkm\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-hostroot\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-systemd-units\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-env-overrides\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz4xv\" (UniqueName: \"kubernetes.io/projected/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-kube-api-access-wz4xv\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-cnibin\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-os-release\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fw7d\" (UniqueName: \"kubernetes.io/projected/734bc79a-4428-43af-ba2a-b6a253df6452-kube-api-access-8fw7d\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.882952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-hosts-file\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-585pp\" (UniqueName: \"kubernetes.io/projected/cba2ff8b-bb92-46a6-a975-764a176db0e6-kube-api-access-585pp\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-systemd\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-host\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-run-netns\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-k8s-cni-cncf-io\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-cni-bin\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-ovnkube-script-lib\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cba2ff8b-bb92-46a6-a975-764a176db0e6-host-slash\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cnibin\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-multus-certs\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-etc-kubernetes\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.882976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-log-socket\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-run\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysctl-d\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysctl-conf\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b1e295d-c532-4450-80d7-f9fa421f9d1d-kubelet-config\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2bdb3ee-759f-4652-b6d0-c892342e63ef-tmp\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-var-lib-kubelet\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.883999 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.883284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-tuned\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.889294 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:28.889270 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1791cf5791cda6f6876965b4b0ae27a.slice/crio-549bcb8342b4954b9710878adbb81914bf37a0c568bab90139e40a3e704af8ab WatchSource:0}: Error finding container 549bcb8342b4954b9710878adbb81914bf37a0c568bab90139e40a3e704af8ab: Status 404 returned error can't find the container with id 549bcb8342b4954b9710878adbb81914bf37a0c568bab90139e40a3e704af8ab Jul 01 19:22:28.889495 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:28.889471 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd699610293e38abe1e8442cf82b3271a.slice/crio-1cb0b36c5ff80124ad4a47e7a9d8f5979db3b266e5b0d025dcc7ce6d3ac0ebed WatchSource:0}: Error finding container 1cb0b36c5ff80124ad4a47e7a9d8f5979db3b266e5b0d025dcc7ce6d3ac0ebed: Status 404 returned error can't find the container with id 1cb0b36c5ff80124ad4a47e7a9d8f5979db3b266e5b0d025dcc7ce6d3ac0ebed Jul 01 19:22:28.893435 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.893422 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:22:28.983811 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-tuned\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.983934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.983934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-device-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.983934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-kubelet\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.983934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-kubelet\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.983934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-systemd\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-device-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-lib-modules\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983977 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-kubelet\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.983988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-system-cni-dir\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984014 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-systemd\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-socket-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-kubelet\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-lib-modules\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-system-cni-dir\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-conf-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.984196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-var-lib-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.984657 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984362 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-conf-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.984657 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984415 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-socket-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.984657 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-var-lib-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.984657 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984646 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:22:28.984884 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.984860 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-etc-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-ovn\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-node-log\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxjq\" (UniqueName: \"kubernetes.io/projected/d2bdb3ee-759f-4652-b6d0-c892342e63ef-kube-api-access-wtxjq\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-tmp-dir\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-registration-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-cni-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-cni-netd\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-kubernetes\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-os-release\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8ls\" (UniqueName: \"kubernetes.io/projected/50ffddd0-9177-4d4a-9610-20ba3522aeb6-kube-api-access-8k8ls\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-run-ovn-kubernetes\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cba2ff8b-bb92-46a6-a975-764a176db0e6-iptables-alerter-script\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysconfig\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-sys\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.989284 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-socket-dir-parent\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50ffddd0-9177-4d4a-9610-20ba3522aeb6-host\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-ovnkube-config\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b1e295d-c532-4450-80d7-f9fa421f9d1d-dbus\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcbpw\" (UniqueName: \"kubernetes.io/projected/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-kube-api-access-zcbpw\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-system-cni-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734bc79a-4428-43af-ba2a-b6a253df6452-cni-binary-copy\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-netns\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-cni-multus\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5km4c\" (UniqueName: \"kubernetes.io/projected/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-kube-api-access-5km4c\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/734bc79a-4428-43af-ba2a-b6a253df6452-multus-daemon-config\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-sys-fs\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-cni-bin\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.985977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50ffddd0-9177-4d4a-9610-20ba3522aeb6-serviceca\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-slash\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/523dbf55-bc15-4739-818a-2885a2013a47-ovn-node-metrics-cert\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9-agent-certs\") pod \"konnectivity-agent-lf668\" (UID: \"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9\") " pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-modprobe-d\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7spf\" (UniqueName: \"kubernetes.io/projected/523dbf55-bc15-4739-818a-2885a2013a47-kube-api-access-n7spf\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9-konnectivity-ca\") pod \"konnectivity-agent-lf668\" (UID: \"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9\") " pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dkkm\" (UniqueName: \"kubernetes.io/projected/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-kube-api-access-4dkkm\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-hostroot\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-systemd-units\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-env-overrides\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz4xv\" (UniqueName: \"kubernetes.io/projected/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-kube-api-access-wz4xv\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-cnibin\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-os-release\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fw7d\" (UniqueName: \"kubernetes.io/projected/734bc79a-4428-43af-ba2a-b6a253df6452-kube-api-access-8fw7d\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-hosts-file\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585pp\" (UniqueName: \"kubernetes.io/projected/cba2ff8b-bb92-46a6-a975-764a176db0e6-kube-api-access-585pp\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-systemd\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.990888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-host\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-run-netns\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-k8s-cni-cncf-io\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-etc-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-run-ovn-kubernetes\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-cni-bin\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-os-release\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-ovnkube-script-lib\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986842 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysconfig\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cba2ff8b-bb92-46a6-a975-764a176db0e6-host-slash\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-registration-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cba2ff8b-bb92-46a6-a975-764a176db0e6-host-slash\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-cni-netd\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.986982 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-cni-multus\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987065 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-sys\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987135 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-kubernetes\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987202 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-node-log\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-cni-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cnibin\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-multus-certs\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b1e295d-c532-4450-80d7-f9fa421f9d1d-dbus\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-etc-kubernetes\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-system-cni-dir\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987389 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-cnibin\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-log-socket\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-log-socket\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-var-lib-cni-bin\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-run\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-ovnkube-config\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.991947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-slash\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-multus-socket-dir-parent\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987607 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-openvswitch\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987611 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-os-release\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987626 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-multus-certs\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734bc79a-4428-43af-ba2a-b6a253df6452-cni-binary-copy\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987689 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-hosts-file\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-host\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987747 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-netns\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-systemd-units\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987748 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-systemd\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987763 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-run\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-cni-bin\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.987828 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.987898 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:29.487877587 +0000 UTC m=+2.105757351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50ffddd0-9177-4d4a-9610-20ba3522aeb6-serviceca\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-hostroot\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.992477 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.987992 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-sys-fs\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-run-netns\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988285 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-run-ovn\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysctl-d\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysctl-conf\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b1e295d-c532-4450-80d7-f9fa421f9d1d-kubelet-config\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2bdb3ee-759f-4652-b6d0-c892342e63ef-tmp\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-var-lib-kubelet\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988477 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9-konnectivity-ca\") pod \"konnectivity-agent-lf668\" (UID: \"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9\") " pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-tmp-dir\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-var-lib-kubelet\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cnibin\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50ffddd0-9177-4d4a-9610-20ba3522aeb6-host\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-ovnkube-script-lib\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/734bc79a-4428-43af-ba2a-b6a253df6452-multus-daemon-config\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.993017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.988932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/523dbf55-bc15-4739-818a-2885a2013a47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysctl-conf\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-host-run-k8s-cni-cncf-io\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cba2ff8b-bb92-46a6-a975-764a176db0e6-iptables-alerter-script\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b1e295d-c532-4450-80d7-f9fa421f9d1d-kubelet-config\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/734bc79a-4428-43af-ba2a-b6a253df6452-etc-kubernetes\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-modprobe-d\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.989217 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:28.989276 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:29.489260743 +0000 UTC m=+2.107140487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/523dbf55-bc15-4739-818a-2885a2013a47-env-overrides\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.989683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-sysctl-d\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.990166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2bdb3ee-759f-4652-b6d0-c892342e63ef-etc-tuned\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.991336 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/523dbf55-bc15-4739-818a-2885a2013a47-ovn-node-metrics-cert\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.991413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2bdb3ee-759f-4652-b6d0-c892342e63ef-tmp\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:28.993483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.991447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9-agent-certs\") pod \"konnectivity-agent-lf668\" (UID: \"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9\") " pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:28.997170 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:28.997151 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:29.005044 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.005019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5km4c\" (UniqueName: \"kubernetes.io/projected/22c2f7d4-97a4-46b0-92ac-21d7adcd462d-kube-api-access-5km4c\") pod \"aws-ebs-csi-driver-node-xg8c5\" (UID: \"22c2f7d4-97a4-46b0-92ac-21d7adcd462d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:29.005148 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.005040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7spf\" (UniqueName: \"kubernetes.io/projected/523dbf55-bc15-4739-818a-2885a2013a47-kube-api-access-n7spf\") pod \"ovnkube-node-tq5ps\" (UID: \"523dbf55-bc15-4739-818a-2885a2013a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:29.005459 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.005434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fw7d\" (UniqueName: \"kubernetes.io/projected/734bc79a-4428-43af-ba2a-b6a253df6452-kube-api-access-8fw7d\") pod \"multus-gndwh\" (UID: \"734bc79a-4428-43af-ba2a-b6a253df6452\") " pod="openshift-multus/multus-gndwh" Jul 01 19:22:29.005550 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.005526 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dkkm\" (UniqueName: \"kubernetes.io/projected/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-kube-api-access-4dkkm\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:29.005911 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.005875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz4xv\" (UniqueName: \"kubernetes.io/projected/3dd10c94-b03f-4ae1-b010-9489c4acf7ac-kube-api-access-wz4xv\") pod \"multus-additional-cni-plugins-lrlg9\" (UID: \"3dd10c94-b03f-4ae1-b010-9489c4acf7ac\") " pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:29.006669 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:29.006648 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:29.006737 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:29.006674 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:29.006737 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:29.006690 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:29.006817 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:29.006769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:29.506752608 +0000 UTC m=+2.124632355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:29.007244 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.007214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcbpw\" (UniqueName: \"kubernetes.io/projected/e9f1ad24-c80d-4870-9f0c-b63a5468b3fb-kube-api-access-zcbpw\") pod \"node-resolver-lsh9h\" (UID: \"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb\") " pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:29.007331 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.007315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-585pp\" (UniqueName: \"kubernetes.io/projected/cba2ff8b-bb92-46a6-a975-764a176db0e6-kube-api-access-585pp\") pod \"iptables-alerter-2pph8\" (UID: \"cba2ff8b-bb92-46a6-a975-764a176db0e6\") " pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:29.007891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.007876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8ls\" (UniqueName: \"kubernetes.io/projected/50ffddd0-9177-4d4a-9610-20ba3522aeb6-kube-api-access-8k8ls\") pod \"node-ca-4ct8l\" (UID: \"50ffddd0-9177-4d4a-9610-20ba3522aeb6\") " pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:29.008975 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.008957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxjq\" (UniqueName: \"kubernetes.io/projected/d2bdb3ee-759f-4652-b6d0-c892342e63ef-kube-api-access-wtxjq\") pod \"tuned-qswl8\" (UID: \"d2bdb3ee-759f-4652-b6d0-c892342e63ef\") " pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:29.101085 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.101018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2pph8" Jul 01 19:22:29.109145 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.109121 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba2ff8b_bb92_46a6_a975_764a176db0e6.slice/crio-8e3438f41eb40a413f2591b11452c5a12ac83b7c77c3d87806daa7021f32c2e5 WatchSource:0}: Error finding container 8e3438f41eb40a413f2591b11452c5a12ac83b7c77c3d87806daa7021f32c2e5: Status 404 returned error can't find the container with id 8e3438f41eb40a413f2591b11452c5a12ac83b7c77c3d87806daa7021f32c2e5 Jul 01 19:22:29.129258 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.129232 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:29.135930 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.135905 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523dbf55_bc15_4739_818a_2885a2013a47.slice/crio-20df60deaa2d396348a95d987ef894a5325076a7086d2753b682549b13781e68 WatchSource:0}: Error finding container 20df60deaa2d396348a95d987ef894a5325076a7086d2753b682549b13781e68: Status 404 returned error can't find the container with id 20df60deaa2d396348a95d987ef894a5325076a7086d2753b682549b13781e68 Jul 01 19:22:29.138927 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.138818 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsh9h" Jul 01 19:22:29.146522 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.146495 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f1ad24_c80d_4870_9f0c_b63a5468b3fb.slice/crio-8e5c7f98af482770a592fea9d29fcad36dc3a0a4f36b43c2694d5f22782e926b WatchSource:0}: Error finding container 8e5c7f98af482770a592fea9d29fcad36dc3a0a4f36b43c2694d5f22782e926b: Status 404 returned error can't find the container with id 8e5c7f98af482770a592fea9d29fcad36dc3a0a4f36b43c2694d5f22782e926b Jul 01 19:22:29.153385 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.153365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:29.159635 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.159615 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d869fa1_fbe0_4a3e_847d_f6b3fbead7b9.slice/crio-5da5fae5b412caf7801da626f521ad134c93be947aaf1173eeee49a1d4c3e92b WatchSource:0}: Error finding container 5da5fae5b412caf7801da626f521ad134c93be947aaf1173eeee49a1d4c3e92b: Status 404 returned error can't find the container with id 5da5fae5b412caf7801da626f521ad134c93be947aaf1173eeee49a1d4c3e92b Jul 01 19:22:29.174439 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.174421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" Jul 01 19:22:29.181582 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.181564 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd10c94_b03f_4ae1_b010_9489c4acf7ac.slice/crio-9a227ca3248089ceb23301f89d7acaf3d7136bd75712fc3e9b958bdde76d7f1c WatchSource:0}: Error finding container 9a227ca3248089ceb23301f89d7acaf3d7136bd75712fc3e9b958bdde76d7f1c: Status 404 returned error can't find the container with id 9a227ca3248089ceb23301f89d7acaf3d7136bd75712fc3e9b958bdde76d7f1c Jul 01 19:22:29.201005 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.200980 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qswl8" Jul 01 19:22:29.205969 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.205952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" Jul 01 19:22:29.207902 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.207880 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bdb3ee_759f_4652_b6d0_c892342e63ef.slice/crio-28b1106693eb362dbce4052ef5e1c0aa42cf3f3958fbea4336a62473e8322283 WatchSource:0}: Error finding container 28b1106693eb362dbce4052ef5e1c0aa42cf3f3958fbea4336a62473e8322283: Status 404 returned error can't find the container with id 28b1106693eb362dbce4052ef5e1c0aa42cf3f3958fbea4336a62473e8322283 Jul 01 19:22:29.211748 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.211733 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gndwh" Jul 01 19:22:29.212762 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:29.212744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ct8l" Jul 01 19:22:29.213159 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.213132 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c2f7d4_97a4_46b0_92ac_21d7adcd462d.slice/crio-15dcb89123491e68796e53123a3d41df717af2c9b8b8e917aea1dec86de122bd WatchSource:0}: Error finding container 15dcb89123491e68796e53123a3d41df717af2c9b8b8e917aea1dec86de122bd: Status 404 returned error can't find the container with id 15dcb89123491e68796e53123a3d41df717af2c9b8b8e917aea1dec86de122bd Jul 01 19:22:29.219288 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.219263 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734bc79a_4428_43af_ba2a_b6a253df6452.slice/crio-417ca19d649396f16021d8616aa9324d732e2952d8c6b5bab5005b1ad37781bc WatchSource:0}: Error finding container 417ca19d649396f16021d8616aa9324d732e2952d8c6b5bab5005b1ad37781bc: Status 404 returned error can't find the container with id 417ca19d649396f16021d8616aa9324d732e2952d8c6b5bab5005b1ad37781bc Jul 01 19:22:29.221231 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:22:29.221209 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ffddd0_9177_4d4a_9610_20ba3522aeb6.slice/crio-4486894782be1c15d13cef3a2042e4808c8d07ae3c890f235f4274bb8bbd4e8a WatchSource:0}: Error finding container 4486894782be1c15d13cef3a2042e4808c8d07ae3c890f235f4274bb8bbd4e8a: Status 404 returned error can't find the container with id 4486894782be1c15d13cef3a2042e4808c8d07ae3c890f235f4274bb8bbd4e8a Jul 01 19:22:31.305839 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.305815 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:31.454816 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.454729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:31.454970 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.454853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:31.454970 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.454895 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:31.454970 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.454971 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:32.454950589 +0000 UTC m=+3.109797595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:31.455128 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.454969 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:31.455128 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.455011 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:32.45500018 +0000 UTC m=+3.109847174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:31.522650 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.522617 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:31.556045 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.556012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:31.556232 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.556173 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:31.556232 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.556188 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:31.556232 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.556197 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:31.556414 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.556249 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:32.556232598 +0000 UTC m=+3.211079597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:31.808728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.808583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:31.809466 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:31.808722 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:31.822016 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.821929 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:30 +0000 UTC" deadline="2028-02-27 07:45:45.054634293 +0000 UTC" Jul 01 19:22:31.822016 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.821962 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14532h23m13.232676305s" Jul 01 19:22:31.828958 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.828873 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2pph8" event={"ID":"cba2ff8b-bb92-46a6-a975-764a176db0e6","Type":"ContainerStarted","Data":"8e3438f41eb40a413f2591b11452c5a12ac83b7c77c3d87806daa7021f32c2e5"} Jul 01 19:22:31.835315 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.835290 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" event={"ID":"d1791cf5791cda6f6876965b4b0ae27a","Type":"ContainerStarted","Data":"549bcb8342b4954b9710878adbb81914bf37a0c568bab90139e40a3e704af8ab"} Jul 01 19:22:31.837881 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.837850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" event={"ID":"d699610293e38abe1e8442cf82b3271a","Type":"ContainerStarted","Data":"1cb0b36c5ff80124ad4a47e7a9d8f5979db3b266e5b0d025dcc7ce6d3ac0ebed"} Jul 01 19:22:31.843323 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.843296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ct8l" event={"ID":"50ffddd0-9177-4d4a-9610-20ba3522aeb6","Type":"ContainerStarted","Data":"4486894782be1c15d13cef3a2042e4808c8d07ae3c890f235f4274bb8bbd4e8a"} Jul 01 19:22:31.849211 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.849186 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gndwh" event={"ID":"734bc79a-4428-43af-ba2a-b6a253df6452","Type":"ContainerStarted","Data":"417ca19d649396f16021d8616aa9324d732e2952d8c6b5bab5005b1ad37781bc"} Jul 01 19:22:31.851506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.851482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qswl8" event={"ID":"d2bdb3ee-759f-4652-b6d0-c892342e63ef","Type":"ContainerStarted","Data":"28b1106693eb362dbce4052ef5e1c0aa42cf3f3958fbea4336a62473e8322283"} Jul 01 19:22:31.857306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.857280 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerStarted","Data":"9a227ca3248089ceb23301f89d7acaf3d7136bd75712fc3e9b958bdde76d7f1c"} Jul 01 19:22:31.860307 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.860281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsh9h" event={"ID":"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb","Type":"ContainerStarted","Data":"8e5c7f98af482770a592fea9d29fcad36dc3a0a4f36b43c2694d5f22782e926b"} Jul 01 19:22:31.878959 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.878913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" event={"ID":"22c2f7d4-97a4-46b0-92ac-21d7adcd462d","Type":"ContainerStarted","Data":"15dcb89123491e68796e53123a3d41df717af2c9b8b8e917aea1dec86de122bd"} Jul 01 19:22:31.893969 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.893938 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lf668" event={"ID":"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9","Type":"ContainerStarted","Data":"5da5fae5b412caf7801da626f521ad134c93be947aaf1173eeee49a1d4c3e92b"} Jul 01 19:22:31.906324 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:31.906087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"20df60deaa2d396348a95d987ef894a5325076a7086d2753b682549b13781e68"} Jul 01 19:22:32.463907 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.462975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:32.463907 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.463067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:32.463907 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.463252 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:32.463907 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.463329 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:34.463296255 +0000 UTC m=+5.118143251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:32.463907 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.463718 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:32.463907 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.463781 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:34.463751055 +0000 UTC m=+5.118598048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:32.564333 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.564294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:32.564499 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.564472 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:32.564499 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.564493 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:32.564613 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.564506 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:32.564613 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.564565 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:34.564546515 +0000 UTC m=+5.219393523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:32.805984 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.805903 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:32.806154 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.806032 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:32.806457 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.806438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:32.806554 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:32.806534 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:32.822905 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.822836 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:30 +0000 UTC" deadline="2028-02-20 13:07:06.465646097 +0000 UTC" Jul 01 19:22:32.822905 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:32.822891 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14369h44m33.642758554s" Jul 01 19:22:33.641640 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:33.641613 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:33.808831 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:33.808749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:33.808985 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:33.808881 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:34.478798 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:34.477978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:34.478798 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:34.478063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:34.478798 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.478209 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:34.478798 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.478275 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:38.47825566 +0000 UTC m=+9.133102651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:34.478798 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.478659 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:34.478798 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.478710 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:38.478695136 +0000 UTC m=+9.133542127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:34.579841 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:34.579151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:34.579841 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.579352 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:34.579841 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.579371 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:34.579841 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.579383 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:34.579841 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.579472 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:38.579453884 +0000 UTC m=+9.234300887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:34.806538 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:34.806456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:34.806684 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.806588 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:34.806966 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:34.806948 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:34.807058 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:34.807043 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:35.808713 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:35.808188 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:35.808713 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:35.808339 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:36.806510 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:36.806455 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:36.806693 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:36.806456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:36.806693 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:36.806599 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:36.806693 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:36.806651 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:37.806306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:37.806273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:37.806754 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:37.806437 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:38.511561 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:38.511420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:38.511561 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:38.511485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:38.511746 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.511595 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:38.511746 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.511608 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:38.511746 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.511668 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:46.511648782 +0000 UTC m=+17.166495776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:38.511746 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.511685 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:46.51167656 +0000 UTC m=+17.166523552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:38.613242 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:38.612637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:38.613242 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.612822 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:38.613242 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.612843 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:38.613242 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.612855 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:38.613242 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.612912 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:46.612893042 +0000 UTC m=+17.267740035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:38.806378 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:38.806298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:38.806825 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:38.806298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:38.806825 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.806436 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:38.806825 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:38.806513 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:39.807951 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:39.807920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:39.808728 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:39.808699 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:40.806306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:40.806212 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:40.806306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:40.806212 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:40.806523 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:40.806370 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:40.806586 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:40.806516 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:41.806614 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:41.806579 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:41.807071 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:41.806728 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:42.805997 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:42.805964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:42.806093 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:42.805964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:42.806093 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:42.806078 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:42.806201 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:42.806134 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:43.806135 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:43.806100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:43.806610 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:43.806259 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:44.805869 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:44.805830 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:44.805869 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:44.805877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:44.806101 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:44.805972 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:44.806165 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:44.806121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:45.806499 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:45.806460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:45.806951 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:45.806601 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:46.571806 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:46.571773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:46.571991 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:46.571819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:46.571991 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.571918 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:46.571991 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.571922 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:46.571991 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.571969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:02.571956874 +0000 UTC m=+33.226803865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:46.571991 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.571982 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:02.571975248 +0000 UTC m=+33.226822239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:46.672333 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:46.672297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:46.672476 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.672431 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:46.672476 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.672450 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:46.672476 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.672459 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:46.672607 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.672512 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:02.672499822 +0000 UTC m=+33.327346826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:46.806022 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:46.805974 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:46.806022 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:46.806011 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:46.806227 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.806099 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:46.806279 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:46.806235 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:47.806526 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:47.806487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:47.806966 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:47.806618 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:48.806023 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:48.805984 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:48.806224 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:48.805989 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:48.806224 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:48.806100 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:48.806328 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:48.806225 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:49.806726 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:49.806696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:49.807155 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:49.806809 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:50.806277 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:50.806247 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:50.806408 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:50.806349 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:50.806497 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:50.806421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:50.806530 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:50.806503 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:51.806462 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.806164 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:51.806952 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:51.806553 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:51.955976 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.955946 2574 generic.go:356] "Generic (PLEG): container finished" podID="d699610293e38abe1e8442cf82b3271a" containerID="c61245b80c090d64776eefdb0d6b9a3b0646c6b09c946ca5223cddff10973ae6" exitCode=0 Jul 01 19:22:51.956080 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.956034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" event={"ID":"d699610293e38abe1e8442cf82b3271a","Type":"ContainerDied","Data":"c61245b80c090d64776eefdb0d6b9a3b0646c6b09c946ca5223cddff10973ae6"} Jul 01 19:22:51.958069 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.957874 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ct8l" event={"ID":"50ffddd0-9177-4d4a-9610-20ba3522aeb6","Type":"ContainerStarted","Data":"1332194376aca24c1d5b760e1734c3162351e2e37afaa64a70d46c7ef32446f4"} Jul 01 19:22:51.963927 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.963822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gndwh" event={"ID":"734bc79a-4428-43af-ba2a-b6a253df6452","Type":"ContainerStarted","Data":"4d9524e96df90bf2eb33a6d4d8ae6282e8a22e86625da2f4ed25455d16b95632"} Jul 01 19:22:51.965273 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.965250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qswl8" event={"ID":"d2bdb3ee-759f-4652-b6d0-c892342e63ef","Type":"ContainerStarted","Data":"8b3d9c9099bc472648b1f199bb0b3011b60e82d7ff7ef05ffffd08bd134e0aba"} Jul 01 19:22:51.967003 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.966979 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dd10c94-b03f-4ae1-b010-9489c4acf7ac" containerID="f9a335c06b36555d956d21d3275a11fee6f87f74968f7fcea43dec511e439587" exitCode=0 Jul 01 19:22:51.967102 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.967043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerDied","Data":"f9a335c06b36555d956d21d3275a11fee6f87f74968f7fcea43dec511e439587"} Jul 01 19:22:51.968880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.968797 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsh9h" event={"ID":"e9f1ad24-c80d-4870-9f0c-b63a5468b3fb","Type":"ContainerStarted","Data":"fc130ee75a2b21f6dcd5153fa62150cafe3eb87bc020729973f547992382c9c0"} Jul 01 19:22:51.970975 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.970921 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" event={"ID":"22c2f7d4-97a4-46b0-92ac-21d7adcd462d","Type":"ContainerStarted","Data":"6e163195214ec2c68bf93cb2ac22b96897a259777c109d2d52c72da78ee83d8e"} Jul 01 19:22:51.973118 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.973094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lf668" event={"ID":"4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9","Type":"ContainerStarted","Data":"6333b56e894680ed29a88b1386e187687aafbfa1bfd948b3f46838b37fe1932b"} Jul 01 19:22:51.977120 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.977097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"fc1daa87b0a68c324d60966f6d3ffb03b8878a8da00c9eb4441a4ee6ad147383"} Jul 01 19:22:51.977222 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.977189 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"104cb1d95f550d1d8706f8c1874a8fdef3a348cd93ff637ffb4eaa21eba0a7e7"} Jul 01 19:22:51.977293 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.977239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"3b2b51b019c1183c1e892875e7b87dcda7191c310ffdd095efa6a4f8a047ccc3"} Jul 01 19:22:51.977293 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.977286 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"23af40fff14f9ee4ee404357f3deebf5c9b5f01c414ea49dbf16331cdf64eed8"} Jul 01 19:22:51.977389 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.977333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"cfe9ed15a005f13368796925c40450199dc39f6b1f51df604811efda2f40d872"} Jul 01 19:22:51.977389 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.977380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"2edf78cb60a3fdc0d685db5dfb8934f22c1ba6fd3e4d4c12052a22c39644593e"} Jul 01 19:22:51.979159 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:51.979098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" event={"ID":"d1791cf5791cda6f6876965b4b0ae27a","Type":"ContainerStarted","Data":"96143421a7e30122fccd2cef6406ecd883f9906afbf413e5abb7c7d96d1e6051"} Jul 01 19:22:52.022557 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.022177 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lsh9h" podStartSLOduration=3.055255872 podStartE2EDuration="23.022158386s" totalImagesPullingTime="19.966902514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:52.019788271 +0000 UTC m=+22.674635285" watchObservedRunningTime="2026-07-01 19:22:52.022158386 +0000 UTC m=+22.677005401" Jul 01 19:22:52.054201 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.054076 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lf668" podStartSLOduration=3.135681805 podStartE2EDuration="23.054061074s" totalImagesPullingTime="19.918379269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:52.053977628 +0000 UTC m=+22.708824641" watchObservedRunningTime="2026-07-01 19:22:52.054061074 +0000 UTC m=+22.708908087" Jul 01 19:22:52.246538 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.246332 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qswl8" podStartSLOduration=3.343357462 podStartE2EDuration="23.246312127s" totalImagesPullingTime="19.902954665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:52.194949254 +0000 UTC m=+22.849796279" watchObservedRunningTime="2026-07-01 19:22:52.246312127 +0000 UTC m=+22.901159141" Jul 01 19:22:52.287336 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.287282 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-179.ec2.internal" podStartSLOduration=22.28726073 podStartE2EDuration="22.28726073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:52.248082981 +0000 UTC m=+22.902929994" watchObservedRunningTime="2026-07-01 19:22:52.28726073 +0000 UTC m=+22.942107744" Jul 01 19:22:52.366953 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.366905 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gndwh" podStartSLOduration=2.451496756 podStartE2EDuration="22.36689013s" totalImagesPullingTime="19.915393374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:52.28927113 +0000 UTC m=+22.944118147" watchObservedRunningTime="2026-07-01 19:22:52.36689013 +0000 UTC m=+23.021737178" Jul 01 19:22:52.455298 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.455269 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:52.543020 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.542993 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:52.644510 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.644482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:52.787522 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.787496 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:22:52.805967 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.805944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:52.806089 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:52.806058 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:52.806180 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.806095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:52.806237 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:52.806191 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:52.807088 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.807021 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:22:52.787518713Z","UUID":"e397028c-57d4-44a5-8f20-f54424cf53e1","Handler":null,"Name":"","Endpoint":""} Jul 01 19:22:52.808668 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.808643 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:22:52.808771 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.808689 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:22:52.923380 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.923349 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:52.982871 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.982834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2pph8" event={"ID":"cba2ff8b-bb92-46a6-a975-764a176db0e6","Type":"ContainerStarted","Data":"b4a79e36f6e1024918e92377cb4b496dc391cdf106d34c2e6d7b64739c93f650"} Jul 01 19:22:52.984750 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.984724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" event={"ID":"d699610293e38abe1e8442cf82b3271a","Type":"ContainerStarted","Data":"0c58bad03035f7a9fe82bb8d9613cb42964b688a8b04a04b2a7fe11840ebe9b0"} Jul 01 19:22:52.986771 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:52.986744 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" event={"ID":"22c2f7d4-97a4-46b0-92ac-21d7adcd462d","Type":"ContainerStarted","Data":"23e06933d5691c70d421d984d756a7d8131434836f5a0c291b32c95c41e12a5a"} Jul 01 19:22:53.010237 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.010192 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4ct8l" podStartSLOduration=3.153506286 podStartE2EDuration="23.010180502s" totalImagesPullingTime="19.856674216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:52.36969461 +0000 UTC m=+23.024541623" watchObservedRunningTime="2026-07-01 19:22:53.010180502 +0000 UTC m=+23.665027515" Jul 01 19:22:53.048555 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.048473 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2pph8" podStartSLOduration=4.04670839 podStartE2EDuration="24.048459123s" totalImagesPullingTime="20.001750733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:53.01098885 +0000 UTC m=+23.665835863" watchObservedRunningTime="2026-07-01 19:22:53.048459123 +0000 UTC m=+23.703306135" Jul 01 19:22:53.048788 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.048765 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-179.ec2.internal" podStartSLOduration=23.048756887 podStartE2EDuration="23.048756887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:53.047062634 +0000 UTC m=+23.701909649" watchObservedRunningTime="2026-07-01 19:22:53.048756887 +0000 UTC m=+23.703603905" Jul 01 19:22:53.064040 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.064002 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:53.328366 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.328286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:53.701906 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.701867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:53.782901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.782868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:53.806688 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:53.806377 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:53.806688 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:53.806492 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:54.805957 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:54.805924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:54.806455 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:54.805925 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:54.806455 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:54.806031 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:54.806455 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:54.806124 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:54.993364 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:54.993315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" event={"ID":"22c2f7d4-97a4-46b0-92ac-21d7adcd462d","Type":"ContainerStarted","Data":"a8954413e1cbaffbcea817db5cf0a093147fdff586c2f0f9fd2fc916694071b8"} Jul 01 19:22:54.996955 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:54.996930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"188f72bfcce55f3955a4104f6549b7ea1f54249f42ce337390250adf2b9f6351"} Jul 01 19:22:55.805973 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:55.805945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:55.806405 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:55.806094 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:55.920485 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:55.920449 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:55.921099 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:55.921075 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:55.948078 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:55.948033 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg8c5" podStartSLOduration=4.471371965 podStartE2EDuration="26.948014304s" totalImagesPullingTime="22.476642339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:55.017177133 +0000 UTC m=+25.672024145" watchObservedRunningTime="2026-07-01 19:22:55.948014304 +0000 UTC m=+26.602861318" Jul 01 19:22:55.999565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:55.999532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:55.999798 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:55.999772 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lf668" Jul 01 19:22:56.106234 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:56.106158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:56.805692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:56.805523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:56.805836 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:56.805523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:56.805836 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:56.805766 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:56.805914 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:56.805833 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:57.004450 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.004418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" event={"ID":"523dbf55-bc15-4739-818a-2885a2013a47","Type":"ContainerStarted","Data":"9d2882a179fa478498a4af8b9f567952fe33f355e0a93e903ca7eab27526804a"} Jul 01 19:22:57.005030 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.004643 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:57.006308 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.006285 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dd10c94-b03f-4ae1-b010-9489c4acf7ac" containerID="90d3c1e4c4f34b0486b0cfcb37c230d00de28e2608f6f64362f9f7446584324e" exitCode=0 Jul 01 19:22:57.006418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.006366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerDied","Data":"90d3c1e4c4f34b0486b0cfcb37c230d00de28e2608f6f64362f9f7446584324e"} Jul 01 19:22:57.019677 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.019658 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:57.084503 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.084413 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" podStartSLOduration=6.978315441 podStartE2EDuration="27.084399248s" totalImagesPullingTime="20.106083807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:57.056156567 +0000 UTC m=+27.711003580" watchObservedRunningTime="2026-07-01 19:22:57.084399248 +0000 UTC m=+27.739246288" Jul 01 19:22:57.806722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:57.806619 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:57.806940 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:57.806755 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:58.009047 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.009017 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:58.009565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.009100 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:58.022974 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.022951 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:22:58.425834 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.425579 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vw95m"] Jul 01 19:22:58.425834 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.425835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:58.426012 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:58.425918 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:58.437273 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.437241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jmz8"] Jul 01 19:22:58.437392 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.437322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:58.437438 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:58.437391 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:58.441835 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.441813 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kccvx"] Jul 01 19:22:58.441958 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.441893 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:58.442022 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:58.441954 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:22:58.658014 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:58.657927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:59.012735 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:59.012702 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dd10c94-b03f-4ae1-b010-9489c4acf7ac" containerID="f53dd44a2e03e0471c7bf933ba14895a66a735b5b79bc31b04c0b7d99875e0ad" exitCode=0 Jul 01 19:22:59.013199 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:59.012786 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerDied","Data":"f53dd44a2e03e0471c7bf933ba14895a66a735b5b79bc31b04c0b7d99875e0ad"} Jul 01 19:22:59.807922 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:59.807888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:22:59.808104 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:59.808047 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:22:59.808633 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:59.808614 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:22:59.809990 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:59.808774 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:22:59.809990 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:22:59.808853 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:22:59.809990 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:22:59.808964 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:23:00.388350 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:00.388323 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:00.683987 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:00.683953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:00.745121 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:00.745057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:01.019297 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.019264 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dd10c94-b03f-4ae1-b010-9489c4acf7ac" containerID="b0f0fa060646fb02492adcf33b6cd1fec83ace9f1d6795519f07bc1b1f41b403" exitCode=0 Jul 01 19:23:01.019456 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.019327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerDied","Data":"b0f0fa060646fb02492adcf33b6cd1fec83ace9f1d6795519f07bc1b1f41b403"} Jul 01 19:23:01.459539 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.459506 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:01.557322 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.557292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:01.805990 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.805915 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:01.806184 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.806038 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:01.806184 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:01.806040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:23:01.806184 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:01.806034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:23:01.806350 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:01.806210 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:23:01.806350 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:01.806329 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:23:02.586106 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:02.586075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:02.586534 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:02.586128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:23:02.586534 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.586297 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:02.586534 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.586359 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:34.586341071 +0000 UTC m=+65.241188091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:02.586534 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.586300 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:02.586534 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.586462 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret podName:2b1e295d-c532-4450-80d7-f9fa421f9d1d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:34.586444915 +0000 UTC m=+65.241291908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret") pod "global-pull-secret-syncer-7jmz8" (UID: "2b1e295d-c532-4450-80d7-f9fa421f9d1d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:02.686977 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:02.686947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:02.687155 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.687102 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:02.687155 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.687123 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:02.687155 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.687135 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vr6jk for pod openshift-network-diagnostics/network-check-target-kccvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:02.687287 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:02.687207 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk podName:b80fe092-2d0b-4273-aead-b7e98c04ba9c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:34.687188735 +0000 UTC m=+65.342035731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6jk" (UniqueName: "kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk") pod "network-check-target-kccvx" (UID: "b80fe092-2d0b-4273-aead-b7e98c04ba9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:03.806175 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:03.806125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:03.806604 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:03.806154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:03.806604 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:03.806257 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kccvx" podUID="b80fe092-2d0b-4273-aead-b7e98c04ba9c" Jul 01 19:23:03.806604 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:03.806154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:23:03.806604 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:03.806325 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmz8" podUID="2b1e295d-c532-4450-80d7-f9fa421f9d1d" Jul 01 19:23:03.806604 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:03.806439 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vw95m" podUID="f40220c1-4697-4a0f-ab9c-a43a97e3cb98" Jul 01 19:23:04.107331 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.107261 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-179.ec2.internal" event="NodeReady" Jul 01 19:23:04.107473 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.107392 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:23:04.168453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.168420 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dqnf7"] Jul 01 19:23:04.187470 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.187413 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4j5g9"] Jul 01 19:23:04.187662 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.187636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.191230 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.190996 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdgrk\"" Jul 01 19:23:04.191230 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.191155 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:23:04.191413 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.191315 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:23:04.213816 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.213789 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqnf7"] Jul 01 19:23:04.213951 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.213831 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4j5g9"] Jul 01 19:23:04.213951 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.213928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.217387 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.217370 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:23:04.217653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.217637 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:23:04.217894 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.217875 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:23:04.217993 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.217970 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9btb6\"" Jul 01 19:23:04.300208 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.300175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2c233e-b0a3-4cca-8d48-a913abc66f28-config-volume\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.300208 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.300211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.300445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.300230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gkx\" (UniqueName: \"kubernetes.io/projected/885ef05c-8362-4ca3-aeac-1d5c31dcac6a-kube-api-access-92gkx\") pod \"ingress-canary-4j5g9\" (UID: \"885ef05c-8362-4ca3-aeac-1d5c31dcac6a\") " pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.300445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.300258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c233e-b0a3-4cca-8d48-a913abc66f28-tmp-dir\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.300445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.300357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/885ef05c-8362-4ca3-aeac-1d5c31dcac6a-cert\") pod \"ingress-canary-4j5g9\" (UID: \"885ef05c-8362-4ca3-aeac-1d5c31dcac6a\") " pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.300445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.300394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jls5k\" (UniqueName: \"kubernetes.io/projected/9d2c233e-b0a3-4cca-8d48-a913abc66f28-kube-api-access-jls5k\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.389384 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.389258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:04.401227 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5k\" (UniqueName: \"kubernetes.io/projected/9d2c233e-b0a3-4cca-8d48-a913abc66f28-kube-api-access-jls5k\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.401408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2c233e-b0a3-4cca-8d48-a913abc66f28-config-volume\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.401408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.401408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gkx\" (UniqueName: \"kubernetes.io/projected/885ef05c-8362-4ca3-aeac-1d5c31dcac6a-kube-api-access-92gkx\") pod \"ingress-canary-4j5g9\" (UID: \"885ef05c-8362-4ca3-aeac-1d5c31dcac6a\") " pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.401408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c233e-b0a3-4cca-8d48-a913abc66f28-tmp-dir\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.401408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/885ef05c-8362-4ca3-aeac-1d5c31dcac6a-cert\") pod \"ingress-canary-4j5g9\" (UID: \"885ef05c-8362-4ca3-aeac-1d5c31dcac6a\") " pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.401650 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:04.401453 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:04.401650 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:04.401516 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:04.901495981 +0000 UTC m=+35.556342983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:04.401902 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2c233e-b0a3-4cca-8d48-a913abc66f28-config-volume\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.401979 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.401956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c233e-b0a3-4cca-8d48-a913abc66f28-tmp-dir\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.406275 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.406249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/885ef05c-8362-4ca3-aeac-1d5c31dcac6a-cert\") pod \"ingress-canary-4j5g9\" (UID: \"885ef05c-8362-4ca3-aeac-1d5c31dcac6a\") " pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.414996 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.414970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jls5k\" (UniqueName: \"kubernetes.io/projected/9d2c233e-b0a3-4cca-8d48-a913abc66f28-kube-api-access-jls5k\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.414996 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.414984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gkx\" (UniqueName: \"kubernetes.io/projected/885ef05c-8362-4ca3-aeac-1d5c31dcac6a-kube-api-access-92gkx\") pod \"ingress-canary-4j5g9\" (UID: \"885ef05c-8362-4ca3-aeac-1d5c31dcac6a\") " pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.490730 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.490689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:04.523349 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.523321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4j5g9" Jul 01 19:23:04.906197 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:04.906161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:04.906670 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:04.906336 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:04.906670 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:04.906415 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:05.906393775 +0000 UTC m=+36.561240771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:05.461464 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.461228 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4j5g9"] Jul 01 19:23:05.506948 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:23:05.506918 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885ef05c_8362_4ca3_aeac_1d5c31dcac6a.slice/crio-6e28fcb4047489cd5d2bf852cf84375269241476c90b07a87ded36a2e6f9eca8 WatchSource:0}: Error finding container 6e28fcb4047489cd5d2bf852cf84375269241476c90b07a87ded36a2e6f9eca8: Status 404 returned error can't find the container with id 6e28fcb4047489cd5d2bf852cf84375269241476c90b07a87ded36a2e6f9eca8 Jul 01 19:23:05.805790 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.805756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:23:05.805931 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.805806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:05.805931 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.805816 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:05.808767 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.808741 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:05.808880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.808742 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsxvz\"" Jul 01 19:23:05.808880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.808815 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:05.808880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.808852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4g2f5\"" Jul 01 19:23:05.809061 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.808885 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:05.809602 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.809588 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:05.912502 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:05.912428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:05.912974 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:05.912576 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:05.912974 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:05.912634 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:07.912618216 +0000 UTC m=+38.567465212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:06.033559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:06.033521 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4j5g9" event={"ID":"885ef05c-8362-4ca3-aeac-1d5c31dcac6a","Type":"ContainerStarted","Data":"6e28fcb4047489cd5d2bf852cf84375269241476c90b07a87ded36a2e6f9eca8"} Jul 01 19:23:06.036113 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:06.036080 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dd10c94-b03f-4ae1-b010-9489c4acf7ac" containerID="6cdd07826dfc3c3077e79a2743984b07ad87412695ce39707b34008669cb6cf0" exitCode=0 Jul 01 19:23:06.036226 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:06.036122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerDied","Data":"6cdd07826dfc3c3077e79a2743984b07ad87412695ce39707b34008669cb6cf0"} Jul 01 19:23:06.953431 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:06.953397 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:07.041615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:07.041585 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dd10c94-b03f-4ae1-b010-9489c4acf7ac" containerID="6e79917759de804bc4809bc1cefcff0b3daa34adad73bf4b703dc2fb23f83621" exitCode=0 Jul 01 19:23:07.041772 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:07.041621 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerDied","Data":"6e79917759de804bc4809bc1cefcff0b3daa34adad73bf4b703dc2fb23f83621"} Jul 01 19:23:07.927581 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:07.927553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:07.927722 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:07.927702 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:07.927767 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:07.927761 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:11.927747264 +0000 UTC m=+42.582594256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:08.046786 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:08.046505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" event={"ID":"3dd10c94-b03f-4ae1-b010-9489c4acf7ac","Type":"ContainerStarted","Data":"3d675ad7d0eca14748cc0d9a2c453af3ddad873de76fda1434bc0c05bb5239ff"} Jul 01 19:23:08.048077 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:08.048056 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4j5g9" event={"ID":"885ef05c-8362-4ca3-aeac-1d5c31dcac6a","Type":"ContainerStarted","Data":"1c0b6f606387ec491a31ba9c0dfab0728349651fdb838f752578a8375367543c"} Jul 01 19:23:08.071455 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:08.071409 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lrlg9" podStartSLOduration=8.06492418 podStartE2EDuration="39.07139601s" totalImagesPullingTime="31.00647183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:08.071211404 +0000 UTC m=+38.726058417" watchObservedRunningTime="2026-07-01 19:23:08.07139601 +0000 UTC m=+38.726243023" Jul 01 19:23:08.200476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:08.200446 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:08.264718 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:08.264691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:09.067779 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:09.067733 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4j5g9" podStartSLOduration=2.634821934 podStartE2EDuration="5.067717193s" totalImagesPullingTime="2.432895259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:09.066763166 +0000 UTC m=+39.721610172" watchObservedRunningTime="2026-07-01 19:23:09.067717193 +0000 UTC m=+39.722564205" Jul 01 19:23:09.267495 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:09.267464 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:09.375171 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:09.375069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:11.441654 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:11.441624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:11.499971 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:11.499941 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:11.958708 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:11.958681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:11.958856 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:11.958780 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:11.958856 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:11.958833 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:19.958818101 +0000 UTC m=+50.613665093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:14.248002 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:14.247969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:14.347715 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:14.347682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:14.725845 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:14.725816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:14.787253 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:14.787225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:14.848527 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:14.848495 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:15.318810 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:15.318778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:15.416289 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:15.416256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:20.012906 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:20.012877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:20.013291 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:20.012997 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:20.013291 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:20.013049 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:36.013036316 +0000 UTC m=+66.667883306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:30.025520 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:30.025493 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tq5ps" Jul 01 19:23:30.195660 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:30.195626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:30.293815 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:30.293734 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:34.614562 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.614522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:34.614946 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.614598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:23:34.617478 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.617455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:34.617526 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.617461 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:34.624900 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:34.624881 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:23:34.624947 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:34.624937 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs podName:f40220c1-4697-4a0f-ab9c-a43a97e3cb98 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:38.624920754 +0000 UTC m=+129.279767748 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs") pod "network-metrics-daemon-vw95m" (UID: "f40220c1-4697-4a0f-ab9c-a43a97e3cb98") : secret "metrics-daemon-secret" not found Jul 01 19:23:34.628172 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.628132 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b1e295d-c532-4450-80d7-f9fa421f9d1d-original-pull-secret\") pod \"global-pull-secret-syncer-7jmz8\" (UID: \"2b1e295d-c532-4450-80d7-f9fa421f9d1d\") " pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:34.715429 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.715395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:34.718330 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.718315 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:34.728976 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.728963 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:34.739414 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.739396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr6jk\" (UniqueName: \"kubernetes.io/projected/b80fe092-2d0b-4273-aead-b7e98c04ba9c-kube-api-access-vr6jk\") pod \"network-check-target-kccvx\" (UID: \"b80fe092-2d0b-4273-aead-b7e98c04ba9c\") " pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:34.915926 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.915833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmz8" Jul 01 19:23:34.938618 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.938593 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4g2f5\"" Jul 01 19:23:34.946838 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:34.946812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:35.048435 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:35.048405 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jmz8"] Jul 01 19:23:35.051084 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:23:35.051051 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1e295d_c532_4450_80d7_f9fa421f9d1d.slice/crio-8dc6ec55369d15c68c55194220762489549f6ffb1e04ed6bc0334e2e5363520e WatchSource:0}: Error finding container 8dc6ec55369d15c68c55194220762489549f6ffb1e04ed6bc0334e2e5363520e: Status 404 returned error can't find the container with id 8dc6ec55369d15c68c55194220762489549f6ffb1e04ed6bc0334e2e5363520e Jul 01 19:23:35.076703 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:35.076682 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kccvx"] Jul 01 19:23:35.079598 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:23:35.079576 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80fe092_2d0b_4273_aead_b7e98c04ba9c.slice/crio-c0c70be24a507b8bdbbd7db0f52b99a461a302fe1d54381ba8f2c8b3fee747b4 WatchSource:0}: Error finding container c0c70be24a507b8bdbbd7db0f52b99a461a302fe1d54381ba8f2c8b3fee747b4: Status 404 returned error can't find the container with id c0c70be24a507b8bdbbd7db0f52b99a461a302fe1d54381ba8f2c8b3fee747b4 Jul 01 19:23:35.110581 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:35.110552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kccvx" event={"ID":"b80fe092-2d0b-4273-aead-b7e98c04ba9c","Type":"ContainerStarted","Data":"c0c70be24a507b8bdbbd7db0f52b99a461a302fe1d54381ba8f2c8b3fee747b4"} Jul 01 19:23:35.111605 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:35.111584 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jmz8" event={"ID":"2b1e295d-c532-4450-80d7-f9fa421f9d1d","Type":"ContainerStarted","Data":"8dc6ec55369d15c68c55194220762489549f6ffb1e04ed6bc0334e2e5363520e"} Jul 01 19:23:36.023822 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:36.023789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:23:36.024295 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:36.023939 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:36.024295 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:36.024006 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls podName:9d2c233e-b0a3-4cca-8d48-a913abc66f28 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:08.023991335 +0000 UTC m=+98.678838327 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls") pod "dns-default-dqnf7" (UID: "9d2c233e-b0a3-4cca-8d48-a913abc66f28") : secret "dns-default-metrics-tls" not found Jul 01 19:23:36.737728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:36.737687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:36.800935 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:36.800898 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:38.048479 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.047782 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-784fcc567-kgls9"] Jul 01 19:23:38.083868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.083839 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-784fcc567-kgls9"] Jul 01 19:23:38.084043 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.083961 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.087421 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087240 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.087421 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087264 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 19:23:38.087421 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lfsrf\"" Jul 01 19:23:38.087421 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087242 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 19:23:38.087718 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 19:23:38.087718 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087671 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.088013 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.087992 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 19:23:38.139027 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.139000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.139027 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.139032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-stats-auth\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.139334 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.139091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.139334 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.139156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fq5\" (UniqueName: \"kubernetes.io/projected/54e41c76-5d56-4aa6-b534-3503ef381c3b-kube-api-access-98fq5\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.139334 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.139210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-default-certificate\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.150175 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.150153 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5"] Jul 01 19:23:38.165355 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.165334 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-9qrbk"] Jul 01 19:23:38.165490 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.165454 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.168599 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.168574 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.168767 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.168655 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.168767 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.168680 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 19:23:38.168935 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.168914 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 19:23:38.169004 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.168946 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k5rj4\"" Jul 01 19:23:38.182844 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.182823 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5"] Jul 01 19:23:38.182943 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.182860 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-9qrbk"] Jul 01 19:23:38.182943 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.182934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.185990 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.185960 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 19:23:38.186380 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.186361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 19:23:38.186528 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.186509 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.186610 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.186510 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.186610 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.186575 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q2lpf\"" Jul 01 19:23:38.192025 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.191947 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 19:23:38.205383 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.205360 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:38.240236 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-stats-auth\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.240385 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g7m6\" (UniqueName: \"kubernetes.io/projected/e9def05b-c9e7-477b-a07c-d7419f4ed708-kube-api-access-6g7m6\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.240385 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwbzq\" (UniqueName: \"kubernetes.io/projected/49438452-63fa-4c59-b2fc-bb97b5a0a05a-kube-api-access-jwbzq\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.240505 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.240505 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fq5\" (UniqueName: \"kubernetes.io/projected/54e41c76-5d56-4aa6-b534-3503ef381c3b-kube-api-access-98fq5\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.240505 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49438452-63fa-4c59-b2fc-bb97b5a0a05a-serving-cert\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.240505 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:38.240478 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:38.240505 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49438452-63fa-4c59-b2fc-bb97b5a0a05a-trusted-ca\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.240732 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9def05b-c9e7-477b-a07c-d7419f4ed708-config\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.240732 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-default-certificate\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.240732 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49438452-63fa-4c59-b2fc-bb97b5a0a05a-config\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.240732 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.240732 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.240657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9def05b-c9e7-477b-a07c-d7419f4ed708-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.240732 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:38.240675 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.74065595 +0000 UTC m=+69.395502949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : secret "router-metrics-certs-default" not found Jul 01 19:23:38.241036 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:38.240836 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.740819425 +0000 UTC m=+69.395666429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:38.243670 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.243643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-stats-auth\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.243992 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.243968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-default-certificate\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.255304 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.255255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fq5\" (UniqueName: \"kubernetes.io/projected/54e41c76-5d56-4aa6-b534-3503ef381c3b-kube-api-access-98fq5\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.328064 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.327953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:38.341578 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49438452-63fa-4c59-b2fc-bb97b5a0a05a-config\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.341737 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9def05b-c9e7-477b-a07c-d7419f4ed708-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.341737 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g7m6\" (UniqueName: \"kubernetes.io/projected/e9def05b-c9e7-477b-a07c-d7419f4ed708-kube-api-access-6g7m6\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.341737 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwbzq\" (UniqueName: \"kubernetes.io/projected/49438452-63fa-4c59-b2fc-bb97b5a0a05a-kube-api-access-jwbzq\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.341915 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49438452-63fa-4c59-b2fc-bb97b5a0a05a-serving-cert\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.341915 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49438452-63fa-4c59-b2fc-bb97b5a0a05a-trusted-ca\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.341915 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.341820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9def05b-c9e7-477b-a07c-d7419f4ed708-config\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.343108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.342371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49438452-63fa-4c59-b2fc-bb97b5a0a05a-config\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.343108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.342423 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9def05b-c9e7-477b-a07c-d7419f4ed708-config\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.343428 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.343385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49438452-63fa-4c59-b2fc-bb97b5a0a05a-trusted-ca\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.344770 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.344735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9def05b-c9e7-477b-a07c-d7419f4ed708-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.345200 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.345174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49438452-63fa-4c59-b2fc-bb97b5a0a05a-serving-cert\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.350921 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.350865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwbzq\" (UniqueName: \"kubernetes.io/projected/49438452-63fa-4c59-b2fc-bb97b5a0a05a-kube-api-access-jwbzq\") pod \"console-operator-7fdbdf9c99-9qrbk\" (UID: \"49438452-63fa-4c59-b2fc-bb97b5a0a05a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.351033 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.351019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g7m6\" (UniqueName: \"kubernetes.io/projected/e9def05b-c9e7-477b-a07c-d7419f4ed708-kube-api-access-6g7m6\") pod \"service-ca-operator-5d7b7dc95c-2g7w5\" (UID: \"e9def05b-c9e7-477b-a07c-d7419f4ed708\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.478444 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.478410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" Jul 01 19:23:38.493688 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.493611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:38.744586 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.744544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.744771 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:38.744613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:38.744771 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:38.744724 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:38.744881 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:38.744777 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:39.7447574 +0000 UTC m=+70.399604413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:38.744881 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:38.744803 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:39.744793131 +0000 UTC m=+70.399640127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : secret "router-metrics-certs-default" not found Jul 01 19:23:39.505018 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:39.504927 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5"] Jul 01 19:23:39.508005 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:23:39.507965 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9def05b_c9e7_477b_a07c_d7419f4ed708.slice/crio-f73d8728e9053926de741e52eab9ca679299e004b1d8e78c091eb43b331013b9 WatchSource:0}: Error finding container f73d8728e9053926de741e52eab9ca679299e004b1d8e78c091eb43b331013b9: Status 404 returned error can't find the container with id f73d8728e9053926de741e52eab9ca679299e004b1d8e78c091eb43b331013b9 Jul 01 19:23:39.518056 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:39.518033 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-9qrbk"] Jul 01 19:23:39.657401 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:23:39.657368 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49438452_63fa_4c59_b2fc_bb97b5a0a05a.slice/crio-f5c95438da142db72d1f5ab2e2b65b4877b07fa96fa027fa9ed4bb042ba3077b WatchSource:0}: Error finding container f5c95438da142db72d1f5ab2e2b65b4877b07fa96fa027fa9ed4bb042ba3077b: Status 404 returned error can't find the container with id f5c95438da142db72d1f5ab2e2b65b4877b07fa96fa027fa9ed4bb042ba3077b Jul 01 19:23:39.751413 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:39.751385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:39.751516 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:39.751453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:39.751581 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:39.751540 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:39.751623 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:39.751588 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.751572309 +0000 UTC m=+72.406419301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:39.751623 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:39.751607 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.751597679 +0000 UTC m=+72.406444670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : secret "router-metrics-certs-default" not found Jul 01 19:23:40.127761 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:40.127724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kccvx" event={"ID":"b80fe092-2d0b-4273-aead-b7e98c04ba9c","Type":"ContainerStarted","Data":"a66c4239ec242017e43a894e1814ed72c8da1c861f3d4f8ff75d9dd3a843f2e7"} Jul 01 19:23:40.127934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:40.127817 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:23:40.129101 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:40.129074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" event={"ID":"49438452-63fa-4c59-b2fc-bb97b5a0a05a","Type":"ContainerStarted","Data":"f5c95438da142db72d1f5ab2e2b65b4877b07fa96fa027fa9ed4bb042ba3077b"} Jul 01 19:23:40.130273 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:40.130250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" event={"ID":"e9def05b-c9e7-477b-a07c-d7419f4ed708","Type":"ContainerStarted","Data":"f73d8728e9053926de741e52eab9ca679299e004b1d8e78c091eb43b331013b9"} Jul 01 19:23:40.144491 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:40.144298 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kccvx" podStartSLOduration=66.524841064 podStartE2EDuration="1m11.144284378s" totalImagesPullingTime="4.619443314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:40.143930003 +0000 UTC m=+70.798777028" watchObservedRunningTime="2026-07-01 19:23:40.144284378 +0000 UTC m=+70.799131392" Jul 01 19:23:41.529003 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.528972 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hhrhg"] Jul 01 19:23:41.531191 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.531175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.536408 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.536379 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-xh89l\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xh89l\"" type="*v1.Secret" Jul 01 19:23:41.536408 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.536380 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jul 01 19:23:41.536648 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.536623 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jul 01 19:23:41.536648 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.536631 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 01 19:23:41.536750 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.536618 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-hhrhg\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" podUID="109c8646-eaed-4ad2-9da4-58aa13cc4926" pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.536859 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.536834 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 01 19:23:41.558296 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.558262 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hhrhg"] Jul 01 19:23:41.566445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.566416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/109c8646-eaed-4ad2-9da4-58aa13cc4926-crio-socket\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.566590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.566455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.566590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.566503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/109c8646-eaed-4ad2-9da4-58aa13cc4926-data-volume\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.566590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.566546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.566762 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.566606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxpd9\" (UniqueName: \"kubernetes.io/projected/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-api-access-wxpd9\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.578235 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.578124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:41.644966 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.644811 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:41.667936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.667672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/109c8646-eaed-4ad2-9da4-58aa13cc4926-crio-socket\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.667936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.667721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.667936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.667757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/109c8646-eaed-4ad2-9da4-58aa13cc4926-data-volume\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.667936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.667773 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/109c8646-eaed-4ad2-9da4-58aa13cc4926-crio-socket\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.667936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.667806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.667936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.667835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxpd9\" (UniqueName: \"kubernetes.io/projected/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-api-access-wxpd9\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.668375 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.668226 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/109c8646-eaed-4ad2-9da4-58aa13cc4926-data-volume\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:41.768625 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.768588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:41.768800 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.768666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:41.768800 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.768748 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.768731496 +0000 UTC m=+76.423578487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:41.768800 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.768791 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:41.768945 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:41.768859 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.768842998 +0000 UTC m=+76.423689992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : secret "router-metrics-certs-default" not found Jul 01 19:23:41.831663 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.831620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:41.931383 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:41.931351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:42.139116 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.139071 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jmz8" event={"ID":"2b1e295d-c532-4450-80d7-f9fa421f9d1d","Type":"ContainerStarted","Data":"5b2f4684ef13ba37ea3f32b14f2ab33ba27cdcbf6eed29e51c8a3d67aecb49a9"} Jul 01 19:23:42.159434 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.159378 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7jmz8" podStartSLOduration=65.81569879 podStartE2EDuration="1m12.159358251s" totalImagesPullingTime="6.343659461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:42.158460918 +0000 UTC m=+72.813307934" watchObservedRunningTime="2026-07-01 19:23:42.159358251 +0000 UTC m=+72.814205245" Jul 01 19:23:42.341895 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.341805 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xh89l\"" Jul 01 19:23:42.403612 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.403584 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:23:42.408668 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.408649 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:42.408746 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.408706 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:42.908690192 +0000 UTC m=+73.563537182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : configmap "kube-rbac-proxy" not found Jul 01 19:23:42.566389 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.566353 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:23:42.668268 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.668193 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition Jul 01 19:23:42.668428 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.668276 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.168258361 +0000 UTC m=+73.823105359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : failed to sync secret cache: timed out waiting for the condition Jul 01 19:23:42.675616 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.675590 2574 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 01 19:23:42.675760 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.675626 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wxpd9 for pod openshift-insights/insights-runtime-extractor-hhrhg: failed to sync configmap cache: timed out waiting for the condition Jul 01 19:23:42.675760 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.675688 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-api-access-wxpd9 podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.175667286 +0000 UTC m=+73.830514292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wxpd9" (UniqueName: "kubernetes.io/projected/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-api-access-wxpd9") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : failed to sync configmap cache: timed out waiting for the condition Jul 01 19:23:42.931914 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.931887 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:23:42.978589 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.978557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:42.978752 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.978660 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:42.978752 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:42.978734 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.978714341 +0000 UTC m=+74.633561348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : configmap "kube-rbac-proxy" not found Jul 01 19:23:42.995612 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:42.995585 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:23:43.180648 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:43.180616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:43.180831 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:43.180653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxpd9\" (UniqueName: \"kubernetes.io/projected/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-api-access-wxpd9\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:43.180831 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:43.180774 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:43.180945 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:43.180844 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:44.180822182 +0000 UTC m=+74.835669173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:43.183294 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:43.183231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxpd9\" (UniqueName: \"kubernetes.io/projected/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-api-access-wxpd9\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:43.725801 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:43.725763 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsh9h_e9f1ad24-c80d-4870-9f0c-b63a5468b3fb/dns-node-resolver/0.log" Jul 01 19:23:43.986952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:43.986879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:43.987088 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:43.986960 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:43.987088 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:43.987012 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.986999191 +0000 UTC m=+76.641846181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : configmap "kube-rbac-proxy" not found Jul 01 19:23:44.146297 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.146269 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/0.log" Jul 01 19:23:44.146442 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.146316 2574 generic.go:356] "Generic (PLEG): container finished" podID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" containerID="44031ba27889cb3cb001c99c6a68821042431e4c4fa8c7edd5a275994d34b310" exitCode=255 Jul 01 19:23:44.146442 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.146399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" event={"ID":"49438452-63fa-4c59-b2fc-bb97b5a0a05a","Type":"ContainerDied","Data":"44031ba27889cb3cb001c99c6a68821042431e4c4fa8c7edd5a275994d34b310"} Jul 01 19:23:44.146603 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.146582 2574 scope.go:117] "RemoveContainer" containerID="44031ba27889cb3cb001c99c6a68821042431e4c4fa8c7edd5a275994d34b310" Jul 01 19:23:44.147887 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.147864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" event={"ID":"e9def05b-c9e7-477b-a07c-d7419f4ed708","Type":"ContainerStarted","Data":"78d5927635b2a6f4887456759c508be904dc51c3f6a81ea3ee517e5dc368e3bd"} Jul 01 19:23:44.182571 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.182531 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" podStartSLOduration=2.033952995 podStartE2EDuration="6.182517511s" totalImagesPullingTime="4.148564516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:44.181747212 +0000 UTC m=+74.836594231" watchObservedRunningTime="2026-07-01 19:23:44.182517511 +0000 UTC m=+74.837364525" Jul 01 19:23:44.189034 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.188588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:44.189034 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:44.188806 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:44.189034 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:44.188860 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:46.188842658 +0000 UTC m=+76.843689651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:44.311174 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.311119 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:44.325171 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.325150 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ct8l_50ffddd0-9177-4d4a-9610-20ba3522aeb6/node-ca/0.log" Jul 01 19:23:44.400750 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.400720 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:44.926265 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:44.926234 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4j5g9_885ef05c-8362-4ca3-aeac-1d5c31dcac6a/serve-healthcheck-canary/0.log" Jul 01 19:23:45.152251 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.152223 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/1.log" Jul 01 19:23:45.152652 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.152638 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/0.log" Jul 01 19:23:45.152702 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.152672 2574 generic.go:356] "Generic (PLEG): container finished" podID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" containerID="80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8" exitCode=255 Jul 01 19:23:45.152744 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.152702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" event={"ID":"49438452-63fa-4c59-b2fc-bb97b5a0a05a","Type":"ContainerDied","Data":"80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8"} Jul 01 19:23:45.152815 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.152801 2574 scope.go:117] "RemoveContainer" containerID="44031ba27889cb3cb001c99c6a68821042431e4c4fa8c7edd5a275994d34b310" Jul 01 19:23:45.153017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.153000 2574 scope.go:117] "RemoveContainer" containerID="80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8" Jul 01 19:23:45.153220 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:45.153184 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9qrbk_openshift-console-operator(49438452-63fa-4c59-b2fc-bb97b5a0a05a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podUID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" Jul 01 19:23:45.307978 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.307944 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8"] Jul 01 19:23:45.310492 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.310475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" Jul 01 19:23:45.313217 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.313195 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fqs26\"" Jul 01 19:23:45.313351 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.313196 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:45.313493 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.313479 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 19:23:45.319047 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.319023 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8"] Jul 01 19:23:45.399163 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.399102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg7nf\" (UniqueName: \"kubernetes.io/projected/eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2-kube-api-access-bg7nf\") pod \"migrator-786f9fbc5-j5sh8\" (UID: \"eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" Jul 01 19:23:45.500357 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.500322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7nf\" (UniqueName: \"kubernetes.io/projected/eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2-kube-api-access-bg7nf\") pod \"migrator-786f9fbc5-j5sh8\" (UID: \"eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" Jul 01 19:23:45.510709 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.510686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg7nf\" (UniqueName: \"kubernetes.io/projected/eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2-kube-api-access-bg7nf\") pod \"migrator-786f9fbc5-j5sh8\" (UID: \"eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" Jul 01 19:23:45.621120 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.621059 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" Jul 01 19:23:45.739093 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.739065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8"] Jul 01 19:23:45.742345 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:23:45.742320 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6e5ed2_fbae_49da_a5f9_8446ca1d14f2.slice/crio-8cb7d700fc4d0f56bb1aeb980051483ced5d64757dd2169c76e88b28e5108503 WatchSource:0}: Error finding container 8cb7d700fc4d0f56bb1aeb980051483ced5d64757dd2169c76e88b28e5108503: Status 404 returned error can't find the container with id 8cb7d700fc4d0f56bb1aeb980051483ced5d64757dd2169c76e88b28e5108503 Jul 01 19:23:45.802300 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.802278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:45.802410 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:45.802338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:45.802453 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:45.802423 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:45.802485 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:45.802450 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:53.802433799 +0000 UTC m=+84.457280790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:45.802485 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:45.802473 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:53.802466617 +0000 UTC m=+84.457313608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : secret "router-metrics-certs-default" not found Jul 01 19:23:46.004400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.004371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:46.004796 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:46.004457 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:46.004796 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:46.004507 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:50.004494115 +0000 UTC m=+80.659341106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : configmap "kube-rbac-proxy" not found Jul 01 19:23:46.156850 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.156821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/1.log" Jul 01 19:23:46.157227 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.157206 2574 scope.go:117] "RemoveContainer" containerID="80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8" Jul 01 19:23:46.157396 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:46.157377 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9qrbk_openshift-console-operator(49438452-63fa-4c59-b2fc-bb97b5a0a05a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podUID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" Jul 01 19:23:46.158058 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.158038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" event={"ID":"eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2","Type":"ContainerStarted","Data":"8cb7d700fc4d0f56bb1aeb980051483ced5d64757dd2169c76e88b28e5108503"} Jul 01 19:23:46.205655 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.205622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:46.205801 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:46.205774 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:46.205889 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:46.205834 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:50.205821542 +0000 UTC m=+80.860668534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:46.261935 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.261859 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:46.362502 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:46.362466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:47.892679 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:47.892622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:47.965483 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:47.965452 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:48.166428 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.166328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" event={"ID":"eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2","Type":"ContainerStarted","Data":"bb81a5ef2e1e1e82355b564efba29fd3a9fe4e41627fb4d7f74db652adee203b"} Jul 01 19:23:48.166428 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.166384 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" event={"ID":"eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2","Type":"ContainerStarted","Data":"945864f3896445e571c27b2d667a59f247ab732c466ff14f6ad19ea567de12f5"} Jul 01 19:23:48.195292 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.195251 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-j5sh8" podStartSLOduration=1.719205235 podStartE2EDuration="3.195237096s" totalImagesPullingTime="1.476031861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:48.195166657 +0000 UTC m=+78.850013661" watchObservedRunningTime="2026-07-01 19:23:48.195237096 +0000 UTC m=+78.850084109" Jul 01 19:23:48.310454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.310416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:48.391661 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.391620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:48.494162 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.494115 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:48.494351 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.494197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:23:48.494583 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:48.494566 2574 scope.go:117] "RemoveContainer" containerID="80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8" Jul 01 19:23:48.494768 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:48.494747 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9qrbk_openshift-console-operator(49438452-63fa-4c59-b2fc-bb97b5a0a05a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podUID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" Jul 01 19:23:49.503919 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:49.503882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:50.035944 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:50.035909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:50.036094 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:50.036032 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:50.036183 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:50.036095 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:58.036080718 +0000 UTC m=+88.690927709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : configmap "kube-rbac-proxy" not found Jul 01 19:23:50.237067 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:50.237027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:50.237283 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:50.237185 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:50.237283 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:50.237257 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:58.237237142 +0000 UTC m=+88.892084133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:51.810554 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:51.810441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:51.911198 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:51.911160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:51.987696 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:51.987664 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:52.093070 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:52.092987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:52.193647 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:52.193615 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:52.913889 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:52.913853 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:53.538778 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:53.538744 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:53.711747 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:53.711715 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:53.864009 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:53.863926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:53.864178 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:53.864015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:23:53.864178 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:53.864118 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:53.864178 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:53.864157 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:24:09.864117217 +0000 UTC m=+100.518964225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:53.864310 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:53.864194 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs podName:54e41c76-5d56-4aa6-b534-3503ef381c3b nodeName:}" failed. No retries permitted until 2026-07-01 19:24:09.864184203 +0000 UTC m=+100.519031200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs") pod "router-default-784fcc567-kgls9" (UID: "54e41c76-5d56-4aa6-b534-3503ef381c3b") : secret "router-metrics-certs-default" not found Jul 01 19:23:53.911480 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:53.911452 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:54.118782 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:54.118705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:54.526418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:54.526382 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:54.663839 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:54.663809 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:54.908594 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:54.908517 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.311123 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:55.311092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.417032 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:55.417002 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.518000 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:55.517968 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.618361 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:55.618289 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.915479 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:55.915399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.983702 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:55.983674 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:56.509456 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:56.509423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.614866 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:57.614834 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.713553 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:57.713505 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.823692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:57.823656 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.943442 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:57.943417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.041630 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:58.041592 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.092485 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:58.092453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:58.092960 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:58.092938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/109c8646-eaed-4ad2-9da4-58aa13cc4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:58.294112 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:58.294019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:23:58.294302 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:58.294205 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:58.294302 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:23:58.294283 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls podName:109c8646-eaed-4ad2-9da4-58aa13cc4926 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:14.294261836 +0000 UTC m=+104.949108842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hhrhg" (UID: "109c8646-eaed-4ad2-9da4-58aa13cc4926") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:58.530180 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:58.530129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.918569 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:58.918533 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:59.245684 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:59.245655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:59.535427 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:23:59.535344 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:00.319042 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:00.319005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:00.543856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:00.543823 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:00.759426 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:00.759389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.145214 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:01.145116 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.429217 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:01.429189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.536736 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:01.536705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.737604 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:01.737528 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:02.127751 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:02.127661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:02.321591 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:02.321556 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:02.599885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:02.599842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:03.806409 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:03.806374 2574 scope.go:117] "RemoveContainer" containerID="80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8" Jul 01 19:24:04.215620 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:04.215595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:24:04.216017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:04.216002 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/1.log" Jul 01 19:24:04.216060 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:04.216034 2574 generic.go:356] "Generic (PLEG): container finished" podID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" containerID="6c4b105d52f756398353bcbabbc98bea7ff010da835ad4c81219d9631d5042d6" exitCode=255 Jul 01 19:24:04.216090 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:04.216078 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" event={"ID":"49438452-63fa-4c59-b2fc-bb97b5a0a05a","Type":"ContainerDied","Data":"6c4b105d52f756398353bcbabbc98bea7ff010da835ad4c81219d9631d5042d6"} Jul 01 19:24:04.216133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:04.216122 2574 scope.go:117] "RemoveContainer" containerID="80079929aeb49372fe6a90da353564aea302564d83b6501a2cbeb5867526ece8" Jul 01 19:24:04.216408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:04.216392 2574 scope.go:117] "RemoveContainer" containerID="6c4b105d52f756398353bcbabbc98bea7ff010da835ad4c81219d9631d5042d6" Jul 01 19:24:04.216589 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:04.216568 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9qrbk_openshift-console-operator(49438452-63fa-4c59-b2fc-bb97b5a0a05a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podUID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" Jul 01 19:24:05.222452 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:05.222423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:24:07.425811 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.425778 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm"] Jul 01 19:24:07.428440 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.428425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.434542 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.434519 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 19:24:07.435391 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.435368 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4cx8s\"" Jul 01 19:24:07.435577 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.435554 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 19:24:07.435682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.435588 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 19:24:07.435682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.435671 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 19:24:07.440258 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.440239 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm"] Jul 01 19:24:07.558336 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.558306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:07.564601 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.564576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab5327b4-7b76-4dc3-abe6-36d8dfbcf852-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4df8c756-n54vm\" (UID: \"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.564744 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.564673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cl25\" (UniqueName: \"kubernetes.io/projected/ab5327b4-7b76-4dc3-abe6-36d8dfbcf852-kube-api-access-7cl25\") pod \"managed-serviceaccount-addon-agent-f4df8c756-n54vm\" (UID: \"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.658382 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.658345 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:07.665454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.665428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cl25\" (UniqueName: \"kubernetes.io/projected/ab5327b4-7b76-4dc3-abe6-36d8dfbcf852-kube-api-access-7cl25\") pod \"managed-serviceaccount-addon-agent-f4df8c756-n54vm\" (UID: \"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.665610 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.665594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab5327b4-7b76-4dc3-abe6-36d8dfbcf852-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4df8c756-n54vm\" (UID: \"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.667967 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.667941 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab5327b4-7b76-4dc3-abe6-36d8dfbcf852-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4df8c756-n54vm\" (UID: \"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.675291 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.675267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cl25\" (UniqueName: \"kubernetes.io/projected/ab5327b4-7b76-4dc3-abe6-36d8dfbcf852-kube-api-access-7cl25\") pod \"managed-serviceaccount-addon-agent-f4df8c756-n54vm\" (UID: \"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.747459 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.747429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" Jul 01 19:24:07.755627 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.755591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:07.872621 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:07.872592 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm"] Jul 01 19:24:07.875394 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:07.875358 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab5327b4_7b76_4dc3_abe6_36d8dfbcf852.slice/crio-85430376106a7297512a9f9bb68562837673a7cf5fe30c3e3de9eea4c53ccf7a WatchSource:0}: Error finding container 85430376106a7297512a9f9bb68562837673a7cf5fe30c3e3de9eea4c53ccf7a: Status 404 returned error can't find the container with id 85430376106a7297512a9f9bb68562837673a7cf5fe30c3e3de9eea4c53ccf7a Jul 01 19:24:08.067663 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.067579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:24:08.069594 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.069570 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2c233e-b0a3-4cca-8d48-a913abc66f28-metrics-tls\") pod \"dns-default-dqnf7\" (UID: \"9d2c233e-b0a3-4cca-8d48-a913abc66f28\") " pod="openshift-dns/dns-default-dqnf7" Jul 01 19:24:08.100832 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.100810 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdgrk\"" Jul 01 19:24:08.109722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.109700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqnf7" Jul 01 19:24:08.231998 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.231966 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" event={"ID":"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852","Type":"ContainerStarted","Data":"85430376106a7297512a9f9bb68562837673a7cf5fe30c3e3de9eea4c53ccf7a"} Jul 01 19:24:08.237710 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.237688 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqnf7"] Jul 01 19:24:08.239783 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:08.239752 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2c233e_b0a3_4cca_8d48_a913abc66f28.slice/crio-1cf77fe529b0f84b81331bd95016b749c0893cf6f306fcad572db769c39043ae WatchSource:0}: Error finding container 1cf77fe529b0f84b81331bd95016b749c0893cf6f306fcad572db769c39043ae: Status 404 returned error can't find the container with id 1cf77fe529b0f84b81331bd95016b749c0893cf6f306fcad572db769c39043ae Jul 01 19:24:08.494263 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.494232 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:24:08.494627 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.494284 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:24:08.494627 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:08.494587 2574 scope.go:117] "RemoveContainer" containerID="6c4b105d52f756398353bcbabbc98bea7ff010da835ad4c81219d9631d5042d6" Jul 01 19:24:08.494739 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:08.494719 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9qrbk_openshift-console-operator(49438452-63fa-4c59-b2fc-bb97b5a0a05a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podUID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" Jul 01 19:24:09.238816 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:09.238715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqnf7" event={"ID":"9d2c233e-b0a3-4cca-8d48-a913abc66f28","Type":"ContainerStarted","Data":"1cf77fe529b0f84b81331bd95016b749c0893cf6f306fcad572db769c39043ae"} Jul 01 19:24:09.882501 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:09.882466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:09.882959 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:09.882537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:09.883134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:09.883109 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e41c76-5d56-4aa6-b534-3503ef381c3b-service-ca-bundle\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:09.884958 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:09.884933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e41c76-5d56-4aa6-b534-3503ef381c3b-metrics-certs\") pod \"router-default-784fcc567-kgls9\" (UID: \"54e41c76-5d56-4aa6-b534-3503ef381c3b\") " pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:09.895806 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:09.895787 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:11.024329 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.024295 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-784fcc567-kgls9"] Jul 01 19:24:11.029401 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:11.029377 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e41c76_5d56_4aa6_b534_3503ef381c3b.slice/crio-8c97f85c992b21629813b9470c9e635fba19a17fad6c64df5047b68273fa681f WatchSource:0}: Error finding container 8c97f85c992b21629813b9470c9e635fba19a17fad6c64df5047b68273fa681f: Status 404 returned error can't find the container with id 8c97f85c992b21629813b9470c9e635fba19a17fad6c64df5047b68273fa681f Jul 01 19:24:11.135748 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.135674 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kccvx" Jul 01 19:24:11.246893 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.246855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqnf7" event={"ID":"9d2c233e-b0a3-4cca-8d48-a913abc66f28","Type":"ContainerStarted","Data":"418ef0f7b1780728ee10d19c0bc532524a5fff05ceee2cebaa56e2ad9bcc3fbb"} Jul 01 19:24:11.247096 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.246972 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqnf7" event={"ID":"9d2c233e-b0a3-4cca-8d48-a913abc66f28","Type":"ContainerStarted","Data":"51d54fc04f6dda3762e0b36c109a55ac04c9d04e76795b5a18f3ab187f2ee737"} Jul 01 19:24:11.247096 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.247010 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dqnf7" Jul 01 19:24:11.248445 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.248418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" event={"ID":"ab5327b4-7b76-4dc3-abe6-36d8dfbcf852","Type":"ContainerStarted","Data":"a4b82ec497b2902993d23c6c5d2c6a4d9f2390fcf2f6db23dd9caff3ab5cae45"} Jul 01 19:24:11.249809 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.249780 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-784fcc567-kgls9" event={"ID":"54e41c76-5d56-4aa6-b534-3503ef381c3b","Type":"ContainerStarted","Data":"cc55fed9a32937ded379511451a0b2f445fd21639d9f6665970d4b6de5f79de1"} Jul 01 19:24:11.249947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.249814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-784fcc567-kgls9" event={"ID":"54e41c76-5d56-4aa6-b534-3503ef381c3b","Type":"ContainerStarted","Data":"8c97f85c992b21629813b9470c9e635fba19a17fad6c64df5047b68273fa681f"} Jul 01 19:24:11.266049 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.265996 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dqnf7" podStartSLOduration=64.627446623 podStartE2EDuration="1m7.265977706s" totalImagesPullingTime="2.638531083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:11.265297897 +0000 UTC m=+101.920144911" watchObservedRunningTime="2026-07-01 19:24:11.265977706 +0000 UTC m=+101.920824722" Jul 01 19:24:11.286694 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.286652 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-784fcc567-kgls9" podStartSLOduration=33.28663881 podStartE2EDuration="33.28663881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:11.2861254 +0000 UTC m=+101.940972415" watchObservedRunningTime="2026-07-01 19:24:11.28663881 +0000 UTC m=+101.941485822" Jul 01 19:24:11.305897 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.305851 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4df8c756-n54vm" podStartSLOduration=1.297677893 podStartE2EDuration="4.305835774s" totalImagesPullingTime="3.008157881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:11.305696889 +0000 UTC m=+101.960543903" watchObservedRunningTime="2026-07-01 19:24:11.305835774 +0000 UTC m=+101.960682766" Jul 01 19:24:11.896196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.896167 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:11.898895 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:11.898875 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:12.254179 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:12.254129 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:12.255249 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:12.255225 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-784fcc567-kgls9" Jul 01 19:24:12.476896 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:12.476865 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.581041 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:12.580953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.723647 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:12.723618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.813801 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:12.813772 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:14.319321 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:14.319285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:24:14.321536 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:14.321518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/109c8646-eaed-4ad2-9da4-58aa13cc4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhrhg\" (UID: \"109c8646-eaed-4ad2-9da4-58aa13cc4926\") " pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:24:14.540872 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:14.540840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hhrhg" Jul 01 19:24:14.694069 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:14.694038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hhrhg"] Jul 01 19:24:14.698464 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:14.698431 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109c8646_eaed_4ad2_9da4_58aa13cc4926.slice/crio-6b03e49213201321a5f2639a0f9dcd9153d73fc5ccf195522a2525c7586a6358 WatchSource:0}: Error finding container 6b03e49213201321a5f2639a0f9dcd9153d73fc5ccf195522a2525c7586a6358: Status 404 returned error can't find the container with id 6b03e49213201321a5f2639a0f9dcd9153d73fc5ccf195522a2525c7586a6358 Jul 01 19:24:15.263790 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:15.263758 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhrhg" event={"ID":"109c8646-eaed-4ad2-9da4-58aa13cc4926","Type":"ContainerStarted","Data":"6b03e49213201321a5f2639a0f9dcd9153d73fc5ccf195522a2525c7586a6358"} Jul 01 19:24:16.427433 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:16.427401 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:16.501958 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:16.501919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:16.667043 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:16.667009 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:16.768326 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:16.768250 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:17.329057 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:17.329018 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:18.806676 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:18.806653 2574 scope.go:117] "RemoveContainer" containerID="6c4b105d52f756398353bcbabbc98bea7ff010da835ad4c81219d9631d5042d6" Jul 01 19:24:18.806985 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:18.806783 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9qrbk_openshift-console-operator(49438452-63fa-4c59-b2fc-bb97b5a0a05a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podUID="49438452-63fa-4c59-b2fc-bb97b5a0a05a" Jul 01 19:24:19.279070 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:19.279019 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhrhg" event={"ID":"109c8646-eaed-4ad2-9da4-58aa13cc4926","Type":"ContainerStarted","Data":"20c5a601812686ebeca19754f22b14b100a6cc1b6f5381c664518ad286011188"} Jul 01 19:24:20.283590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:20.283556 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhrhg" event={"ID":"109c8646-eaed-4ad2-9da4-58aa13cc4926","Type":"ContainerStarted","Data":"a410df0c653f28babdc00e9f17ddaa44a95085d1517efdd83f39db64ef1885de"} Jul 01 19:24:20.415763 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:20.415727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:21.256417 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:21.256391 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dqnf7" Jul 01 19:24:22.809326 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:22.809296 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.054371 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.054340 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf"] Jul 01 19:24:23.056351 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.056336 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.059621 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.059553 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7wr2k\"" Jul 01 19:24:23.059621 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.059612 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:24:23.059790 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.059609 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 19:24:23.059790 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.059651 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:24:23.059790 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.059619 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:24:23.059790 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.059710 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:24:23.071423 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.071398 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf"] Jul 01 19:24:23.072473 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.072452 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7t5hp"] Jul 01 19:24:23.074538 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.074519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.076743 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.076726 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:24:23.076885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.076727 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:24:23.076990 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.076944 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:24:23.076990 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.076956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfs88\"" Jul 01 19:24:23.097781 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.097754 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.188983 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.188953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.189108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.188988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1004630f-99aa-4dd6-a6f7-06aac0137d3d-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.189108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-sys\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnphn\" (UniqueName: \"kubernetes.io/projected/90b4cddc-fbe5-4622-a559-9b941b44fb32-kube-api-access-vnphn\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-wtmp\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-tls\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-accelerators-collector-config\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6nl7\" (UniqueName: \"kubernetes.io/projected/1004630f-99aa-4dd6-a6f7-06aac0137d3d-kube-api-access-f6nl7\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.189302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.189302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-root\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189451 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b4cddc-fbe5-4622-a559-9b941b44fb32-metrics-client-ca\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.189451 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.189327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-textfile\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.198297 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.198240 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.289653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-sys\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.289803 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnphn\" (UniqueName: \"kubernetes.io/projected/90b4cddc-fbe5-4622-a559-9b941b44fb32-kube-api-access-vnphn\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.289803 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-wtmp\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.289803 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-tls\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.289803 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-sys\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.289803 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-accelerators-collector-config\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.289803 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6nl7\" (UniqueName: \"kubernetes.io/projected/1004630f-99aa-4dd6-a6f7-06aac0137d3d-kube-api-access-f6nl7\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-wtmp\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-root\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:23.289879 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b4cddc-fbe5-4622-a559-9b941b44fb32-metrics-client-ca\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:23.289938 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-tls podName:90b4cddc-fbe5-4622-a559-9b941b44fb32 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:23.789918747 +0000 UTC m=+114.444765748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-tls") pod "node-exporter-7t5hp" (UID: "90b4cddc-fbe5-4622-a559-9b941b44fb32") : secret "node-exporter-tls" not found Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.289981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-textfile\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:23.289996 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.290119 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:24:23.290044 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-tls podName:1004630f-99aa-4dd6-a6f7-06aac0137d3d nodeName:}" failed. No retries permitted until 2026-07-01 19:24:23.79003264 +0000 UTC m=+114.444879631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-jvzxf" (UID: "1004630f-99aa-4dd6-a6f7-06aac0137d3d") : secret "openshift-state-metrics-tls" not found Jul 01 19:24:23.290707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90b4cddc-fbe5-4622-a559-9b941b44fb32-root\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290346 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-textfile\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1004630f-99aa-4dd6-a6f7-06aac0137d3d-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.290707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-accelerators-collector-config\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b4cddc-fbe5-4622-a559-9b941b44fb32-metrics-client-ca\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.290959 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.290920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1004630f-99aa-4dd6-a6f7-06aac0137d3d-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.292435 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.292411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.292642 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.292623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.297175 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.297131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhrhg" event={"ID":"109c8646-eaed-4ad2-9da4-58aa13cc4926","Type":"ContainerStarted","Data":"9f654eaea0b3ec33721b1faa652954b5223e8eb567c78113de47eaca2e0ce207"} Jul 01 19:24:23.299109 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.299084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.300250 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.300219 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnphn\" (UniqueName: \"kubernetes.io/projected/90b4cddc-fbe5-4622-a559-9b941b44fb32-kube-api-access-vnphn\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.300342 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.300314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6nl7\" (UniqueName: \"kubernetes.io/projected/1004630f-99aa-4dd6-a6f7-06aac0137d3d-kube-api-access-f6nl7\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.316254 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.316183 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hhrhg" podStartSLOduration=34.806743275 podStartE2EDuration="42.316170823s" totalImagesPullingTime="7.509427548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:23.315058485 +0000 UTC m=+113.969905513" watchObservedRunningTime="2026-07-01 19:24:23.316170823 +0000 UTC m=+113.971017834" Jul 01 19:24:23.391103 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.391072 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.473511 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.473447 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.567070 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.566960 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.694518 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.694471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.794236 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.794204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-tls\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.794394 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.794244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.795619 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.795579 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:23.796728 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.796703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1004630f-99aa-4dd6-a6f7-06aac0137d3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-jvzxf\" (UID: \"1004630f-99aa-4dd6-a6f7-06aac0137d3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.796824 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.796747 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b4cddc-fbe5-4622-a559-9b941b44fb32-node-exporter-tls\") pod \"node-exporter-7t5hp\" (UID: \"90b4cddc-fbe5-4622-a559-9b941b44fb32\") " pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.969434 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.969407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" Jul 01 19:24:23.982908 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:23.982884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7t5hp" Jul 01 19:24:23.992220 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:23.992195 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b4cddc_fbe5_4622_a559_9b941b44fb32.slice/crio-8126a45db4b2a169fd2ce92906f53ea9f5564f37a1d719aabef8056e2c3f7032 WatchSource:0}: Error finding container 8126a45db4b2a169fd2ce92906f53ea9f5564f37a1d719aabef8056e2c3f7032: Status 404 returned error can't find the container with id 8126a45db4b2a169fd2ce92906f53ea9f5564f37a1d719aabef8056e2c3f7032 Jul 01 19:24:24.043559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.043525 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:24.129938 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.129863 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf"] Jul 01 19:24:24.132376 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:24.132337 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1004630f_99aa_4dd6_a6f7_06aac0137d3d.slice/crio-e422ee5072947d92edbbc67e0da7bbf774fd1a319438e1c12d085eb41f3869f5 WatchSource:0}: Error finding container e422ee5072947d92edbbc67e0da7bbf774fd1a319438e1c12d085eb41f3869f5: Status 404 returned error can't find the container with id e422ee5072947d92edbbc67e0da7bbf774fd1a319438e1c12d085eb41f3869f5 Jul 01 19:24:24.146192 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.146166 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:24.222396 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.222373 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:24.302074 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.302040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" event={"ID":"1004630f-99aa-4dd6-a6f7-06aac0137d3d","Type":"ContainerStarted","Data":"40eb047b403dda63e41c05fef86afc1d62cafe5f5931e3334cda232781c8cec5"} Jul 01 19:24:24.302256 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.302100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" event={"ID":"1004630f-99aa-4dd6-a6f7-06aac0137d3d","Type":"ContainerStarted","Data":"1521ac16a0d8bcab12ec92a6e753029ac071bb3f8e9129e0cc356dba5e82228d"} Jul 01 19:24:24.302256 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.302124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" event={"ID":"1004630f-99aa-4dd6-a6f7-06aac0137d3d","Type":"ContainerStarted","Data":"e422ee5072947d92edbbc67e0da7bbf774fd1a319438e1c12d085eb41f3869f5"} Jul 01 19:24:24.303151 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:24.303119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7t5hp" event={"ID":"90b4cddc-fbe5-4622-a559-9b941b44fb32","Type":"ContainerStarted","Data":"8126a45db4b2a169fd2ce92906f53ea9f5564f37a1d719aabef8056e2c3f7032"} Jul 01 19:24:25.308333 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:25.308301 2574 generic.go:356] "Generic (PLEG): container finished" podID="90b4cddc-fbe5-4622-a559-9b941b44fb32" containerID="47773ed0efa94d4718c40600e996cc101940a6dc0b285069aa0076e2927dcabb" exitCode=0 Jul 01 19:24:25.308679 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:25.308341 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7t5hp" event={"ID":"90b4cddc-fbe5-4622-a559-9b941b44fb32","Type":"ContainerDied","Data":"47773ed0efa94d4718c40600e996cc101940a6dc0b285069aa0076e2927dcabb"} Jul 01 19:24:26.002360 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.002324 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.067211 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.067184 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84d65f7b74-fmlzr"] Jul 01 19:24:26.069560 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.069545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.072211 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072180 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 19:24:26.072340 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072222 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 19:24:26.072340 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072250 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-71m5sd1hvbhcg\"" Jul 01 19:24:26.072340 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072283 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rw6sx\"" Jul 01 19:24:26.072340 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072222 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 19:24:26.072518 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072502 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 19:24:26.072556 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.072540 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 19:24:26.089196 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.089175 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d65f7b74-fmlzr"] Jul 01 19:24:26.094851 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.094834 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.178796 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.178767 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.215006 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.214979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215110 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215110 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215110 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-tls\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-grpc-tls\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clfm\" (UniqueName: \"kubernetes.io/projected/314dc41e-2b66-4c31-bbf1-ef843b32419d-kube-api-access-6clfm\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.215302 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.215271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/314dc41e-2b66-4c31-bbf1-ef843b32419d-metrics-client-ca\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.278818 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.278761 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.313739 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.313714 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" event={"ID":"1004630f-99aa-4dd6-a6f7-06aac0137d3d","Type":"ContainerStarted","Data":"cfe5a163a4594646b86a492d406f1ce5b4e772e02c36ab3a3155b1595604090a"} Jul 01 19:24:26.315585 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315674 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315674 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315849 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-tls\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315849 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-grpc-tls\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315962 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clfm\" (UniqueName: \"kubernetes.io/projected/314dc41e-2b66-4c31-bbf1-ef843b32419d-kube-api-access-6clfm\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315962 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.315962 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.315927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/314dc41e-2b66-4c31-bbf1-ef843b32419d-metrics-client-ca\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.316709 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.316687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/314dc41e-2b66-4c31-bbf1-ef843b32419d-metrics-client-ca\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.316899 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.316805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7t5hp" event={"ID":"90b4cddc-fbe5-4622-a559-9b941b44fb32","Type":"ContainerStarted","Data":"68e3e1981705dbd9175289c380831ff9a6db4634ecff8a44558ec2b2a776ef44"} Jul 01 19:24:26.316899 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.316857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7t5hp" event={"ID":"90b4cddc-fbe5-4622-a559-9b941b44fb32","Type":"ContainerStarted","Data":"509af1ac4592f4132efa1e192d455116280c41dcf1196ec2d284481767c0a299"} Jul 01 19:24:26.318607 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.318535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.318607 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.318566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.318769 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.318630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-tls\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.318769 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.318707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.318904 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.318885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-grpc-tls\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.319063 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.319044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/314dc41e-2b66-4c31-bbf1-ef843b32419d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.323952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.323932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clfm\" (UniqueName: \"kubernetes.io/projected/314dc41e-2b66-4c31-bbf1-ef843b32419d-kube-api-access-6clfm\") pod \"thanos-querier-84d65f7b74-fmlzr\" (UID: \"314dc41e-2b66-4c31-bbf1-ef843b32419d\") " pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.339106 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.339065 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-jvzxf" podStartSLOduration=2.246405025 podStartE2EDuration="3.339052429s" totalImagesPullingTime="1.092647404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:26.33855543 +0000 UTC m=+116.993402443" watchObservedRunningTime="2026-07-01 19:24:26.339052429 +0000 UTC m=+116.993899442" Jul 01 19:24:26.361021 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.360981 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7t5hp" podStartSLOduration=2.5039812599999998 podStartE2EDuration="3.360970492s" totalImagesPullingTime="793.705101ms" totalInitContainerRuntime="63.284131ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:26.360097776 +0000 UTC m=+117.014944788" watchObservedRunningTime="2026-07-01 19:24:26.360970492 +0000 UTC m=+117.015817505" Jul 01 19:24:26.378744 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.378721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:26.502083 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:26.502058 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d65f7b74-fmlzr"] Jul 01 19:24:26.504286 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:26.504261 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314dc41e_2b66_4c31_bbf1_ef843b32419d.slice/crio-fafb069d3899de466fc304882383031232cd565b389d5130abd740592a502fc6 WatchSource:0}: Error finding container fafb069d3899de466fc304882383031232cd565b389d5130abd740592a502fc6: Status 404 returned error can't find the container with id fafb069d3899de466fc304882383031232cd565b389d5130abd740592a502fc6 Jul 01 19:24:27.323707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.323670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"fafb069d3899de466fc304882383031232cd565b389d5130abd740592a502fc6"} Jul 01 19:24:27.389802 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.389769 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57b679f646-j8pkl"] Jul 01 19:24:27.392017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.391983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.395090 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.395023 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 19:24:27.395235 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.395091 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 19:24:27.396460 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.396438 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-atmichk3qdl5n\"" Jul 01 19:24:27.396460 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.396456 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:24:27.396642 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.396479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f69wk\"" Jul 01 19:24:27.396749 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.396732 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 19:24:27.406063 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.406037 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57b679f646-j8pkl"] Jul 01 19:24:27.526347 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-client-ca-bundle\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.526516 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hklst\" (UniqueName: \"kubernetes.io/projected/74036870-8d9d-40b5-9940-e5b0e4285479-kube-api-access-hklst\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.526516 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-secret-metrics-server-client-certs\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.526516 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74036870-8d9d-40b5-9940-e5b0e4285479-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.526638 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74036870-8d9d-40b5-9940-e5b0e4285479-audit-log\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.526638 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-secret-metrics-server-tls\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.526709 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.526642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74036870-8d9d-40b5-9940-e5b0e4285479-metrics-server-audit-profiles\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627048 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.626980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-client-ca-bundle\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627048 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hklst\" (UniqueName: \"kubernetes.io/projected/74036870-8d9d-40b5-9940-e5b0e4285479-kube-api-access-hklst\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627265 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-secret-metrics-server-client-certs\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627265 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74036870-8d9d-40b5-9940-e5b0e4285479-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627265 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74036870-8d9d-40b5-9940-e5b0e4285479-audit-log\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627265 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-secret-metrics-server-tls\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627265 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74036870-8d9d-40b5-9940-e5b0e4285479-metrics-server-audit-profiles\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627636 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74036870-8d9d-40b5-9940-e5b0e4285479-audit-log\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.627949 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.627925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74036870-8d9d-40b5-9940-e5b0e4285479-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.628206 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.628187 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74036870-8d9d-40b5-9940-e5b0e4285479-metrics-server-audit-profiles\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.629466 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.629440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-client-ca-bundle\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.629626 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.629607 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-secret-metrics-server-tls\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.629665 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.629651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74036870-8d9d-40b5-9940-e5b0e4285479-secret-metrics-server-client-certs\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.635766 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.635747 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hklst\" (UniqueName: \"kubernetes.io/projected/74036870-8d9d-40b5-9940-e5b0e4285479-kube-api-access-hklst\") pod \"metrics-server-57b679f646-j8pkl\" (UID: \"74036870-8d9d-40b5-9940-e5b0e4285479\") " pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.702972 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.702928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:27.832342 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.832313 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:27.847426 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:27.847400 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57b679f646-j8pkl"] Jul 01 19:24:27.850617 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:27.850594 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74036870_8d9d_40b5_9940_e5b0e4285479.slice/crio-70b9544a6113f78f2c189e6c44177582acd2005edb41cdbc40fb7096d40cca3f WatchSource:0}: Error finding container 70b9544a6113f78f2c189e6c44177582acd2005edb41cdbc40fb7096d40cca3f: Status 404 returned error can't find the container with id 70b9544a6113f78f2c189e6c44177582acd2005edb41cdbc40fb7096d40cca3f Jul 01 19:24:28.328042 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:28.328004 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" event={"ID":"74036870-8d9d-40b5-9940-e5b0e4285479","Type":"ContainerStarted","Data":"70b9544a6113f78f2c189e6c44177582acd2005edb41cdbc40fb7096d40cca3f"} Jul 01 19:24:28.556023 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:28.555979 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:29.278479 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.278444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:29.280339 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.280313 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:24:29.283527 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.283510 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.286199 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286179 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:24:29.286377 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286335 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nqgbv\"" Jul 01 19:24:29.286377 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286335 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:24:29.286529 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286459 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:24:29.286529 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286492 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:24:29.286625 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:24:29.286757 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286732 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:24:29.286847 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.286758 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:24:29.287431 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.287412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:24:29.287527 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.287435 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:24:29.287527 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.287439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:24:29.287720 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.287702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:24:29.287771 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.287720 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3gdjall9ho15s\"" Jul 01 19:24:29.287771 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.287737 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:24:29.291673 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.291649 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:24:29.293797 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.293777 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:24:29.303560 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.303536 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:24:29.334587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.334552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"2f331ee3f4b3a1408de345825f9cdb7f546d64e357dcf70e44591c08ab4c3ae6"} Jul 01 19:24:29.335016 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.334633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"b464d1139ef2820449bcabbc60bf48c35586cb8921d30abd10ff4b85df6c8b40"} Jul 01 19:24:29.335016 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.334675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"3bac6e07eb145e62f4498d1da3d903b67092b318764349eff089315e64253b7f"} Jul 01 19:24:29.441154 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441154 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441559 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.441722 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.441702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28cdd\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-kube-api-access-28cdd\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542493 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542493 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542493 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542699 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542699 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28cdd\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-kube-api-access-28cdd\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542699 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542699 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542699 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.542936 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.542886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.543901 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.543881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.544461 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.544436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.545113 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.545087 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.545479 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.545452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.545882 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.545858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.545989 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.545966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.546397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.546569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.546932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.546993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.547222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.547982 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548506 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.548299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.548635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.548718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.548888 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.548729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.549030 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.548889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.550543 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.550520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.551010 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.550994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28cdd\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-kube-api-access-28cdd\") pod \"prometheus-k8s-0\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.595020 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.594989 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:29.731168 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.731125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:24:29.733907 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:29.733877 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc2b59c_a1fc_4df7_acc0_a6304d03e3d5.slice/crio-1150d5b03147192b768ec0ba5d68a029590725f9ce99971f7461ba4e3ea1c34d WatchSource:0}: Error finding container 1150d5b03147192b768ec0ba5d68a029590725f9ce99971f7461ba4e3ea1c34d: Status 404 returned error can't find the container with id 1150d5b03147192b768ec0ba5d68a029590725f9ce99971f7461ba4e3ea1c34d Jul 01 19:24:29.971055 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:29.970994 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.093029 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.092977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.159589 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.159543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.340492 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.340470 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"90d12a669fd49672b2d6354feda7e0ed60ec8b0cab3fe16ec749c710858a13bd"} Jul 01 19:24:30.340866 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.340545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"f7160ede5c508185a12ad539840c02a9bc5c2fbf93de91b36e623d68a8b3a26e"} Jul 01 19:24:30.341886 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.341855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" event={"ID":"74036870-8d9d-40b5-9940-e5b0e4285479","Type":"ContainerStarted","Data":"60e47b95c364c8d4555a122af449a045b2f58d6e9e236a9e612b88e917da2c61"} Jul 01 19:24:30.343118 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.343092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"1150d5b03147192b768ec0ba5d68a029590725f9ce99971f7461ba4e3ea1c34d"} Jul 01 19:24:30.421998 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.421959 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.518465 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.518378 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.806590 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:30.806493 2574 scope.go:117] "RemoveContainer" containerID="6c4b105d52f756398353bcbabbc98bea7ff010da835ad4c81219d9631d5042d6" Jul 01 19:24:31.347794 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.347765 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" exitCode=0 Jul 01 19:24:31.348224 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.347859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} Jul 01 19:24:31.351668 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.351645 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" event={"ID":"314dc41e-2b66-4c31-bbf1-ef843b32419d","Type":"ContainerStarted","Data":"a16720aa53b594175ac9d713ccf2dbad9d0c38b08198836ddee06e7cd3a0753a"} Jul 01 19:24:31.351826 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.351811 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:31.353481 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.353464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:24:31.353582 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.353565 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" event={"ID":"49438452-63fa-4c59-b2fc-bb97b5a0a05a","Type":"ContainerStarted","Data":"9a0d28ffd1ef0c273ebeb0f004cad4ae8d593b6f98a56d33cd07cc677d58a30e"} Jul 01 19:24:31.353880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.353861 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:24:31.380450 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.380365 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" podStartSLOduration=2.762335211 podStartE2EDuration="4.380349499s" totalImagesPullingTime="1.618014288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:30.363767127 +0000 UTC m=+121.018614141" watchObservedRunningTime="2026-07-01 19:24:31.380349499 +0000 UTC m=+122.035196491" Jul 01 19:24:31.396397 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.396353 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" podStartSLOduration=49.279944591 podStartE2EDuration="53.396339826s" totalImagesPullingTime="4.116395235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:31.396208937 +0000 UTC m=+122.051055951" watchObservedRunningTime="2026-07-01 19:24:31.396339826 +0000 UTC m=+122.051186849" Jul 01 19:24:31.418615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.418575 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" podStartSLOduration=1.9607494939999999 podStartE2EDuration="5.418562315s" totalImagesPullingTime="3.457812821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:31.41764227 +0000 UTC m=+122.072489282" watchObservedRunningTime="2026-07-01 19:24:31.418562315 +0000 UTC m=+122.073409322" Jul 01 19:24:31.450846 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.450822 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9qrbk" Jul 01 19:24:31.645191 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.645118 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:31.739657 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.739622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:31.931289 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:31.931258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.109921 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.109888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.209384 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.209304 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.310465 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.310434 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.368475 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.368446 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.538497 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.538410 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.642707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.642669 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:32.740693 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:32.740659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:33.331303 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:33.331275 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:33.519022 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:33.518984 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:33.714426 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:33.714385 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:34.741133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:34.741098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:34.841086 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:34.841055 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:35.372149 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.372105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} Jul 01 19:24:35.372312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.372221 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} Jul 01 19:24:35.372312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.372253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} Jul 01 19:24:35.372312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.372281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} Jul 01 19:24:35.372312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.372307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} Jul 01 19:24:35.372428 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.372337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerStarted","Data":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} Jul 01 19:24:35.405812 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:35.405756 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.973130337 podStartE2EDuration="6.40573414s" totalImagesPullingTime="4.41406671s" totalInitContainerRuntime="18.537093ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:35.403064949 +0000 UTC m=+126.057911967" watchObservedRunningTime="2026-07-01 19:24:35.40573414 +0000 UTC m=+126.060581154" Jul 01 19:24:37.363702 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:37.363672 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84d65f7b74-fmlzr" Jul 01 19:24:38.629910 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:38.629869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:24:38.632134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:38.632114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f40220c1-4697-4a0f-ab9c-a43a97e3cb98-metrics-certs\") pod \"network-metrics-daemon-vw95m\" (UID: \"f40220c1-4697-4a0f-ab9c-a43a97e3cb98\") " pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:24:38.824323 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:38.824292 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsxvz\"" Jul 01 19:24:38.832228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:38.832204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vw95m" Jul 01 19:24:38.962272 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:38.962245 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vw95m"] Jul 01 19:24:38.964887 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:24:38.964861 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40220c1_4697_4a0f_ab9c_a43a97e3cb98.slice/crio-b95262e7f95e895039a5bd2c583f97b343476cbd661759412c396894bc40ecea WatchSource:0}: Error finding container b95262e7f95e895039a5bd2c583f97b343476cbd661759412c396894bc40ecea: Status 404 returned error can't find the container with id b95262e7f95e895039a5bd2c583f97b343476cbd661759412c396894bc40ecea Jul 01 19:24:39.390340 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:39.390309 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vw95m" event={"ID":"f40220c1-4697-4a0f-ab9c-a43a97e3cb98","Type":"ContainerStarted","Data":"b95262e7f95e895039a5bd2c583f97b343476cbd661759412c396894bc40ecea"} Jul 01 19:24:39.409730 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:39.409701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:39.472968 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:39.472932 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:39.595810 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:39.595780 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:40.395366 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:40.395325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vw95m" event={"ID":"f40220c1-4697-4a0f-ab9c-a43a97e3cb98","Type":"ContainerStarted","Data":"ce9c955fa6e91885cc111fc87474c3ef37d192f41356ec3cad472c6213a81294"} Jul 01 19:24:40.395714 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:40.395414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vw95m" event={"ID":"f40220c1-4697-4a0f-ab9c-a43a97e3cb98","Type":"ContainerStarted","Data":"8485c204a573679c7e2e1da792712f3f878ed3c5fb04d3bdd78c3db29cdc86b7"} Jul 01 19:24:40.413949 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:40.413898 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vw95m" podStartSLOduration=129.453231744 podStartE2EDuration="2m10.413882597s" totalImagesPullingTime="960.650853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:40.412261805 +0000 UTC m=+131.067108829" watchObservedRunningTime="2026-07-01 19:24:40.413882597 +0000 UTC m=+131.068729610" Jul 01 19:24:40.512939 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:40.512908 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:40.580272 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:40.580241 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:42.168914 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:42.168879 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:42.270456 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:42.270427 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:46.424155 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:46.424117 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:46.522894 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:46.522863 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:47.180056 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:47.180022 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:47.280247 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:47.280215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:47.703155 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:47.703119 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:47.703626 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:47.703226 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:24:48.091768 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:48.091685 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.154171 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:48.154121 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.234473 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:48.234441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.490983 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:48.490950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.592947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:48.592919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.949194 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:50.949132 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:51.049323 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:51.049295 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:53.940796 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:53.940763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:54.041129 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:54.041082 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:54.139481 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:54.139445 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:57.990074 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:57.990045 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:58.079003 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:24:58.078964 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:01.427413 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:01.427375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:01.548691 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:01.548655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:07.708572 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:07.708540 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:25:07.712396 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:07.712371 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57b679f646-j8pkl" Jul 01 19:25:15.531654 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:15.531623 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9def05b-c9e7-477b-a07c-d7419f4ed708" containerID="78d5927635b2a6f4887456759c508be904dc51c3f6a81ea3ee517e5dc368e3bd" exitCode=0 Jul 01 19:25:15.532133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:15.531700 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" event={"ID":"e9def05b-c9e7-477b-a07c-d7419f4ed708","Type":"ContainerDied","Data":"78d5927635b2a6f4887456759c508be904dc51c3f6a81ea3ee517e5dc368e3bd"} Jul 01 19:25:15.532133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:15.532072 2574 scope.go:117] "RemoveContainer" containerID="78d5927635b2a6f4887456759c508be904dc51c3f6a81ea3ee517e5dc368e3bd" Jul 01 19:25:16.537671 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:16.537637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2g7w5" event={"ID":"e9def05b-c9e7-477b-a07c-d7419f4ed708","Type":"ContainerStarted","Data":"0a2a18ba8c178c4fe50870c56717071446b15badac275c18bf579f93785079be"} Jul 01 19:25:20.085981 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:20.085935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:20.195330 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:20.195303 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:29.595763 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:29.595682 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:29.611081 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:29.611050 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:30.605153 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:30.605115 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:35.082112 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:35.082077 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:42.342730 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:42.342690 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:42.439900 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:42.439864 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:47.748262 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748229 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:25:47.748692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748500 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="prometheus" containerID="cri-o://56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" gracePeriod=600 Jul 01 19:25:47.748692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748525 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="thanos-sidecar" containerID="cri-o://bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" gracePeriod=600 Jul 01 19:25:47.748692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748550 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-web" containerID="cri-o://2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" gracePeriod=600 Jul 01 19:25:47.748692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748588 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="config-reloader" containerID="cri-o://baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" gracePeriod=600 Jul 01 19:25:47.748692 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748597 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" gracePeriod=600 Jul 01 19:25:47.748943 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.748529 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy" containerID="cri-o://548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" gracePeriod=600 Jul 01 19:25:47.984599 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:47.984576 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.113642 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113567 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-db\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113642 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113611 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-grpc-tls\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113646 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113685 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113730 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-1\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113765 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-metrics-client-certs\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113792 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-serving-certs-ca-bundle\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113821 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config-out\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.113868 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113849 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-trusted-ca-bundle\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113887 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-tls\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113916 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-metrics-client-ca\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28cdd\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-kube-api-access-28cdd\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.113985 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-thanos-prometheus-http-client-file\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114014 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-0\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114075 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-web-config\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114102 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-kubelet-serving-ca-bundle\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114133 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114127 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-kube-rbac-proxy\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114535 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114211 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-tls-assets\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114535 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114238 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114535 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114272 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-2\") pod \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\" (UID: \"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5\") " Jul 01 19:25:48.114535 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114427 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.114535 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114502 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.114996 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114880 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.114996 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.114916 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.115740 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.115552 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:48.115842 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.115780 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.115940 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.115969 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.115986 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.116001 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-metrics-client-ca\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.116008 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.116016 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.116306 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.116030 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-db\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.116707 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.116633 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:48.116966 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.116936 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.117645 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.117608 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.117784 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.117761 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.118362 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.118338 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config-out" (OuterVolumeSpecName: "config-out") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:48.118460 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.118379 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.118460 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.118404 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.118639 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.118612 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-kube-api-access-28cdd" (OuterVolumeSpecName: "kube-api-access-28cdd") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "kube-api-access-28cdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:48.118911 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.118885 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:48.118979 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.118925 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.119290 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.119269 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config" (OuterVolumeSpecName: "config") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.119665 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.119646 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.128318 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.128294 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-web-config" (OuterVolumeSpecName: "web-config") pod "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" (UID: "ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:48.217106 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217059 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-metrics-client-certs\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217106 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217100 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config-out\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217106 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217110 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217106 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217121 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28cdd\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-kube-api-access-28cdd\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217130 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217158 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217166 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-web-config\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217176 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-kube-rbac-proxy\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217183 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-tls-assets\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217192 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-config\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217199 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217209 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-grpc-tls\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217217 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.217373 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.217226 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:25:48.663596 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663559 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" exitCode=0 Jul 01 19:25:48.663596 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663586 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" exitCode=0 Jul 01 19:25:48.663596 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663596 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" exitCode=0 Jul 01 19:25:48.663596 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663603 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" exitCode=0 Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663611 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" exitCode=0 Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663618 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" exitCode=0 Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663635 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663640 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663744 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663789 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} Jul 01 19:25:48.663856 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} Jul 01 19:25:48.664278 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.663890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5","Type":"ContainerDied","Data":"1150d5b03147192b768ec0ba5d68a029590725f9ce99971f7461ba4e3ea1c34d"} Jul 01 19:25:48.672557 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.672447 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.679343 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.679328 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.685660 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.685644 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.688779 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.688759 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:25:48.692593 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.692564 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.697849 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.697827 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:25:48.699429 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.699414 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.706227 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.706209 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.712702 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.712687 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.712946 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.712928 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.712997 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.712953 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} err="failed to get container status \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" Jul 01 19:25:48.712997 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.712985 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.713222 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.713197 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.713291 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.713231 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} err="failed to get container status \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" Jul 01 19:25:48.713291 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.713253 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.713491 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.713474 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.713530 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.713500 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} err="failed to get container status \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" Jul 01 19:25:48.713530 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.713514 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.713751 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.713734 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.713793 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.713757 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} err="failed to get container status \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" Jul 01 19:25:48.713793 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.713771 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.714025 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.714009 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.714088 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714041 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} err="failed to get container status \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" Jul 01 19:25:48.714088 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714060 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.714312 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.714296 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.714359 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714316 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} err="failed to get container status \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" Jul 01 19:25:48.714359 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714330 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.714553 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:25:48.714537 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.714596 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714559 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} err="failed to get container status \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" Jul 01 19:25:48.714596 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714573 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.714776 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714759 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} err="failed to get container status \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" Jul 01 19:25:48.714836 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714777 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.714993 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714976 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} err="failed to get container status \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" Jul 01 19:25:48.715038 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.714996 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.715211 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715194 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} err="failed to get container status \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" Jul 01 19:25:48.715287 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715213 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.715431 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715415 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} err="failed to get container status \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" Jul 01 19:25:48.715503 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715432 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.715644 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715629 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} err="failed to get container status \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" Jul 01 19:25:48.715702 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715645 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.715841 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715826 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} err="failed to get container status \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" Jul 01 19:25:48.715904 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.715841 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.716061 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716042 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} err="failed to get container status \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" Jul 01 19:25:48.716101 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716062 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.716281 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716264 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} err="failed to get container status \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" Jul 01 19:25:48.716343 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716281 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.716515 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716500 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} err="failed to get container status \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" Jul 01 19:25:48.716575 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716517 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.716694 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716678 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} err="failed to get container status \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" Jul 01 19:25:48.716762 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716697 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.716894 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716879 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} err="failed to get container status \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" Jul 01 19:25:48.716961 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.716895 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.717115 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717094 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} err="failed to get container status \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" Jul 01 19:25:48.717182 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717115 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.717347 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717331 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} err="failed to get container status \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" Jul 01 19:25:48.717410 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717348 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.717541 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717525 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} err="failed to get container status \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" Jul 01 19:25:48.717605 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717543 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.717724 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717709 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} err="failed to get container status \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" Jul 01 19:25:48.717784 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717726 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.717913 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717891 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} err="failed to get container status \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" Jul 01 19:25:48.717964 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.717913 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.718122 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718105 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} err="failed to get container status \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" Jul 01 19:25:48.718186 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718123 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.718348 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718332 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} err="failed to get container status \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" Jul 01 19:25:48.718412 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718350 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.718544 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718514 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} err="failed to get container status \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" Jul 01 19:25:48.718544 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718535 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.718717 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718702 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} err="failed to get container status \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" Jul 01 19:25:48.718760 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718717 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.718911 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718896 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} err="failed to get container status \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" Jul 01 19:25:48.718952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.718911 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.719093 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719077 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} err="failed to get container status \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" Jul 01 19:25:48.719132 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719093 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.719310 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719284 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} err="failed to get container status \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" Jul 01 19:25:48.719363 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719310 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.719525 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719509 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} err="failed to get container status \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" Jul 01 19:25:48.719525 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719525 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.719716 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719701 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} err="failed to get container status \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" Jul 01 19:25:48.719798 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719716 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.719906 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719889 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} err="failed to get container status \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" Jul 01 19:25:48.719945 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.719907 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.720128 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720109 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} err="failed to get container status \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" Jul 01 19:25:48.720197 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720128 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.720337 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720321 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} err="failed to get container status \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" Jul 01 19:25:48.720383 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720336 2574 scope.go:117] "RemoveContainer" containerID="650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370" Jul 01 19:25:48.720539 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720523 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370"} err="failed to get container status \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": rpc error: code = NotFound desc = could not find container \"650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370\": container with ID starting with 650f1f71c73980e23f85811dae45ce69ac99f53339772053661e403bd7925370 not found: ID does not exist" Jul 01 19:25:48.720586 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720538 2574 scope.go:117] "RemoveContainer" containerID="548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef" Jul 01 19:25:48.720755 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720739 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef"} err="failed to get container status \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": rpc error: code = NotFound desc = could not find container \"548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef\": container with ID starting with 548479cde146415412de138d1c19df22fb33b6b70c4377110937213127ca1aef not found: ID does not exist" Jul 01 19:25:48.720792 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720756 2574 scope.go:117] "RemoveContainer" containerID="2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef" Jul 01 19:25:48.720935 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720920 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef"} err="failed to get container status \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": rpc error: code = NotFound desc = could not find container \"2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef\": container with ID starting with 2c2293c946bd9bfbcf2f43419a458798fb7b2c3bec2ec11f529fd2ec87e43aef not found: ID does not exist" Jul 01 19:25:48.720978 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.720934 2574 scope.go:117] "RemoveContainer" containerID="bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544" Jul 01 19:25:48.721112 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721098 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544"} err="failed to get container status \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": rpc error: code = NotFound desc = could not find container \"bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544\": container with ID starting with bc244aee0555247af485e6d576bd9c74c1dfba7c13a0d8393ee6bda068074544 not found: ID does not exist" Jul 01 19:25:48.721173 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721112 2574 scope.go:117] "RemoveContainer" containerID="baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687" Jul 01 19:25:48.721301 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721286 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687"} err="failed to get container status \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": rpc error: code = NotFound desc = could not find container \"baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687\": container with ID starting with baf993246ea57097baa000bb08f2e2e927014df23f4ddd9b2f0f26561c390687 not found: ID does not exist" Jul 01 19:25:48.721345 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721303 2574 scope.go:117] "RemoveContainer" containerID="56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49" Jul 01 19:25:48.721476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721459 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49"} err="failed to get container status \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": rpc error: code = NotFound desc = could not find container \"56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49\": container with ID starting with 56686b6c1c74e6d4da2582596e52b6aa7bde623210b5ae7e22872c993e233e49 not found: ID does not exist" Jul 01 19:25:48.721522 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721476 2574 scope.go:117] "RemoveContainer" containerID="7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de" Jul 01 19:25:48.721660 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.721646 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de"} err="failed to get container status \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": rpc error: code = NotFound desc = could not find container \"7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de\": container with ID starting with 7ed3d73b335eade43a554881131219179432e86e0dfded17c6de0e613311e3de not found: ID does not exist" Jul 01 19:25:48.754879 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.754851 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:25:48.755312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755300 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="config-reloader" Jul 01 19:25:48.755375 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755320 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="config-reloader" Jul 01 19:25:48.755375 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755339 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="init-config-reloader" Jul 01 19:25:48.755375 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755350 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="init-config-reloader" Jul 01 19:25:48.755375 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755361 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy" Jul 01 19:25:48.755375 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755371 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755384 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="prometheus" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755395 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="prometheus" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755406 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="thanos-sidecar" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755415 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="thanos-sidecar" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755426 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-web" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755434 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-web" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755443 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-thanos" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755451 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-thanos" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755537 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-web" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755551 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="config-reloader" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755561 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy-thanos" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755570 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="prometheus" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755581 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="kube-rbac-proxy" Jul 01 19:25:48.755615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.755590 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" containerName="thanos-sidecar" Jul 01 19:25:48.761313 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.761290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.765103 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:25:48.765346 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765104 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:25:48.765346 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:25:48.765346 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nqgbv\"" Jul 01 19:25:48.765587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765471 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:25:48.765587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765471 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:25:48.765587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765499 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:25:48.765587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765526 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:25:48.765587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765544 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:25:48.765587 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765527 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:25:48.766026 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765609 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3gdjall9ho15s\"" Jul 01 19:25:48.766026 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765694 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:25:48.766026 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765706 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:25:48.766026 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.765830 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:25:48.768349 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.768329 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:25:48.771324 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.771305 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:25:48.779209 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.779189 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:25:48.923117 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0e0e1f-53dc-4604-a81e-92abd040eee9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923117 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923117 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4plfb\" (UniqueName: \"kubernetes.io/projected/3d0e0e1f-53dc-4604-a81e-92abd040eee9-kube-api-access-4plfb\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0e0e1f-53dc-4604-a81e-92abd040eee9-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923338 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923533 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923533 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923609 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-config\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923609 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923609 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923723 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923754 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923821 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923869 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923924 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.923975 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:48.924022 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:48.923972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.024951 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.024908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.024951 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.024951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025130 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.024982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025130 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025130 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0e0e1f-53dc-4604-a81e-92abd040eee9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025250 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025250 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025250 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025250 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4plfb\" (UniqueName: \"kubernetes.io/projected/3d0e0e1f-53dc-4604-a81e-92abd040eee9-kube-api-access-4plfb\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0e0e1f-53dc-4604-a81e-92abd040eee9-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025418 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-config\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025960 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.025960 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.025939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.026311 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.026282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028099 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028099 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028381 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028449 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028610 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0e0e1f-53dc-4604-a81e-92abd040eee9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028679 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028662 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028832 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028908 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.028908 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.028898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.029458 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.029416 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.029749 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.029727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.030336 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.030317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0e0e1f-53dc-4604-a81e-92abd040eee9-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.031053 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.031034 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-config\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.031230 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.031212 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.031416 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.031400 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0e0e1f-53dc-4604-a81e-92abd040eee9-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.031749 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.031732 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d0e0e1f-53dc-4604-a81e-92abd040eee9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.037063 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.037047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4plfb\" (UniqueName: \"kubernetes.io/projected/3d0e0e1f-53dc-4604-a81e-92abd040eee9-kube-api-access-4plfb\") pod \"prometheus-k8s-0\" (UID: \"3d0e0e1f-53dc-4604-a81e-92abd040eee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.083754 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.083725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:49.229870 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.229846 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:25:49.232379 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:25:49.232345 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0e0e1f_53dc_4604_a81e_92abd040eee9.slice/crio-8993ea414670ef3fabd93bc874f4b863fcfc876d001e045e70c5f3b21021d27c WatchSource:0}: Error finding container 8993ea414670ef3fabd93bc874f4b863fcfc876d001e045e70c5f3b21021d27c: Status 404 returned error can't find the container with id 8993ea414670ef3fabd93bc874f4b863fcfc876d001e045e70c5f3b21021d27c Jul 01 19:25:49.669932 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.669841 2574 generic.go:356] "Generic (PLEG): container finished" podID="3d0e0e1f-53dc-4604-a81e-92abd040eee9" containerID="23da44b70f65a42b88fba25302bafc635c047cdde4cab5118a559ef1934b8cb7" exitCode=0 Jul 01 19:25:49.670059 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.669925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerDied","Data":"23da44b70f65a42b88fba25302bafc635c047cdde4cab5118a559ef1934b8cb7"} Jul 01 19:25:49.670059 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.669994 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"8993ea414670ef3fabd93bc874f4b863fcfc876d001e045e70c5f3b21021d27c"} Jul 01 19:25:49.813922 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:49.813897 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5" path="/var/lib/kubelet/pods/ddc2b59c-a1fc-4df7-acc0-a6304d03e3d5/volumes" Jul 01 19:25:50.677746 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:50.677713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"96686ce0d22b37a19e2ff5f9636dbd0c72b9a2a0cd4e0556518e76b5f24f0316"} Jul 01 19:25:50.677891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:50.677778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"b28dda9e6886fd5b6df606a85c37aab9e2802ce64a7e83efbd396212f6b28c57"} Jul 01 19:25:50.677891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:50.677808 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"e99ccbeca890845a0d0f0fa4e01d7055882e751db4325b8402757db5d12f2df4"} Jul 01 19:25:50.677891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:50.677832 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"1c32185d49b9c5873c0ff2a79a57e7b72786c238246c9b3ab2fbd142c4304ad1"} Jul 01 19:25:50.677891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:50.677855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"3e20b05607b18d9f8e6aa841e4486b16b02f5f0190116921882a26e40739f893"} Jul 01 19:25:50.677891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:50.677887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d0e0e1f-53dc-4604-a81e-92abd040eee9","Type":"ContainerStarted","Data":"b33c86364a07c3781e580afe403e032f3bb5cf2c176eb7e610229e00933e2655"} Jul 01 19:25:52.255689 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:52.255650 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:52.355386 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:52.355334 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:52.456987 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:52.456957 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:52.971249 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:52.971210 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:53.075414 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:53.075383 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:54.084189 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:25:54.084157 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:03.497364 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:03.497330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:37.728261 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:37.728210 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:38.263070 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:38.263029 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:41.630069 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:41.630030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:49.084121 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:49.084082 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:49.099234 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:49.099206 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:49.139588 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:49.139534 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=61.118251523 podStartE2EDuration="1m1.13951168s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.260157ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:50.712656171 +0000 UTC m=+201.367503197" watchObservedRunningTime="2026-07-01 19:26:49.13951168 +0000 UTC m=+259.794358692" Jul 01 19:26:49.917599 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:49.917573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:57.698653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:57.698577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:57.822476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:57.822444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:59.618041 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:59.618006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:59.704949 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:26:59.704914 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:09.679381 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:09.679331 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:09.752826 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:09.752794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:10.761069 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:10.761036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:10.863705 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:10.863674 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:10.962321 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:10.962294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:15.089456 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:15.089421 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:15.189891 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:15.189843 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:16.426430 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:16.426396 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:16.606622 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:16.606590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:16.680640 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:16.680572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:25.465269 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:25.465231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:29.743641 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:29.743608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:27:29.751384 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:29.751355 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:27:29.753807 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:29.753783 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:27:40.174791 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:40.174758 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:53.570529 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:27:53.570492 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:01.694525 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:01.694490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:03.717487 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:03.717438 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:30.086479 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:30.086447 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:30.181875 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:30.181842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:35.768654 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:35.768607 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:35.982697 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:35.982666 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:36.210546 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:36.210514 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:36.306017 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:36.305984 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:36.583923 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:36.583842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:37.029589 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:37.029556 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:37.210853 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:37.210822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:37.311726 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:37.311646 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:37.643225 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:37.643131 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:37.933241 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:37.933213 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:38.123389 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:38.123355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:38.216068 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:28:38.215994 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:39.589807 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:39.589771 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:39.673777 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:39.673747 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:43.645059 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:43.645020 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:43.753314 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:43.753280 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:43.842648 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:43.842620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:43.939812 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:43.939781 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:44.221011 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:44.220937 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:44.320300 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:44.320268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:44.426897 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:29:44.426866 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:13.035970 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:13.035930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:52.501656 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:52.501622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:57.378080 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:57.378046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:57.487408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:57.487361 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:57.627691 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:57.627665 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:57.729996 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:57.729966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:57.829685 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:57.829653 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:57.931195 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:57.931158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:58.177400 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:58.177366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:58.278623 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:30:58.278595 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:08.787043 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:08.787005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:08.881090 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:08.881058 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:08.941977 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:08.941945 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:14.632038 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.632006 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-m5ppj"] Jul 01 19:31:14.635527 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.635509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.638247 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.638217 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 19:31:14.638247 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.638221 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 19:31:14.638454 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.638248 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 19:31:14.639180 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.639165 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zqwb7\"" Jul 01 19:31:14.644485 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.644462 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-m5ppj"] Jul 01 19:31:14.737724 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.737697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8zbr\" (UniqueName: \"kubernetes.io/projected/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-kube-api-access-t8zbr\") pod \"s3-init-m5ppj\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.737889 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.737744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-model-cache\") pod \"s3-init-m5ppj\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.838681 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.838649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-model-cache\") pod \"s3-init-m5ppj\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.838781 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.838709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8zbr\" (UniqueName: \"kubernetes.io/projected/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-kube-api-access-t8zbr\") pod \"s3-init-m5ppj\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.839025 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.839005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-model-cache\") pod \"s3-init-m5ppj\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.848330 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.848305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8zbr\" (UniqueName: \"kubernetes.io/projected/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-kube-api-access-t8zbr\") pod \"s3-init-m5ppj\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " pod="kserve/s3-init-m5ppj" Jul 01 19:31:14.945561 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:14.945535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m5ppj" Jul 01 19:31:15.069163 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:15.069112 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-m5ppj"] Jul 01 19:31:15.072248 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:31:15.072217 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f4859e3_3f5c_4b5f_a07d_b3910882a20f.slice/crio-7c74e56be9181ff2a2a772b8d77f02e0341f1386478765e5bad5f6c05b140efa WatchSource:0}: Error finding container 7c74e56be9181ff2a2a772b8d77f02e0341f1386478765e5bad5f6c05b140efa: Status 404 returned error can't find the container with id 7c74e56be9181ff2a2a772b8d77f02e0341f1386478765e5bad5f6c05b140efa Jul 01 19:31:15.074505 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:15.074492 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:31:15.877216 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:15.877181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m5ppj" event={"ID":"3f4859e3-3f5c-4b5f-a07d-b3910882a20f","Type":"ContainerStarted","Data":"7c74e56be9181ff2a2a772b8d77f02e0341f1386478765e5bad5f6c05b140efa"} Jul 01 19:31:19.897242 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:19.896946 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m5ppj" event={"ID":"3f4859e3-3f5c-4b5f-a07d-b3910882a20f","Type":"ContainerStarted","Data":"57c82398fd6022b521daa9a66de15d2853933192fe7d6e513de066426d655171"} Jul 01 19:31:21.906708 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:21.906678 2574 generic.go:356] "Generic (PLEG): container finished" podID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerID="57c82398fd6022b521daa9a66de15d2853933192fe7d6e513de066426d655171" exitCode=0 Jul 01 19:31:21.907062 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:21.906750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m5ppj" event={"ID":"3f4859e3-3f5c-4b5f-a07d-b3910882a20f","Type":"ContainerDied","Data":"57c82398fd6022b521daa9a66de15d2853933192fe7d6e513de066426d655171"} Jul 01 19:31:26.934802 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:26.934771 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m5ppj" event={"ID":"3f4859e3-3f5c-4b5f-a07d-b3910882a20f","Type":"ContainerStarted","Data":"3a4489f7fdddb030fc6c37098848039c754fe8c8cf8d91ddf34cf864af63162d"} Jul 01 19:31:26.954720 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:31:26.954666 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-m5ppj" podStartSLOduration=2.529966108 podStartE2EDuration="12.954650302s" totalImagesPullingTime="8.658361292s" totalInitContainerRuntime="1.766322902s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:26.953122112 +0000 UTC m=+537.607969124" watchObservedRunningTime="2026-07-01 19:31:26.954650302 +0000 UTC m=+537.609497315" Jul 01 19:32:29.777967 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:29.777939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:32:29.781869 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:29.781848 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:32:32.171206 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:32.171175 2574 generic.go:356] "Generic (PLEG): container finished" podID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerID="3a4489f7fdddb030fc6c37098848039c754fe8c8cf8d91ddf34cf864af63162d" exitCode=0 Jul 01 19:32:32.171571 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:32.171228 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m5ppj" event={"ID":"3f4859e3-3f5c-4b5f-a07d-b3910882a20f","Type":"ContainerDied","Data":"3a4489f7fdddb030fc6c37098848039c754fe8c8cf8d91ddf34cf864af63162d"} Jul 01 19:32:33.293071 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.293045 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m5ppj" Jul 01 19:32:33.396889 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.396847 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8zbr\" (UniqueName: \"kubernetes.io/projected/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-kube-api-access-t8zbr\") pod \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " Jul 01 19:32:33.396889 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.396895 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-model-cache\") pod \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\" (UID: \"3f4859e3-3f5c-4b5f-a07d-b3910882a20f\") " Jul 01 19:32:33.399007 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.398975 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-kube-api-access-t8zbr" (OuterVolumeSpecName: "kube-api-access-t8zbr") pod "3f4859e3-3f5c-4b5f-a07d-b3910882a20f" (UID: "3f4859e3-3f5c-4b5f-a07d-b3910882a20f"). InnerVolumeSpecName "kube-api-access-t8zbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:32:33.415420 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.415395 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f4859e3-3f5c-4b5f-a07d-b3910882a20f" (UID: "3f4859e3-3f5c-4b5f-a07d-b3910882a20f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:32:33.498447 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.498413 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8zbr\" (UniqueName: \"kubernetes.io/projected/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-kube-api-access-t8zbr\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:32:33.498447 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:33.498441 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4859e3-3f5c-4b5f-a07d-b3910882a20f-model-cache\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:32:34.181056 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:34.181033 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m5ppj" Jul 01 19:32:34.181056 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:34.181039 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m5ppj" event={"ID":"3f4859e3-3f5c-4b5f-a07d-b3910882a20f","Type":"ContainerDied","Data":"7c74e56be9181ff2a2a772b8d77f02e0341f1386478765e5bad5f6c05b140efa"} Jul 01 19:32:34.181312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:34.181071 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c74e56be9181ff2a2a772b8d77f02e0341f1386478765e5bad5f6c05b140efa" Jul 01 19:32:34.540197 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:34.540102 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:34.713264 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:34.713236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:45.844003 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:45.843965 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:45.958262 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:32:45.958229 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:33:03.174772 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:33:03.174673 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:41.091653 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:34:41.091619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:43.445466 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:34:43.445431 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:58.185171 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:34:58.185123 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:58.287134 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:34:58.287102 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:35:30.153742 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:35:30.153692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:21.156558 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:21.156476 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:21.293126 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:21.293087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.217736 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.217698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.381602 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.381571 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.478197 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.478071 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.512109 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.512071 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4"] Jul 01 19:36:31.512467 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.512449 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerName="s3-init" Jul 01 19:36:31.512548 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.512469 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerName="s3-init" Jul 01 19:36:31.512548 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.512509 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerName="download-hf-model" Jul 01 19:36:31.512548 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.512520 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerName="download-hf-model" Jul 01 19:36:31.512709 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.512594 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4859e3-3f5c-4b5f-a07d-b3910882a20f" containerName="s3-init" Jul 01 19:36:31.514813 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.514792 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.517358 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.517334 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 01 19:36:31.517358 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.517345 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-31388-predictor-serving-cert\"" Jul 01 19:36:31.517615 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.517595 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 19:36:31.517724 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.517628 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 01 19:36:31.518408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.518380 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 01 19:36:31.518408 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.518401 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-bqdbq\"" Jul 01 19:36:31.518551 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.518447 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-31388-kube-rbac-proxy-sar-config\"" Jul 01 19:36:31.526459 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.526439 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4"] Jul 01 19:36:31.534307 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.534288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.534405 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.534343 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzcn\" (UniqueName: \"kubernetes.io/projected/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-api-access-ptzcn\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.534405 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.534395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.534494 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.534452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.534535 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.534496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.552343 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.552316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.629260 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.629231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.635447 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.635408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.635565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.635479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.635565 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.635530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzcn\" (UniqueName: \"kubernetes.io/projected/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-api-access-ptzcn\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.635685 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.635578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.635685 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.635623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.635904 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.635882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.636251 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.636229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.636334 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.636292 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.637847 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.637828 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.643898 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.643881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzcn\" (UniqueName: \"kubernetes.io/projected/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-api-access-ptzcn\") pod \"isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.744312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.744238 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:31.825092 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.825063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:31.952285 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:31.952260 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4"] Jul 01 19:36:31.954277 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:36:31.954245 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b26b48_6eaf_4f50_b3b7_eacb72cb2272.slice/crio-5f505893283f17d42d60b74d32cc990a49ef667e38d969c6a54cff89deff4ef0 WatchSource:0}: Error finding container 5f505893283f17d42d60b74d32cc990a49ef667e38d969c6a54cff89deff4ef0: Status 404 returned error can't find the container with id 5f505893283f17d42d60b74d32cc990a49ef667e38d969c6a54cff89deff4ef0 Jul 01 19:36:32.058540 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:32.058502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerStarted","Data":"21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738"} Jul 01 19:36:32.058712 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:32.058566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerStarted","Data":"5f505893283f17d42d60b74d32cc990a49ef667e38d969c6a54cff89deff4ef0"} Jul 01 19:36:36.075402 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:36.075370 2574 generic.go:356] "Generic (PLEG): container finished" podID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerID="21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738" exitCode=0 Jul 01 19:36:36.075785 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:36.075439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerDied","Data":"21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738"} Jul 01 19:36:36.076697 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:36.076683 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:36:55.156946 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:55.156862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerStarted","Data":"e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527"} Jul 01 19:36:58.171003 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:58.170958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerStarted","Data":"741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4"} Jul 01 19:36:58.171457 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:58.171175 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:58.171457 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:58.171309 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:36:58.172500 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:58.172470 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:36:58.194120 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:58.194022 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podStartSLOduration=1.857645507 podStartE2EDuration="27.194007417s" totalImagesPullingTime="21.770918356s" totalInitContainerRuntime="3.565443554s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:58.192127898 +0000 UTC m=+868.846974913" watchObservedRunningTime="2026-07-01 19:36:58.194007417 +0000 UTC m=+868.848854429" Jul 01 19:36:59.175374 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:36:59.175332 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:37:04.179876 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:04.179845 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:37:04.180389 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:04.180331 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:37:14.180459 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:14.180419 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:37:18.841564 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:18.841532 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:37:24.180981 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:24.180893 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:37:29.805054 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:29.805025 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:37:29.805744 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:29.805729 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:37:34.181121 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:34.181079 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:37:44.180421 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:44.180382 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:37:54.181352 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:37:54.181320 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:38:11.445019 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:11.444985 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:11.606071 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:11.606038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:11.823331 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:11.823250 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:21.512237 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.512202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:21.675127 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.675081 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:21.763882 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.763801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:21.771501 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.771474 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4"] Jul 01 19:38:21.771762 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.771742 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" containerID="cri-o://e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527" gracePeriod=30 Jul 01 19:38:21.771817 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.771759 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kube-rbac-proxy" containerID="cri-o://741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4" gracePeriod=30 Jul 01 19:38:21.860988 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:21.860953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:22.071622 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:22.071535 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:22.497881 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:22.497847 2574 generic.go:356] "Generic (PLEG): container finished" podID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerID="741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4" exitCode=2 Jul 01 19:38:22.498054 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:22.497919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerDied","Data":"741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4"} Jul 01 19:38:24.176599 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:24.176556 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.20:8643/healthz\": dial tcp 10.133.0.20:8643: connect: connection refused" Jul 01 19:38:24.181128 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:24.181102 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused" Jul 01 19:38:25.210372 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.210349 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:38:25.376772 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.376682 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-rbac-proxy-sar-config\") pod \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " Jul 01 19:38:25.376772 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.376726 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kserve-provision-location\") pod \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " Jul 01 19:38:25.376772 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.376763 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-proxy-tls\") pod \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " Jul 01 19:38:25.377052 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.376783 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-cabundle-cert\") pod \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " Jul 01 19:38:25.377052 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.376804 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptzcn\" (UniqueName: \"kubernetes.io/projected/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-api-access-ptzcn\") pod \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\" (UID: \"58b26b48-6eaf-4f50-b3b7-eacb72cb2272\") " Jul 01 19:38:25.377188 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.377113 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "58b26b48-6eaf-4f50-b3b7-eacb72cb2272" (UID: "58b26b48-6eaf-4f50-b3b7-eacb72cb2272"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:25.377188 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.377122 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "58b26b48-6eaf-4f50-b3b7-eacb72cb2272" (UID: "58b26b48-6eaf-4f50-b3b7-eacb72cb2272"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:38:25.377188 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.377178 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "58b26b48-6eaf-4f50-b3b7-eacb72cb2272" (UID: "58b26b48-6eaf-4f50-b3b7-eacb72cb2272"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:25.379015 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.378993 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "58b26b48-6eaf-4f50-b3b7-eacb72cb2272" (UID: "58b26b48-6eaf-4f50-b3b7-eacb72cb2272"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:38:25.379111 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.379025 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-api-access-ptzcn" (OuterVolumeSpecName: "kube-api-access-ptzcn") pod "58b26b48-6eaf-4f50-b3b7-eacb72cb2272" (UID: "58b26b48-6eaf-4f50-b3b7-eacb72cb2272"). InnerVolumeSpecName "kube-api-access-ptzcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:38:25.477880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.477846 2574 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-proxy-tls\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:38:25.477880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.477874 2574 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-cabundle-cert\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:38:25.478068 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.477883 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptzcn\" (UniqueName: \"kubernetes.io/projected/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-api-access-ptzcn\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:38:25.478068 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.477904 2574 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:38:25.478068 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.477912 2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58b26b48-6eaf-4f50-b3b7-eacb72cb2272-kserve-provision-location\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:38:25.512312 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.512275 2574 generic.go:356] "Generic (PLEG): container finished" podID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerID="e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527" exitCode=0 Jul 01 19:38:25.512453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.512311 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerDied","Data":"e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527"} Jul 01 19:38:25.512453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.512332 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" Jul 01 19:38:25.512453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.512373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4" event={"ID":"58b26b48-6eaf-4f50-b3b7-eacb72cb2272","Type":"ContainerDied","Data":"5f505893283f17d42d60b74d32cc990a49ef667e38d969c6a54cff89deff4ef0"} Jul 01 19:38:25.512453 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.512399 2574 scope.go:117] "RemoveContainer" containerID="741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4" Jul 01 19:38:25.520799 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.520782 2574 scope.go:117] "RemoveContainer" containerID="e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527" Jul 01 19:38:25.527612 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.527596 2574 scope.go:117] "RemoveContainer" containerID="21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738" Jul 01 19:38:25.534108 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.534085 2574 scope.go:117] "RemoveContainer" containerID="741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4" Jul 01 19:38:25.534545 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:38:25.534517 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4\": container with ID starting with 741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4 not found: ID does not exist" containerID="741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4" Jul 01 19:38:25.534643 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.534553 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4"} err="failed to get container status \"741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4\": rpc error: code = NotFound desc = could not find container \"741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4\": container with ID starting with 741946695db14adf04325644963558d2a9982ff0675333ebbd11b15245e909c4 not found: ID does not exist" Jul 01 19:38:25.534643 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.534577 2574 scope.go:117] "RemoveContainer" containerID="e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527" Jul 01 19:38:25.534834 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:38:25.534811 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527\": container with ID starting with e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527 not found: ID does not exist" containerID="e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527" Jul 01 19:38:25.534880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.534841 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527"} err="failed to get container status \"e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527\": rpc error: code = NotFound desc = could not find container \"e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527\": container with ID starting with e70074f25c77fca317f78795ebb5810dda2f7bffaae3eda66111d71257b15527 not found: ID does not exist" Jul 01 19:38:25.534880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.534857 2574 scope.go:117] "RemoveContainer" containerID="21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738" Jul 01 19:38:25.535074 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:38:25.535059 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738\": container with ID starting with 21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738 not found: ID does not exist" containerID="21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738" Jul 01 19:38:25.535119 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.535076 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738"} err="failed to get container status \"21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738\": rpc error: code = NotFound desc = could not find container \"21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738\": container with ID starting with 21f391a14b69fec96afb16b2f5d21df16bb2f22631066a669eb30025a4c46738 not found: ID does not exist" Jul 01 19:38:25.535947 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.535930 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4"] Jul 01 19:38:25.537982 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.537959 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-31388-predictor-57fb4985bf-rg7k4"] Jul 01 19:38:25.811041 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:25.811003 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" path="/var/lib/kubelet/pods/58b26b48-6eaf-4f50-b3b7-eacb72cb2272/volumes" Jul 01 19:38:41.671880 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:41.671847 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:38:41.770682 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:38:41.770652 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:39:32.173393 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:39:32.173357 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:39:32.274253 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:39:32.274222 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:40:16.944952 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:40:16.944917 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:40:18.351907 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:40:18.351873 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:29.834359 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:42:29.834280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:42:29.834863 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:42:29.834738 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:42:57.229182 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:42:57.229127 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:43:02.252268 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:43:02.252227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:43:02.591561 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:43:02.591479 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:32.475218 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:32.475183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:32.692753 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:32.692718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:48.211003 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:48.210955 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:48.570026 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:48.569934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:48.655979 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:48.655944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:53.709553 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:53.709458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:54.162825 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:54.162738 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:44:54.348948 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:44:54.348910 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:45:03.795987 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:45:03.795909 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:45:08.930740 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:45:08.930706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:45:09.143606 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:45:09.143566 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:39.127909 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:46:39.127872 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:44.193198 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:46:44.193166 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:44.421522 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:46:44.421482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:47:29.859157 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:47:29.859119 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:47:29.859700 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:47:29.859270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:48:15.112811 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:15.112774 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:21.128830 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.128787 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dqhcb/must-gather-gbxzc"] Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129082 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="storage-initializer" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129093 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="storage-initializer" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129104 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kube-rbac-proxy" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129113 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kube-rbac-proxy" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129122 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129128 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129211 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kserve-container" Jul 01 19:48:21.129228 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.129224 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b26b48-6eaf-4f50-b3b7-eacb72cb2272" containerName="kube-rbac-proxy" Jul 01 19:48:21.132068 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.132041 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:21.132298 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.132283 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.137238 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.137220 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dqhcb\"/\"openshift-service-ca.crt\"" Jul 01 19:48:21.137331 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.137220 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dqhcb\"/\"default-dockercfg-fn4kg\"" Jul 01 19:48:21.137331 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.137220 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dqhcb\"/\"kube-root-ca.crt\"" Jul 01 19:48:21.150696 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.150671 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dqhcb/must-gather-gbxzc"] Jul 01 19:48:21.195294 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.195266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62bkp\" (UniqueName: \"kubernetes.io/projected/bd79b888-4836-4be6-a490-97196bcd5fa5-kube-api-access-62bkp\") pod \"must-gather-gbxzc\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.195403 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.195300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd79b888-4836-4be6-a490-97196bcd5fa5-must-gather-output\") pod \"must-gather-gbxzc\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.227405 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.227375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:21.296160 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.296114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62bkp\" (UniqueName: \"kubernetes.io/projected/bd79b888-4836-4be6-a490-97196bcd5fa5-kube-api-access-62bkp\") pod \"must-gather-gbxzc\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.296291 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.296177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd79b888-4836-4be6-a490-97196bcd5fa5-must-gather-output\") pod \"must-gather-gbxzc\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.296515 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.296495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd79b888-4836-4be6-a490-97196bcd5fa5-must-gather-output\") pod \"must-gather-gbxzc\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.304680 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.304653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62bkp\" (UniqueName: \"kubernetes.io/projected/bd79b888-4836-4be6-a490-97196bcd5fa5-kube-api-access-62bkp\") pod \"must-gather-gbxzc\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.441777 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.441747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:21.592695 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.592664 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dqhcb/must-gather-gbxzc"] Jul 01 19:48:21.596332 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:48:21.596307 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd79b888_4836_4be6_a490_97196bcd5fa5.slice/crio-9dc5f112251f386eeae5166a70718821380b1d20ddee6ce19372ef92b8c269cc WatchSource:0}: Error finding container 9dc5f112251f386eeae5166a70718821380b1d20ddee6ce19372ef92b8c269cc: Status 404 returned error can't find the container with id 9dc5f112251f386eeae5166a70718821380b1d20ddee6ce19372ef92b8c269cc Jul 01 19:48:21.598358 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.598342 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:48:21.726353 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:21.726265 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" event={"ID":"bd79b888-4836-4be6-a490-97196bcd5fa5","Type":"ContainerStarted","Data":"9dc5f112251f386eeae5166a70718821380b1d20ddee6ce19372ef92b8c269cc"} Jul 01 19:48:28.763894 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:28.763857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" event={"ID":"bd79b888-4836-4be6-a490-97196bcd5fa5","Type":"ContainerStarted","Data":"8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb"} Jul 01 19:48:28.764365 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:28.763905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" event={"ID":"bd79b888-4836-4be6-a490-97196bcd5fa5","Type":"ContainerStarted","Data":"7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6"} Jul 01 19:48:28.787896 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:28.787844 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" podStartSLOduration=1.6108168040000002 podStartE2EDuration="7.787831217s" totalImagesPullingTime="6.177014413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:28.786349538 +0000 UTC m=+1559.441196556" watchObservedRunningTime="2026-07-01 19:48:28.787831217 +0000 UTC m=+1559.442678230" Jul 01 19:48:46.847096 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:46.847061 2574 generic.go:356] "Generic (PLEG): container finished" podID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerID="7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6" exitCode=0 Jul 01 19:48:46.847096 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:46.847099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" event={"ID":"bd79b888-4836-4be6-a490-97196bcd5fa5","Type":"ContainerDied","Data":"7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6"} Jul 01 19:48:46.847549 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:46.847407 2574 scope.go:117] "RemoveContainer" containerID="7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6" Jul 01 19:48:47.022632 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:47.022600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dqhcb_must-gather-gbxzc_bd79b888-4836-4be6-a490-97196bcd5fa5/gather/0.log" Jul 01 19:48:47.456123 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:47.456080 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:47.603149 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:47.603056 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:47.667930 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:47.667893 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:50.305151 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:50.305116 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7jmz8_2b1e295d-c532-4450-80d7-f9fa421f9d1d/global-pull-secret-syncer/0.log" Jul 01 19:48:50.421437 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:50.421410 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" Jul 01 19:48:50.555885 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:50.555803 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-179.ec2.internal_d1791cf5791cda6f6876965b4b0ae27a/haproxy/0.log" Jul 01 19:48:52.429272 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.429238 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-dqhcb/must-gather-gbxzc"] Jul 01 19:48:52.429729 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.429417 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="copy" containerID="cri-o://8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb" gracePeriod=2 Jul 01 19:48:52.432403 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:48:52.432364 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gbxzc\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dqhcb\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:52.433544 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.433324 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-dqhcb/must-gather-gbxzc"] Jul 01 19:48:52.656705 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.656680 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dqhcb_must-gather-gbxzc_bd79b888-4836-4be6-a490-97196bcd5fa5/copy/0.log" Jul 01 19:48:52.658412 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.658395 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:52.660722 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:48:52.660698 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gbxzc\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dqhcb\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:52.769413 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.769329 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd79b888-4836-4be6-a490-97196bcd5fa5-must-gather-output\") pod \"bd79b888-4836-4be6-a490-97196bcd5fa5\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " Jul 01 19:48:52.769554 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.769440 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62bkp\" (UniqueName: \"kubernetes.io/projected/bd79b888-4836-4be6-a490-97196bcd5fa5-kube-api-access-62bkp\") pod \"bd79b888-4836-4be6-a490-97196bcd5fa5\" (UID: \"bd79b888-4836-4be6-a490-97196bcd5fa5\") " Jul 01 19:48:52.770552 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.770516 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd79b888-4836-4be6-a490-97196bcd5fa5-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bd79b888-4836-4be6-a490-97196bcd5fa5" (UID: "bd79b888-4836-4be6-a490-97196bcd5fa5"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:48:52.771584 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.771565 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd79b888-4836-4be6-a490-97196bcd5fa5-kube-api-access-62bkp" (OuterVolumeSpecName: "kube-api-access-62bkp") pod "bd79b888-4836-4be6-a490-97196bcd5fa5" (UID: "bd79b888-4836-4be6-a490-97196bcd5fa5"). InnerVolumeSpecName "kube-api-access-62bkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:48:52.869985 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.869946 2574 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd79b888-4836-4be6-a490-97196bcd5fa5-must-gather-output\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:48:52.870191 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.870047 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62bkp\" (UniqueName: \"kubernetes.io/projected/bd79b888-4836-4be6-a490-97196bcd5fa5-kube-api-access-62bkp\") on node \"ip-10-0-142-179.ec2.internal\" DevicePath \"\"" Jul 01 19:48:52.870334 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.870317 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dqhcb_must-gather-gbxzc_bd79b888-4836-4be6-a490-97196bcd5fa5/copy/0.log" Jul 01 19:48:52.870647 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.870622 2574 generic.go:356] "Generic (PLEG): container finished" podID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerID="8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb" exitCode=143 Jul 01 19:48:52.870738 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.870662 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:52.870738 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.870701 2574 scope.go:117] "RemoveContainer" containerID="8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb" Jul 01 19:48:52.874217 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:48:52.874194 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gbxzc\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dqhcb\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:52.878625 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.878612 2574 scope.go:117] "RemoveContainer" containerID="7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6" Jul 01 19:48:52.885184 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:48:52.885158 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gbxzc\" is forbidden: User \"system:node:ip-10-0-142-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dqhcb\": no relationship found between node 'ip-10-0-142-179.ec2.internal' and this object" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" pod="openshift-must-gather-dqhcb/must-gather-gbxzc" Jul 01 19:48:52.889096 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.889085 2574 scope.go:117] "RemoveContainer" containerID="8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb" Jul 01 19:48:52.889349 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:48:52.889331 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb\": container with ID starting with 8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb not found: ID does not exist" containerID="8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb" Jul 01 19:48:52.889386 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.889360 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb"} err="failed to get container status \"8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb\": rpc error: code = NotFound desc = could not find container \"8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb\": container with ID starting with 8e9e94f46938bd37c07cda8bc179c74828f5033c9ec8198ef4e8d01c5711b4fb not found: ID does not exist" Jul 01 19:48:52.889386 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.889383 2574 scope.go:117] "RemoveContainer" containerID="7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6" Jul 01 19:48:52.889611 ip-10-0-142-179 kubenswrapper[2574]: E0701 19:48:52.889595 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6\": container with ID starting with 7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6 not found: ID does not exist" containerID="7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6" Jul 01 19:48:52.889648 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:52.889615 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6"} err="failed to get container status \"7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6\": rpc error: code = NotFound desc = could not find container \"7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6\": container with ID starting with 7a3371b1b122c0db58eb64067e552c63314ffb9a8f560dcc1b04a77b0c3bfeb6 not found: ID does not exist" Jul 01 19:48:53.455821 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:53.455769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:53.528763 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:53.528728 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf668_4d869fa1-fbe0-4a3e-847d-f6b3fbead7b9/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:53.811031 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:53.810953 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" path="/var/lib/kubelet/pods/bd79b888-4836-4be6-a490-97196bcd5fa5/volumes" Jul 01 19:48:54.090055 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.089976 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57b679f646-j8pkl_74036870-8d9d-40b5-9940-e5b0e4285479/metrics-server/0.log" Jul 01 19:48:54.294044 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.294016 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7t5hp_90b4cddc-fbe5-4622-a559-9b941b44fb32/node-exporter/0.log" Jul 01 19:48:54.324117 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.324089 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7t5hp_90b4cddc-fbe5-4622-a559-9b941b44fb32/kube-rbac-proxy/0.log" Jul 01 19:48:54.354574 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.354511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7t5hp_90b4cddc-fbe5-4622-a559-9b941b44fb32/init-textfile/0.log" Jul 01 19:48:54.502438 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.502412 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-jvzxf_1004630f-99aa-4dd6-a6f7-06aac0137d3d/kube-rbac-proxy-main/0.log" Jul 01 19:48:54.529546 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.529523 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-jvzxf_1004630f-99aa-4dd6-a6f7-06aac0137d3d/kube-rbac-proxy-self/0.log" Jul 01 19:48:54.560057 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.560027 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-jvzxf_1004630f-99aa-4dd6-a6f7-06aac0137d3d/openshift-state-metrics/0.log" Jul 01 19:48:54.613971 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.613885 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/prometheus/0.log" Jul 01 19:48:54.640392 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.640359 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/config-reloader/0.log" Jul 01 19:48:54.670639 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.670611 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/thanos-sidecar/0.log" Jul 01 19:48:54.703049 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.703022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/kube-rbac-proxy-web/0.log" Jul 01 19:48:54.760471 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.760447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/kube-rbac-proxy/0.log" Jul 01 19:48:54.809426 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.809399 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/kube-rbac-proxy-thanos/0.log" Jul 01 19:48:54.848538 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:54.848514 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d0e0e1f-53dc-4604-a81e-92abd040eee9/init-config-reloader/0.log" Jul 01 19:48:55.078051 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:55.078019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d65f7b74-fmlzr_314dc41e-2b66-4c31-bbf1-ef843b32419d/thanos-query/0.log" Jul 01 19:48:55.105977 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:55.105955 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d65f7b74-fmlzr_314dc41e-2b66-4c31-bbf1-ef843b32419d/kube-rbac-proxy-web/0.log" Jul 01 19:48:55.135084 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:55.135062 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d65f7b74-fmlzr_314dc41e-2b66-4c31-bbf1-ef843b32419d/kube-rbac-proxy/0.log" Jul 01 19:48:55.161248 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:55.161226 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d65f7b74-fmlzr_314dc41e-2b66-4c31-bbf1-ef843b32419d/prom-label-proxy/0.log" Jul 01 19:48:55.187118 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:55.187095 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d65f7b74-fmlzr_314dc41e-2b66-4c31-bbf1-ef843b32419d/kube-rbac-proxy-rules/0.log" Jul 01 19:48:55.213612 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:55.213572 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d65f7b74-fmlzr_314dc41e-2b66-4c31-bbf1-ef843b32419d/kube-rbac-proxy-metrics/0.log" Jul 01 19:48:57.256842 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:57.256809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/2.log" Jul 01 19:48:57.263672 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:57.263647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9qrbk_49438452-63fa-4c59-b2fc-bb97b5a0a05a/console-operator/3.log" Jul 01 19:48:58.474943 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.474911 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8"] Jul 01 19:48:58.475341 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.475230 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="copy" Jul 01 19:48:58.475341 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.475242 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="copy" Jul 01 19:48:58.475341 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.475258 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="gather" Jul 01 19:48:58.475341 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.475263 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="gather" Jul 01 19:48:58.475341 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.475318 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="gather" Jul 01 19:48:58.475341 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.475327 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd79b888-4836-4be6-a490-97196bcd5fa5" containerName="copy" Jul 01 19:48:58.478557 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.478535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.481058 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.481039 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726bc\"/\"openshift-service-ca.crt\"" Jul 01 19:48:58.481934 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.481915 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726bc\"/\"kube-root-ca.crt\"" Jul 01 19:48:58.482019 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.481982 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-726bc\"/\"default-dockercfg-rqmdg\"" Jul 01 19:48:58.487402 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.487379 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8"] Jul 01 19:48:58.619983 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.619944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-lib-modules\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.619983 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.619982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkng\" (UniqueName: \"kubernetes.io/projected/a98b1963-3127-418b-8510-663d89e1d254-kube-api-access-nzkng\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.620224 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.620010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-proc\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.620224 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.620089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-sys\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.620224 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.620119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-podres\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721289 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-sys\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721289 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-podres\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-lib-modules\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkng\" (UniqueName: \"kubernetes.io/projected/a98b1963-3127-418b-8510-663d89e1d254-kube-api-access-nzkng\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-sys\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-proc\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721476 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-proc\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721637 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-podres\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.721637 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.721535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a98b1963-3127-418b-8510-663d89e1d254-lib-modules\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.730175 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.730110 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkng\" (UniqueName: \"kubernetes.io/projected/a98b1963-3127-418b-8510-663d89e1d254-kube-api-access-nzkng\") pod \"perf-node-gather-daemonset-z5mn8\" (UID: \"a98b1963-3127-418b-8510-663d89e1d254\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.788271 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.788222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:58.913449 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:58.913371 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8"] Jul 01 19:48:58.916051 ip-10-0-142-179 kubenswrapper[2574]: W0701 19:48:58.916026 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda98b1963_3127_418b_8510_663d89e1d254.slice/crio-e9d1dd6621f22fed3166c9d29ed925da868560bae9c974633f53842816a5498c WatchSource:0}: Error finding container e9d1dd6621f22fed3166c9d29ed925da868560bae9c974633f53842816a5498c: Status 404 returned error can't find the container with id e9d1dd6621f22fed3166c9d29ed925da868560bae9c974633f53842816a5498c Jul 01 19:48:59.341991 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.341917 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dqnf7_9d2c233e-b0a3-4cca-8d48-a913abc66f28/dns/0.log" Jul 01 19:48:59.370608 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.370582 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dqnf7_9d2c233e-b0a3-4cca-8d48-a913abc66f28/kube-rbac-proxy/0.log" Jul 01 19:48:59.645612 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.645534 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsh9h_e9f1ad24-c80d-4870-9f0c-b63a5468b3fb/dns-node-resolver/0.log" Jul 01 19:48:59.898658 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.898574 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" event={"ID":"a98b1963-3127-418b-8510-663d89e1d254","Type":"ContainerStarted","Data":"c11c77f8a888e989b11ef336489b0ed8093e3a36727ffda3a9c3abb8161aa073"} Jul 01 19:48:59.898658 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.898627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" event={"ID":"a98b1963-3127-418b-8510-663d89e1d254","Type":"ContainerStarted","Data":"e9d1dd6621f22fed3166c9d29ed925da868560bae9c974633f53842816a5498c"} Jul 01 19:48:59.898843 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.898705 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:48:59.921074 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:48:59.921023 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" podStartSLOduration=1.921008015 podStartE2EDuration="1.921008015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:59.919548108 +0000 UTC m=+1590.574395121" watchObservedRunningTime="2026-07-01 19:48:59.921008015 +0000 UTC m=+1590.575855027" Jul 01 19:49:00.211965 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:00.211936 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ct8l_50ffddd0-9177-4d4a-9610-20ba3522aeb6/node-ca/0.log" Jul 01 19:49:01.137327 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:01.137300 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-784fcc567-kgls9_54e41c76-5d56-4aa6-b534-3503ef381c3b/router/0.log" Jul 01 19:49:01.594960 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:01.594929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4j5g9_885ef05c-8362-4ca3-aeac-1d5c31dcac6a/serve-healthcheck-canary/0.log" Jul 01 19:49:02.168022 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:02.167991 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hhrhg_109c8646-eaed-4ad2-9da4-58aa13cc4926/kube-rbac-proxy/0.log" Jul 01 19:49:02.201643 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:02.201612 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hhrhg_109c8646-eaed-4ad2-9da4-58aa13cc4926/exporter/0.log" Jul 01 19:49:02.235002 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:02.234977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hhrhg_109c8646-eaed-4ad2-9da4-58aa13cc4926/extractor/0.log" Jul 01 19:49:04.651642 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:04.651610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-m5ppj_3f4859e3-3f5c-4b5f-a07d-b3910882a20f/s3-init/0.log" Jul 01 19:49:04.674495 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:04.674474 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-m5ppj_3f4859e3-3f5c-4b5f-a07d-b3910882a20f/download-hf-model/0.log" Jul 01 19:49:05.911015 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:05.910988 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-z5mn8" Jul 01 19:49:08.939032 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:08.939004 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-j5sh8_eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2/migrator/0.log" Jul 01 19:49:08.999674 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:08.999649 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-j5sh8_eb6e5ed2-fbae-49da-a5f9-8446ca1d14f2/graceful-termination/0.log" Jul 01 19:49:10.819457 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.819427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/kube-multus-additional-cni-plugins/0.log" Jul 01 19:49:10.843754 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.843732 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/egress-router-binary-copy/0.log" Jul 01 19:49:10.870367 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.870337 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/cni-plugins/0.log" Jul 01 19:49:10.894422 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.894398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/bond-cni-plugin/0.log" Jul 01 19:49:10.919768 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.919747 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/routeoverride-cni/0.log" Jul 01 19:49:10.964544 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.964516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/whereabouts-cni-bincopy/0.log" Jul 01 19:49:10.988883 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:10.988859 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrlg9_3dd10c94-b03f-4ae1-b010-9489c4acf7ac/whereabouts-cni/0.log" Jul 01 19:49:11.024156 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:11.024123 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gndwh_734bc79a-4428-43af-ba2a-b6a253df6452/kube-multus/0.log" Jul 01 19:49:11.195180 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:11.195119 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vw95m_f40220c1-4697-4a0f-ab9c-a43a97e3cb98/network-metrics-daemon/0.log" Jul 01 19:49:11.218082 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:11.218062 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vw95m_f40220c1-4697-4a0f-ab9c-a43a97e3cb98/kube-rbac-proxy/0.log" Jul 01 19:49:12.525215 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.525186 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/ovn-controller/0.log" Jul 01 19:49:12.548591 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.548571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/ovn-acl-logging/0.log" Jul 01 19:49:12.574480 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.574455 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/kube-rbac-proxy-node/0.log" Jul 01 19:49:12.601851 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.601821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 19:49:12.626635 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.626610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/northd/0.log" Jul 01 19:49:12.651470 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.651447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/nbdb/0.log" Jul 01 19:49:12.679090 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.679056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/sbdb/0.log" Jul 01 19:49:12.735871 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:12.735846 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tq5ps_523dbf55-bc15-4739-818a-2885a2013a47/ovnkube-controller/0.log" Jul 01 19:49:13.796668 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:13.796636 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kccvx_b80fe092-2d0b-4273-aead-b7e98c04ba9c/network-check-target-container/0.log" Jul 01 19:49:14.810813 ip-10-0-142-179 kubenswrapper[2574]: I0701 19:49:14.810783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2pph8_cba2ff8b-bb92-46a6-a975-764a176db0e6/iptables-alerter/0.log"