Jul 28 10:08:07.913312 ip-10-0-130-25 systemd[1]: Starting Kubernetes Kubelet... Jul 28 10:08:08.293625 ip-10-0-130-25 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 10:08:08.293625 ip-10-0-130-25 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 10:08:08.293625 ip-10-0-130-25 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 10:08:08.293625 ip-10-0-130-25 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 10:08:08.293625 ip-10-0-130-25 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 10:08:08.294579 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.294502 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 10:08:08.300814 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300688 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:08:08.300814 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300807 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:08:08.300814 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300811 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:08:08.300814 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300815 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:08:08.300814 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300822 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300827 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300831 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300835 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300837 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300840 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300843 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300846 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300849 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300852 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300854 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300857 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300860 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300864 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300866 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300869 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300871 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300874 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300877 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300880 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:08:08.301038 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300882 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300885 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300888 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300890 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300893 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300896 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300898 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300901 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300904 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300906 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300909 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300912 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300914 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300920 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300924 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300928 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300931 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300934 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300937 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:08:08.301557 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300940 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300943 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300946 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300948 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300951 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300954 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300956 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300959 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300961 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300964 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300966 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300969 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300971 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300973 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300976 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300978 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300981 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300983 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300987 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300990 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:08:08.302041 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300992 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300995 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.300998 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301000 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301003 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301005 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301008 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301012 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301015 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301032 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301035 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301038 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301041 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301044 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301047 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301049 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301052 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301055 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301057 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301060 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:08:08.302522 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301064 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301066 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301069 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301071 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301074 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301077 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301079 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301082 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301084 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301087 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301090 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301095 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301098 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301100 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301103 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301106 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301813 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301820 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301823 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:08:08.303003 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301827 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301830 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301833 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301836 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301838 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301841 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301844 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301846 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301849 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301852 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301856 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301859 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301862 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301865 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301868 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301871 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301873 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301876 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301879 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301882 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:08:08.303491 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301884 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301888 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301890 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301893 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301895 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301898 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301900 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301903 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301906 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301909 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301912 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301914 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301917 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301920 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301923 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301925 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301928 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301930 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301933 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:08:08.304029 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301935 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301938 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301941 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301943 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301946 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301948 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301951 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301953 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301956 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301959 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301962 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301964 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301967 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301969 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301971 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301974 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301977 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301979 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301983 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:08:08.304511 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301985 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301988 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301990 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301993 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301996 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.301998 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302001 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302004 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302006 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302009 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302012 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302033 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302037 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302040 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302044 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302046 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302049 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302052 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302056 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:08:08.304978 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302059 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302062 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302065 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302069 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302071 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302074 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302076 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302079 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302082 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302085 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302087 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302089 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302092 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302094 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302097 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302100 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302103 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302105 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302108 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302481 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:08:08.305462 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302486 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302488 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302491 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302494 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302496 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302499 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302502 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302505 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302507 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302510 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302512 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302515 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302517 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302520 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302522 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302526 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302529 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302531 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302534 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302537 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:08:08.305940 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302539 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302542 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302544 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302547 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302549 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302552 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302554 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302557 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302560 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302562 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302565 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302567 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302570 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302573 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302575 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302577 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302580 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302582 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302586 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:08:08.306429 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302590 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302594 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302597 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302600 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302603 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302606 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302610 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302614 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302617 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302620 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302623 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302625 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302628 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302632 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302635 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302638 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302641 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302644 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302647 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:08:08.306889 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302649 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302652 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302654 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302657 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302659 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302661 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302664 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302667 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302669 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302672 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302674 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302677 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302679 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302684 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302686 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302689 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302691 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302694 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302696 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302699 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302702 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:08:08.307388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302704 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302707 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302710 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302713 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302715 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302719 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302722 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302724 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302727 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302731 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302733 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302736 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302738 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302741 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302744 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302746 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302748 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302751 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.302754 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302824 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302831 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 10:08:08.307903 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302838 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302842 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302846 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302851 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302855 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302859 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302862 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302865 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302868 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302872 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302875 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302878 2564 flags.go:64] FLAG: --cgroup-root="" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302881 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302884 2564 flags.go:64] FLAG: --client-ca-file="" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302887 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302890 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302896 2564 flags.go:64] FLAG: --cluster-domain="" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302899 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302902 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302905 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302908 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302916 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302918 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 10:08:08.308414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302921 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302924 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302927 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302930 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302933 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302936 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302939 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302943 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302946 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302949 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302951 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302954 2564 flags.go:64] FLAG: --enable-server="true" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302959 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302963 2564 flags.go:64] FLAG: --event-burst="100" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302966 2564 flags.go:64] FLAG: --event-qps="50" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302969 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302972 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302975 2564 flags.go:64] FLAG: --eviction-hard="" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302979 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302982 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302985 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302988 2564 flags.go:64] FLAG: --eviction-soft="" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302991 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302993 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.302998 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 10:08:08.308953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303002 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303005 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303008 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303011 2564 flags.go:64] FLAG: --feature-gates="" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303029 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303034 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303037 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303040 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303043 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303046 2564 flags.go:64] FLAG: --help="false" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303049 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303052 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303055 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303058 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303061 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303064 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303067 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303070 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303073 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303077 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303080 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303083 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303086 2564 flags.go:64] FLAG: --kube-reserved="" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303089 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 10:08:08.309622 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303092 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303095 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303097 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303100 2564 flags.go:64] FLAG: --lock-file="" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303103 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303106 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303109 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303114 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303118 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303121 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303124 2564 flags.go:64] FLAG: --logging-format="text" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303127 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303130 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303132 2564 flags.go:64] FLAG: --manifest-url="" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303135 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303139 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303142 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303146 2564 flags.go:64] FLAG: --max-pods="110" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303148 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303151 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303154 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303157 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303160 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303162 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303165 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 10:08:08.310358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303171 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303174 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303178 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303181 2564 flags.go:64] FLAG: --pod-cidr="" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303184 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303189 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303192 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303194 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303197 2564 flags.go:64] FLAG: --port="10250" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303200 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303203 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024c0f649b4c14857" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303206 2564 flags.go:64] FLAG: --qos-reserved="" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303209 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303212 2564 flags.go:64] FLAG: --register-node="true" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303214 2564 flags.go:64] FLAG: --register-with-taints="" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303218 2564 flags.go:64] FLAG: --registry-burst="10" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303222 2564 flags.go:64] FLAG: --registry-qps="5" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303225 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303227 2564 flags.go:64] FLAG: --reserved-memory="" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303231 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303234 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303237 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303240 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303242 2564 flags.go:64] FLAG: --runonce="false" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303245 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 10:08:08.310955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303248 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303252 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303254 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303257 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303260 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303263 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303266 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303269 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303272 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303277 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303280 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303282 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303285 2564 flags.go:64] FLAG: --system-cgroups="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303288 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303293 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303296 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303299 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303302 2564 flags.go:64] FLAG: --tls-min-version="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303305 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303308 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303310 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303313 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303316 2564 flags.go:64] FLAG: --v="2" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303320 2564 flags.go:64] FLAG: --version="false" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303324 2564 flags.go:64] FLAG: --vmodule="" Jul 28 10:08:08.311608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303328 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.303331 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303440 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303444 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303447 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303451 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303453 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303456 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303459 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303462 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303465 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303468 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303471 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303473 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303476 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303479 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303483 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303486 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303488 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303491 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:08:08.312239 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303494 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303496 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303499 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303502 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303505 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303508 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303510 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303513 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303515 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303517 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303520 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303524 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303528 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303531 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303533 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303536 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303538 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303541 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303543 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:08:08.312722 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303546 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303549 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303551 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303554 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303556 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303559 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303561 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303564 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303566 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303571 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303574 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303577 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303580 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303583 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303585 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303588 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303591 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303594 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303597 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:08:08.313241 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303599 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303602 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303604 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303607 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303610 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303613 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303616 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303619 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303622 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303625 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303627 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303630 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303632 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303635 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303638 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303640 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303643 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303645 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303649 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303653 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:08:08.313716 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303656 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303658 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303662 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303665 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303668 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303671 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303673 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303676 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303686 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303689 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303692 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303695 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303698 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303700 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303703 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303705 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303709 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303712 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303714 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303717 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:08:08.314208 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303720 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303723 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.303726 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.304307 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.311512 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.311527 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.312186 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.312193 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312244 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312249 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312253 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312256 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312259 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312262 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312265 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:08:08.314694 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312268 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312271 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312274 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312277 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312280 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312282 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312285 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312288 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312290 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312293 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312295 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312298 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312301 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312303 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312306 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312309 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312311 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312315 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312317 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312320 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:08:08.315134 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312323 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312325 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312328 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312331 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312334 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312336 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312339 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312342 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312344 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312347 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312349 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312352 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312354 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312357 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312359 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312362 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312364 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312367 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312369 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312372 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:08:08.315614 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312374 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312377 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312380 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312382 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312385 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312387 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312390 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312392 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312395 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312397 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312400 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312402 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312405 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312407 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312412 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312416 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312419 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312423 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312426 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:08:08.316287 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312429 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312432 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312435 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312438 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312440 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312443 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312446 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312449 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312451 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312454 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312457 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312459 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312462 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312464 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312467 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312469 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312473 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312476 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312479 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:08:08.317138 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312482 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312485 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312487 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312490 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312492 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312496 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312498 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312501 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312504 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312507 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312509 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312512 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312516 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312520 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:08:08.317628 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.312525 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312649 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312653 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312656 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312659 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312661 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312664 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312667 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312669 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312672 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312674 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312676 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312680 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312684 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312689 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312692 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312694 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312697 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 10:08:08.318034 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312700 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312702 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312705 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312707 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312710 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312712 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312715 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312718 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312721 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312723 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312726 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312729 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312731 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312734 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312737 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312739 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312742 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312744 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312747 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312749 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 10:08:08.318563 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312752 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312754 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312757 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312759 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312761 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312764 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312766 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312769 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312771 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312774 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312776 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312779 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312781 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312784 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312786 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312789 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312792 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312794 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312797 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312800 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 10:08:08.319133 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312803 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312805 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312807 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312810 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312812 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312815 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312817 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312820 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312822 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312824 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312827 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312829 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312832 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312834 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312837 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312839 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312842 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312844 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312847 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312849 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 10:08:08.319822 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312852 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312855 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312857 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312860 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312862 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312865 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312867 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312869 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312872 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312874 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312877 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312879 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312882 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312885 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312887 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312890 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312893 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312895 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312898 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312900 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 10:08:08.320320 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312905 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:08.312908 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.312913 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.313001 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.314741 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.315848 2564 server.go:1019] "Starting client certificate rotation" Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.315964 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.316013 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.317931 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 10:08:08.320805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.318948 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 10:08:08.327082 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.327058 2564 log.go:25] "Validated CRI v1 runtime API" Jul 28 10:08:08.328811 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.328797 2564 log.go:25] "Validated CRI v1 image API" Jul 28 10:08:08.329574 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.329557 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 10:08:08.332674 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.332652 2564 fs.go:135] Filesystem UUIDs: map[15fc154c-6b77-436b-8b3b-f956f13d24bd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a27e97a4-ee24-4eb6-b551-40468e17809f:/dev/nvme0n1p3] Jul 28 10:08:08.332758 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.332673 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 10:08:08.338207 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.338095 2564 manager.go:216] Machine: {Timestamp:2026-07-28 10:08:08.336693606 +0000 UTC m=+0.317542239 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101220 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2be011dbd0c1393db5601e81f1e826 SystemUUID:ec2be011-dbd0-c139-3db5-601e81f1e826 BootID:8712480a-f0ef-4efa-aeb9-ea3a0a8126e3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:4b:35:45:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:4b:35:45:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:1e:1d:c6:84:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 10:08:08.338207 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.338201 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 10:08:08.338317 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.338275 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 10:08:08.341181 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.341154 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 10:08:08.341325 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.341185 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 10:08:08.342225 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.342214 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 10:08:08.342266 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.342228 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 10:08:08.342266 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.342239 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 10:08:08.342835 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.342825 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 10:08:08.343580 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.343570 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 10:08:08.345155 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345142 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 28 10:08:08.345270 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345261 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 10:08:08.345309 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345290 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 28 10:08:08.345309 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345299 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 10:08:08.345369 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345314 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 10:08:08.345369 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345323 2564 kubelet.go:398] "Adding apiserver pod source" Jul 28 10:08:08.345369 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345331 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 10:08:08.345694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345681 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 10:08:08.345742 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.345702 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 10:08:08.346649 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.346630 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 10:08:08.348078 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.348062 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 10:08:08.349824 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.349811 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 10:08:08.349877 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.349840 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 10:08:08.351047 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351035 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 10:08:08.351095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351052 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 10:08:08.351095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351058 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 10:08:08.351095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351063 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 10:08:08.351095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351071 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 10:08:08.351095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351076 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 10:08:08.351095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351084 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 10:08:08.351251 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351098 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 10:08:08.351251 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351107 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 10:08:08.351251 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351112 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 10:08:08.351251 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351128 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 10:08:08.351251 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.351134 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 10:08:08.352723 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.352713 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 10:08:08.352723 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.352722 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 10:08:08.355893 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.355871 2564 server.go:1268] "Started kubelet" Jul 28 10:08:08.355986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.355951 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 10:08:08.356094 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.355998 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 10:08:08.356145 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.356113 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 10:08:08.356747 ip-10-0-130-25 systemd[1]: Started Kubernetes Kubelet. Jul 28 10:08:08.360516 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.360482 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 10:08:08.360652 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.360622 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 10:08:08.360775 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.360751 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 10:08:08.360844 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.360815 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 10:08:08.361426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.361236 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 28 10:08:08.362780 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.362759 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 10:08:08.366910 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.366890 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 10:08:08.366910 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.366906 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 10:08:08.367049 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.366983 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:08.367153 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.365707 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-25.ec2.internal.18c66c3799a70a38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-25.ec2.internal,UID:ip-10-0-130-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-25.ec2.internal,},FirstTimestamp:2026-07-28 10:08:08.355842616 +0000 UTC m=+0.336691249,LastTimestamp:2026-07-28 10:08:08.355842616 +0000 UTC m=+0.336691249,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-25.ec2.internal,}" Jul 28 10:08:08.367760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.367743 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 10:08:08.367760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.367753 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 10:08:08.367873 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.367771 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 10:08:08.367873 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.367854 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 28 10:08:08.367873 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.367864 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 28 10:08:08.368484 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368466 2564 factory.go:55] Registering systemd factory Jul 28 10:08:08.368565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368506 2564 factory.go:223] Registration of the systemd container factory successfully Jul 28 10:08:08.368715 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368698 2564 factory.go:153] Registering CRI-O factory Jul 28 10:08:08.368715 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368715 2564 factory.go:223] Registration of the crio container factory successfully Jul 28 10:08:08.368807 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368759 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 10:08:08.368807 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368778 2564 factory.go:103] Registering Raw factory Jul 28 10:08:08.368807 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.368792 2564 manager.go:1196] Started watching for new ooms in manager Jul 28 10:08:08.369378 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.369357 2564 manager.go:349] Starting recovery of all containers Jul 28 10:08:08.372359 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.372328 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fkwx8" Jul 28 10:08:08.372607 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.372587 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 10:08:08.372675 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.372663 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 10:08:08.379773 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.379619 2564 manager.go:354] Recovery completed Jul 28 10:08:08.381291 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.381275 2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 28 10:08:08.381651 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.381634 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fkwx8" Jul 28 10:08:08.384627 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.384613 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.387457 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.387441 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.387533 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.387467 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.387533 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.387477 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.388052 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388036 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.388052 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388045 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 10:08:08.388158 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388054 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 10:08:08.388158 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388079 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 28 10:08:08.388802 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388790 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.388848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388819 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.388848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.388829 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.389371 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.389360 2564 policy_none.go:49] "None policy: Start" Jul 28 10:08:08.389414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.389375 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 10:08:08.389414 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.389385 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 10:08:08.389734 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.389672 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-25.ec2.internal.18c66c379b896a3d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-25.ec2.internal,UID:ip-10-0-130-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-25.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-25.ec2.internal,},FirstTimestamp:2026-07-28 10:08:08.387455549 +0000 UTC m=+0.368304181,LastTimestamp:2026-07-28 10:08:08.387455549 +0000 UTC m=+0.368304181,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-25.ec2.internal,}" Jul 28 10:08:08.390255 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.390244 2564 policy_none.go:47] "Start" Jul 28 10:08:08.431596 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.431582 2564 manager.go:337] "Starting Device Plugin manager" Jul 28 10:08:08.431672 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.431610 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 10:08:08.431672 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.431619 2564 server.go:87] "Starting device plugin registration server" Jul 28 10:08:08.431991 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.431980 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 10:08:08.432079 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.431992 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 10:08:08.432139 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.432086 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 10:08:08.432190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.432157 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 10:08:08.432190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.432165 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 10:08:08.432611 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.432587 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 10:08:08.432682 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.432639 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:08.532218 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.532199 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.534442 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.532967 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.534442 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.532989 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.534442 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.532999 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.534442 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.533039 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.543948 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.543912 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.543948 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.543931 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-25.ec2.internal\": node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:08.558868 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.558843 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 10:08:08.559952 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.559932 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 10:08:08.560035 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.559978 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 10:08:08.560035 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.559996 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 10:08:08.560118 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.560041 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 10:08:08.562244 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.562227 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:08:08.565540 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.565525 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:08.660357 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.660321 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal"] Jul 28 10:08:08.660458 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.660394 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.661782 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.661767 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.661846 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.661795 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.661846 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.661805 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.664011 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.663998 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.664117 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664103 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.664158 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664131 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.664692 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664673 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.664692 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664684 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.664811 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664703 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.664811 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664708 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.664811 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664713 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.664811 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.664720 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.666445 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.666427 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:08.666910 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.666896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.666990 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.666919 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 10:08:08.667524 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.667509 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientMemory" Jul 28 10:08:08.667610 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.667536 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 10:08:08.667610 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.667551 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeHasSufficientPID" Jul 28 10:08:08.668789 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.668773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cd0084e185b4041597a99660d45f31b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal\" (UID: \"3cd0084e185b4041597a99660d45f31b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.668873 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.668801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cd0084e185b4041597a99660d45f31b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal\" (UID: \"3cd0084e185b4041597a99660d45f31b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.668873 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:08.668827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7799387ccba9495df83effa34fca314-config\") pod \"kube-apiserver-proxy-ip-10-0-130-25.ec2.internal\" (UID: \"a7799387ccba9495df83effa34fca314\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.702542 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.702517 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-25.ec2.internal\" not found" node="ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.705771 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.705754 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-25.ec2.internal\" not found" node="ip-10-0-130-25.ec2.internal" Jul 28 10:08:08.767076 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:08.767054 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:09.878967 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:09.878950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cd0084e185b4041597a99660d45f31b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal\" (UID: \"3cd0084e185b4041597a99660d45f31b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:09.879040 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:09.878979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cd0084e185b4041597a99660d45f31b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal\" (UID: \"3cd0084e185b4041597a99660d45f31b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:09.879040 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:09.879002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7799387ccba9495df83effa34fca314-config\") pod \"kube-apiserver-proxy-ip-10-0-130-25.ec2.internal\" (UID: \"a7799387ccba9495df83effa34fca314\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" Jul 28 10:08:09.879107 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:09.879081 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cd0084e185b4041597a99660d45f31b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal\" (UID: \"3cd0084e185b4041597a99660d45f31b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:09.879150 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:09.879136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cd0084e185b4041597a99660d45f31b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal\" (UID: \"3cd0084e185b4041597a99660d45f31b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:09.879184 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:09.879172 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7799387ccba9495df83effa34fca314-config\") pod \"kube-apiserver-proxy-ip-10-0-130-25.ec2.internal\" (UID: \"a7799387ccba9495df83effa34fca314\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" Jul 28 10:08:09.977431 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:09.977364 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.077731 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.077700 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.113975 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.113957 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:10.117678 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.117654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" Jul 28 10:08:10.178420 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.178393 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.278803 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.278780 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.379301 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.379269 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.425563 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.425544 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 10:08:10.426027 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.425682 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 10:08:10.479897 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.479869 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.495025 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.494990 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 10:03:09 +0000 UTC" deadline="2028-03-16 21:33:09.897026192 +0000 UTC" Jul 28 10:08:10.495025 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.495022 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14339h24m59.40200679s" Jul 28 10:08:10.580549 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.580504 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.680722 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.680699 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.734706 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:10.734679 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7799387ccba9495df83effa34fca314.slice/crio-2ff09f9d377565da99c983e0dd96643f42b0df8a24a958f8add9e52c3e872b12 WatchSource:0}: Error finding container 2ff09f9d377565da99c983e0dd96643f42b0df8a24a958f8add9e52c3e872b12: Status 404 returned error can't find the container with id 2ff09f9d377565da99c983e0dd96643f42b0df8a24a958f8add9e52c3e872b12 Jul 28 10:08:10.738867 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.738854 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 10:08:10.781719 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.781695 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.789991 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:10.789976 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:08:10.796888 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:10.796869 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd0084e185b4041597a99660d45f31b.slice/crio-535e6b3e5d06da717d558c891eb1c9cbd73246166302a1dfecdcdb420b6240f3 WatchSource:0}: Error finding container 535e6b3e5d06da717d558c891eb1c9cbd73246166302a1dfecdcdb420b6240f3: Status 404 returned error can't find the container with id 535e6b3e5d06da717d558c891eb1c9cbd73246166302a1dfecdcdb420b6240f3 Jul 28 10:08:10.882809 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.882751 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:10.983574 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:10.983551 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-25.ec2.internal\" not found" Jul 28 10:08:11.013966 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.013950 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:08:11.035190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.035167 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:08:11.077036 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.077017 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" Jul 28 10:08:11.088564 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.088547 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 10:08:11.089525 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.089512 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" Jul 28 10:08:11.098954 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.098935 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 10:08:11.456436 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.456410 2564 apiserver.go:52] "Watching apiserver" Jul 28 10:08:11.462751 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.462728 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 10:08:11.464620 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.464590 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-z96mn","openshift-multus/multus-bhkmj","openshift-multus/network-metrics-daemon-bswb7","openshift-ovn-kubernetes/ovnkube-node-2bbtd","kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd","openshift-dns/node-resolver-gvzkw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal","openshift-network-diagnostics/network-check-target-dnq8m","openshift-network-operator/iptables-alerter-clmsw","kube-system/global-pull-secret-syncer-zz62r","kube-system/konnectivity-agent-8d9xc","openshift-cluster-node-tuning-operator/tuned-wvdgn","openshift-image-registry/node-ca-tjgzh"] Jul 28 10:08:11.467022 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.467000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.469912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.469511 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.469912 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.469596 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:11.469912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.469863 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wl5rq\"" Jul 28 10:08:11.470117 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.470017 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.470117 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.470098 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.471489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.471467 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:11.471586 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.471543 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:11.473810 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.473794 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.476044 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.476140 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476064 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 10:08:11.476217 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476193 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.476528 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476383 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p57kj\"" Jul 28 10:08:11.476528 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476445 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.476528 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476508 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 10:08:11.476809 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476793 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 10:08:11.476876 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.476794 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 10:08:11.477751 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.477732 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 10:08:11.478249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.478186 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.478249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.478230 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vs8gm\"" Jul 28 10:08:11.478841 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.478410 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.478841 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.478425 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 10:08:11.478841 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.478459 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.480541 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.480499 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.480751 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.480735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:11.480751 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.480744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 10:08:11.480882 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.480786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.480882 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.480795 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:11.480882 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.480839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9l6p\"" Jul 28 10:08:11.484067 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.483939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.486737 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.486294 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.486737 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.486323 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.486737 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.486389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hlc5n\"" Jul 28 10:08:11.486737 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.486506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.487197 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-var-lib-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487275 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487275 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-cni-bin\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487275 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnkpw\" (UniqueName: \"kubernetes.io/projected/ef2dbf6c-8573-431b-9797-18c7b5c6000c-kube-api-access-fnkpw\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487275 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-etc-selinux\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.487426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487275 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-hosts-file\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.487426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkkh7\" (UniqueName: \"kubernetes.io/projected/e5b9839d-062b-4dff-aaab-f3d18085fe1f-kube-api-access-kkkh7\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.487426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-node-log\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-etc-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487579 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487579 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovnkube-config\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487579 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-tmp-dir\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.487579 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5zzc\" (UniqueName: \"kubernetes.io/projected/4f22e723-9f46-4b50-8a3f-e8d624539b30-kube-api-access-k5zzc\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:11.487794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-log-socket\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovn-node-metrics-cert\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.487794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.487794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlngx\" (UniqueName: \"kubernetes.io/projected/37fed524-d60e-4a6c-a693-b2039cff7e78-kube-api-access-qlngx\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.487794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-cni-netd\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-device-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.488024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-sys-fs\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.488024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjvm\" (UniqueName: \"kubernetes.io/projected/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-kube-api-access-hxjvm\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.488024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-dbus\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.488024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.487947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-env-overrides\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-kubelet\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-slash\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-run-netns\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-registration-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-kubelet-config\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovnkube-script-lib\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5b9839d-062b-4dff-aaab-f3d18085fe1f-serviceca\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:11.488267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-systemd-units\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-ovn\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5b9839d-062b-4dff-aaab-f3d18085fe1f-host\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-socket-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-systemd\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488510 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 10:08:11.488606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488539 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s9fw5\"" Jul 28 10:08:11.489006 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.488983 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 10:08:11.489067 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.489015 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.489067 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.489021 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.489164 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.489071 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.491274 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.491255 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 10:08:11.491489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.491459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 10:08:11.491571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.491526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 10:08:11.491819 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.491799 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jzdx6\"" Jul 28 10:08:11.492222 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.492208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.492643 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.492623 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 10:08:11.494433 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.494414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 10:08:11.494524 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.494442 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 10:08:11.494524 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.494415 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z87q9\"" Jul 28 10:08:11.494823 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.494807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.497101 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.497084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hfjdr\"" Jul 28 10:08:11.497188 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.497090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 10:08:11.497249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.497182 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 10:08:11.512679 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.512645 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d792b" Jul 28 10:08:11.520779 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.520759 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d792b" Jul 28 10:08:11.579247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.579227 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 10:08:11.589152 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-log-socket\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589236 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovn-node-metrics-cert\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589236 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-run\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.589236 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmfqp\" (UniqueName: \"kubernetes.io/projected/bc5894d7-0660-4bf2-a5df-8502004ccb38-kube-api-access-fmfqp\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.589236 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75355376-580f-4b6c-a2d5-12c4938c5442-agent-certs\") pod \"konnectivity-agent-8d9xc\" (UID: \"75355376-580f-4b6c-a2d5-12c4938c5442\") " pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.589236 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-cni-netd\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-log-socket\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a498780a-bdbb-4b8d-8633-aef26c9c17a0-iptables-alerter-script\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-multus-certs\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-cni-netd\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-cnibin\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-os-release\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-device-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.589391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-cni-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-env-overrides\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-cni-binary-copy\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75355376-580f-4b6c-a2d5-12c4938c5442-konnectivity-ca\") pod \"konnectivity-agent-8d9xc\" (UID: \"75355376-580f-4b6c-a2d5-12c4938c5442\") " pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589438 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-device-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5b9839d-062b-4dff-aaab-f3d18085fe1f-serviceca\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-kubelet\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589519 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-system-cni-dir\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-ovn\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5b9839d-062b-4dff-aaab-f3d18085fe1f-host\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589636 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-ovn\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.589656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntnhb\" (UniqueName: \"kubernetes.io/projected/a498780a-bdbb-4b8d-8633-aef26c9c17a0-kube-api-access-ntnhb\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5b9839d-062b-4dff-aaab-f3d18085fe1f-host\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71338c5e-4d44-435c-86c7-90d3a2565f3f-cni-binary-copy\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-cni-multus\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-hosts-file\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-host\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-system-cni-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-os-release\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5b9839d-062b-4dff-aaab-f3d18085fe1f-serviceca\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-netns\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589874 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-hosts-file\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-env-overrides\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtr4q\" (UniqueName: \"kubernetes.io/projected/71338c5e-4d44-435c-86c7-90d3a2565f3f-kube-api-access-mtr4q\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-node-log\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.589989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-etc-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovnkube-config\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590023 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-node-log\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-tmp-dir\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.590355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-etc-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5zzc\" (UniqueName: \"kubernetes.io/projected/4f22e723-9f46-4b50-8a3f-e8d624539b30-kube-api-access-k5zzc\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-lib-modules\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc5894d7-0660-4bf2-a5df-8502004ccb38-tmp\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlngx\" (UniqueName: \"kubernetes.io/projected/37fed524-d60e-4a6c-a693-b2039cff7e78-kube-api-access-qlngx\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-systemd\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-k8s-cni-cncf-io\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-conf-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590302 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-tmp-dir\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysctl-d\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysctl-conf\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-var-lib-kubelet\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-socket-dir-parent\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-hostroot\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.591174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-sys-fs\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590482 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovnkube-config\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjvm\" (UniqueName: \"kubernetes.io/projected/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-kube-api-access-hxjvm\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-sys-fs\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-dbus\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7m4\" (UniqueName: \"kubernetes.io/projected/58bb0eef-bfa4-48f2-822e-feec47bdff90-kube-api-access-cb7m4\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-kubelet\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-slash\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-run-netns\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590754 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-dbus\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-kubelet\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-registration-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-kubelet-config\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590805 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-registration-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-slash\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-daemon-config\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-run-netns\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592053 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovnkube-script-lib\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-kubelet-config\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a498780a-bdbb-4b8d-8633-aef26c9c17a0-host-slash\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.590982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-sys\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-systemd-units\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.591074 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-socket-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.591141 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:12.091120598 +0000 UTC m=+2.962321808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591187 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-systemd-units\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591191 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-socket-dir\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysconfig\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.592699 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-tuned\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-cnibin\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-cni-bin\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-systemd\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.591312 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-var-lib-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.591356 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:12.091340581 +0000 UTC m=+2.962541778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-cni-bin\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-var-lib-openvswitch\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovnkube-script-lib\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnkpw\" (UniqueName: \"kubernetes.io/projected/ef2dbf6c-8573-431b-9797-18c7b5c6000c-kube-api-access-fnkpw\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591454 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591414 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-run-systemd\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-etc-selinux\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591491 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-cni-bin\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.593291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-kubernetes\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-etc-kubernetes\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591560 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37fed524-d60e-4a6c-a693-b2039cff7e78-etc-selinux\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkkh7\" (UniqueName: \"kubernetes.io/projected/e5b9839d-062b-4dff-aaab-f3d18085fe1f-kube-api-access-kkkh7\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-modprobe-d\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.591702 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2dbf6c-8573-431b-9797-18c7b5c6000c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.595381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.593088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef2dbf6c-8573-431b-9797-18c7b5c6000c-ovn-node-metrics-cert\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.603112 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.603075 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlngx\" (UniqueName: \"kubernetes.io/projected/37fed524-d60e-4a6c-a693-b2039cff7e78-kube-api-access-qlngx\") pod \"aws-ebs-csi-driver-node-jspvd\" (UID: \"37fed524-d60e-4a6c-a693-b2039cff7e78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.603981 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.603958 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkkh7\" (UniqueName: \"kubernetes.io/projected/e5b9839d-062b-4dff-aaab-f3d18085fe1f-kube-api-access-kkkh7\") pod \"node-ca-tjgzh\" (UID: \"e5b9839d-062b-4dff-aaab-f3d18085fe1f\") " pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.604990 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.604967 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjvm\" (UniqueName: \"kubernetes.io/projected/c7b3e677-1de7-4eb1-9be9-6d1633d4d63b-kube-api-access-hxjvm\") pod \"node-resolver-gvzkw\" (UID: \"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b\") " pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.605376 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.605350 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnkpw\" (UniqueName: \"kubernetes.io/projected/ef2dbf6c-8573-431b-9797-18c7b5c6000c-kube-api-access-fnkpw\") pod \"ovnkube-node-2bbtd\" (UID: \"ef2dbf6c-8573-431b-9797-18c7b5c6000c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.605463 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.605361 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5zzc\" (UniqueName: \"kubernetes.io/projected/4f22e723-9f46-4b50-8a3f-e8d624539b30-kube-api-access-k5zzc\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:11.676023 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.675968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" event={"ID":"3cd0084e185b4041597a99660d45f31b","Type":"ContainerStarted","Data":"535e6b3e5d06da717d558c891eb1c9cbd73246166302a1dfecdcdb420b6240f3"} Jul 28 10:08:11.677135 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.677104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" event={"ID":"a7799387ccba9495df83effa34fca314","Type":"ContainerStarted","Data":"2ff09f9d377565da99c983e0dd96643f42b0df8a24a958f8add9e52c3e872b12"} Jul 28 10:08:11.692174 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-lib-modules\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc5894d7-0660-4bf2-a5df-8502004ccb38-tmp\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-systemd\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-k8s-cni-cncf-io\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692277 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-k8s-cni-cncf-io\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692305 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-systemd\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-lib-modules\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692339 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-conf-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-conf-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysctl-d\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysctl-conf\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-var-lib-kubelet\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692481 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-var-lib-kubelet\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692499 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-socket-dir-parent\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-hostroot\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7m4\" (UniqueName: \"kubernetes.io/projected/58bb0eef-bfa4-48f2-822e-feec47bdff90-kube-api-access-cb7m4\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysctl-d\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-daemon-config\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692574 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysctl-conf\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692620 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-hostroot\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a498780a-bdbb-4b8d-8633-aef26c9c17a0-host-slash\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-sys\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a498780a-bdbb-4b8d-8633-aef26c9c17a0-host-slash\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysconfig\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-tuned\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-socket-dir-parent\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-cnibin\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.692997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-cni-bin\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-kubernetes\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-sys\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-sysconfig\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-etc-kubernetes\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-cni-bin\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692963 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-kubernetes\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693000 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-etc-kubernetes\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-cnibin\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-daemon-config\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693171 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-modprobe-d\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693423 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.692902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-modprobe-d\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-run\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmfqp\" (UniqueName: \"kubernetes.io/projected/bc5894d7-0660-4bf2-a5df-8502004ccb38-kube-api-access-fmfqp\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-run\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75355376-580f-4b6c-a2d5-12c4938c5442-agent-certs\") pod \"konnectivity-agent-8d9xc\" (UID: \"75355376-580f-4b6c-a2d5-12c4938c5442\") " pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.693852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a498780a-bdbb-4b8d-8633-aef26c9c17a0-iptables-alerter-script\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-multus-certs\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-cnibin\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-os-release\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-cni-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-cni-binary-copy\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-multus-certs\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75355376-580f-4b6c-a2d5-12c4938c5442-konnectivity-ca\") pod \"konnectivity-agent-8d9xc\" (UID: \"75355376-580f-4b6c-a2d5-12c4938c5442\") " pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693728 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-cnibin\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-kubelet\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-kubelet\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-multus-cni-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-system-cni-dir\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693896 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-os-release\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntnhb\" (UniqueName: \"kubernetes.io/projected/a498780a-bdbb-4b8d-8633-aef26c9c17a0-kube-api-access-ntnhb\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71338c5e-4d44-435c-86c7-90d3a2565f3f-cni-binary-copy\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.694760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-cni-multus\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-host\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-system-cni-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-os-release\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-netns\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtr4q\" (UniqueName: \"kubernetes.io/projected/71338c5e-4d44-435c-86c7-90d3a2565f3f-kube-api-access-mtr4q\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-var-lib-cni-multus\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694256 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75355376-580f-4b6c-a2d5-12c4938c5442-konnectivity-ca\") pod \"konnectivity-agent-8d9xc\" (UID: \"75355376-580f-4b6c-a2d5-12c4938c5442\") " pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a498780a-bdbb-4b8d-8633-aef26c9c17a0-iptables-alerter-script\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694303 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58bb0eef-bfa4-48f2-822e-feec47bdff90-cni-binary-copy\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.693938 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58bb0eef-bfa4-48f2-822e-feec47bdff90-system-cni-dir\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-system-cni-dir\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694361 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-os-release\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694381 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc5894d7-0660-4bf2-a5df-8502004ccb38-host\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71338c5e-4d44-435c-86c7-90d3a2565f3f-host-run-netns\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71338c5e-4d44-435c-86c7-90d3a2565f3f-cni-binary-copy\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.695400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.694830 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc5894d7-0660-4bf2-a5df-8502004ccb38-tmp\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.695886 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.695573 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc5894d7-0660-4bf2-a5df-8502004ccb38-etc-tuned\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.696823 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.696800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75355376-580f-4b6c-a2d5-12c4938c5442-agent-certs\") pod \"konnectivity-agent-8d9xc\" (UID: \"75355376-580f-4b6c-a2d5-12c4938c5442\") " pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:11.701265 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.701246 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:11.701265 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.701269 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:11.701429 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.701282 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:11.701429 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:11.701371 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:08:12.20135421 +0000 UTC m=+3.072555406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:11.702121 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.702097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7m4\" (UniqueName: \"kubernetes.io/projected/58bb0eef-bfa4-48f2-822e-feec47bdff90-kube-api-access-cb7m4\") pod \"multus-additional-cni-plugins-z96mn\" (UID: \"58bb0eef-bfa4-48f2-822e-feec47bdff90\") " pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.702628 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.702585 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmfqp\" (UniqueName: \"kubernetes.io/projected/bc5894d7-0660-4bf2-a5df-8502004ccb38-kube-api-access-fmfqp\") pod \"tuned-wvdgn\" (UID: \"bc5894d7-0660-4bf2-a5df-8502004ccb38\") " pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.703382 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.703349 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntnhb\" (UniqueName: \"kubernetes.io/projected/a498780a-bdbb-4b8d-8633-aef26c9c17a0-kube-api-access-ntnhb\") pod \"iptables-alerter-clmsw\" (UID: \"a498780a-bdbb-4b8d-8633-aef26c9c17a0\") " pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.703716 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.703697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtr4q\" (UniqueName: \"kubernetes.io/projected/71338c5e-4d44-435c-86c7-90d3a2565f3f-kube-api-access-mtr4q\") pod \"multus-bhkmj\" (UID: \"71338c5e-4d44-435c-86c7-90d3a2565f3f\") " pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.777337 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.777309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gvzkw" Jul 28 10:08:11.785655 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.785633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:11.795407 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.795387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tjgzh" Jul 28 10:08:11.801066 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.801046 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" Jul 28 10:08:11.808703 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.808686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" Jul 28 10:08:11.815252 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.815234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bhkmj" Jul 28 10:08:11.823745 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.823722 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-clmsw" Jul 28 10:08:11.825047 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.825025 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 10:08:11.829902 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.829882 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z96mn" Jul 28 10:08:11.835530 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:11.835514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:12.096355 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.096270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:12.096516 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.096398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:12.096516 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.096431 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:12.096516 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.096510 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:13.096490235 +0000 UTC m=+3.967691439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:12.096699 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.096529 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:12.096699 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.096593 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:13.096575377 +0000 UTC m=+3.967776568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:12.232331 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.232301 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75355376_580f_4b6c_a2d5_12c4938c5442.slice/crio-7164e6ded6bcd3da74ab0806a129c85d592c1b25b22d45a9b55468aa82b8544e WatchSource:0}: Error finding container 7164e6ded6bcd3da74ab0806a129c85d592c1b25b22d45a9b55468aa82b8544e: Status 404 returned error can't find the container with id 7164e6ded6bcd3da74ab0806a129c85d592c1b25b22d45a9b55468aa82b8544e Jul 28 10:08:12.233496 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.233470 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2dbf6c_8573_431b_9797_18c7b5c6000c.slice/crio-07c78214c984c9c7e51289b65a3df381f300e73def4824b422232d36f2812bd0 WatchSource:0}: Error finding container 07c78214c984c9c7e51289b65a3df381f300e73def4824b422232d36f2812bd0: Status 404 returned error can't find the container with id 07c78214c984c9c7e51289b65a3df381f300e73def4824b422232d36f2812bd0 Jul 28 10:08:12.236870 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.236843 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b9839d_062b_4dff_aaab_f3d18085fe1f.slice/crio-5eabc6786b6cabdc5a9ebe9f0ff24c4dd82bd1c327059d84f8306146b20c216e WatchSource:0}: Error finding container 5eabc6786b6cabdc5a9ebe9f0ff24c4dd82bd1c327059d84f8306146b20c216e: Status 404 returned error can't find the container with id 5eabc6786b6cabdc5a9ebe9f0ff24c4dd82bd1c327059d84f8306146b20c216e Jul 28 10:08:12.238314 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.238291 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71338c5e_4d44_435c_86c7_90d3a2565f3f.slice/crio-919d60be60228f2fcde017a525a9efd999190e16715fb6585086b5d9eb834333 WatchSource:0}: Error finding container 919d60be60228f2fcde017a525a9efd999190e16715fb6585086b5d9eb834333: Status 404 returned error can't find the container with id 919d60be60228f2fcde017a525a9efd999190e16715fb6585086b5d9eb834333 Jul 28 10:08:12.238585 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.238562 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fed524_d60e_4a6c_a693_b2039cff7e78.slice/crio-f29512bd8f914abfb083e0e03744827100c904674ad3014f04e3e26738681e94 WatchSource:0}: Error finding container f29512bd8f914abfb083e0e03744827100c904674ad3014f04e3e26738681e94: Status 404 returned error can't find the container with id f29512bd8f914abfb083e0e03744827100c904674ad3014f04e3e26738681e94 Jul 28 10:08:12.239576 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.239547 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda498780a_bdbb_4b8d_8633_aef26c9c17a0.slice/crio-c4e98b0d46911d40d25fb55718ebb3d91c45af5d51ab723bb54e1d5273ef8968 WatchSource:0}: Error finding container c4e98b0d46911d40d25fb55718ebb3d91c45af5d51ab723bb54e1d5273ef8968: Status 404 returned error can't find the container with id c4e98b0d46911d40d25fb55718ebb3d91c45af5d51ab723bb54e1d5273ef8968 Jul 28 10:08:12.240803 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.240782 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5894d7_0660_4bf2_a5df_8502004ccb38.slice/crio-5c95870259bce635498647d195a16a5a117b66f5d5a168a068371ae127cc19e9 WatchSource:0}: Error finding container 5c95870259bce635498647d195a16a5a117b66f5d5a168a068371ae127cc19e9: Status 404 returned error can't find the container with id 5c95870259bce635498647d195a16a5a117b66f5d5a168a068371ae127cc19e9 Jul 28 10:08:12.243106 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.243016 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b3e677_1de7_4eb1_9be9_6d1633d4d63b.slice/crio-e7ce62ed6a90910981d8994673e136308d78d09b6151001186ffe6e8db89f37b WatchSource:0}: Error finding container e7ce62ed6a90910981d8994673e136308d78d09b6151001186ffe6e8db89f37b: Status 404 returned error can't find the container with id e7ce62ed6a90910981d8994673e136308d78d09b6151001186ffe6e8db89f37b Jul 28 10:08:12.243224 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:12.243202 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bb0eef_bfa4_48f2_822e_feec47bdff90.slice/crio-22d9e1f901be3e2bd4e894bafe4699f9481e098b1c8c9f63ed483f28219b5d73 WatchSource:0}: Error finding container 22d9e1f901be3e2bd4e894bafe4699f9481e098b1c8c9f63ed483f28219b5d73: Status 404 returned error can't find the container with id 22d9e1f901be3e2bd4e894bafe4699f9481e098b1c8c9f63ed483f28219b5d73 Jul 28 10:08:12.297296 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.297275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:12.297448 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.297430 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:12.297492 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.297454 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:12.297492 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.297464 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:12.297556 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.297507 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:08:13.29749306 +0000 UTC m=+4.168694250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:12.524580 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.524357 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 10:03:11 +0000 UTC" deadline="2028-05-15 07:22:10.48341157 +0000 UTC" Jul 28 10:08:12.524580 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.524576 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15765h13m57.95884189s" Jul 28 10:08:12.669890 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.669854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:12.670073 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:12.669976 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:12.680602 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.680577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bhkmj" event={"ID":"71338c5e-4d44-435c-86c7-90d3a2565f3f","Type":"ContainerStarted","Data":"919d60be60228f2fcde017a525a9efd999190e16715fb6585086b5d9eb834333"} Jul 28 10:08:12.681654 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.681630 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tjgzh" event={"ID":"e5b9839d-062b-4dff-aaab-f3d18085fe1f","Type":"ContainerStarted","Data":"5eabc6786b6cabdc5a9ebe9f0ff24c4dd82bd1c327059d84f8306146b20c216e"} Jul 28 10:08:12.682908 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.682880 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"07c78214c984c9c7e51289b65a3df381f300e73def4824b422232d36f2812bd0"} Jul 28 10:08:12.685012 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.684974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" event={"ID":"a7799387ccba9495df83effa34fca314","Type":"ContainerStarted","Data":"a1d882964f9f840d40f12fa5eca2a2026cf63cc6fcc3ecdb60de53a41a70fdb3"} Jul 28 10:08:12.686233 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.686201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" event={"ID":"bc5894d7-0660-4bf2-a5df-8502004ccb38","Type":"ContainerStarted","Data":"5c95870259bce635498647d195a16a5a117b66f5d5a168a068371ae127cc19e9"} Jul 28 10:08:12.687481 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.687455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" event={"ID":"37fed524-d60e-4a6c-a693-b2039cff7e78","Type":"ContainerStarted","Data":"f29512bd8f914abfb083e0e03744827100c904674ad3014f04e3e26738681e94"} Jul 28 10:08:12.688604 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.688567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8d9xc" event={"ID":"75355376-580f-4b6c-a2d5-12c4938c5442","Type":"ContainerStarted","Data":"7164e6ded6bcd3da74ab0806a129c85d592c1b25b22d45a9b55468aa82b8544e"} Jul 28 10:08:12.689899 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.689878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerStarted","Data":"22d9e1f901be3e2bd4e894bafe4699f9481e098b1c8c9f63ed483f28219b5d73"} Jul 28 10:08:12.691189 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.691164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gvzkw" event={"ID":"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b","Type":"ContainerStarted","Data":"e7ce62ed6a90910981d8994673e136308d78d09b6151001186ffe6e8db89f37b"} Jul 28 10:08:12.692329 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:12.692308 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-clmsw" event={"ID":"a498780a-bdbb-4b8d-8633-aef26c9c17a0","Type":"ContainerStarted","Data":"c4e98b0d46911d40d25fb55718ebb3d91c45af5d51ab723bb54e1d5273ef8968"} Jul 28 10:08:13.102748 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.102705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:13.102917 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.102763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:13.102996 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.102923 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:13.102996 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.102982 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:15.102964626 +0000 UTC m=+5.974165825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:13.103076 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.103060 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:13.103134 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.103094 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:15.103082101 +0000 UTC m=+5.974283303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:13.304578 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.304542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:13.305191 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.304751 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:13.305191 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.304780 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:13.305191 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.304793 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:13.305191 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.304846 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:08:15.304828673 +0000 UTC m=+6.176029865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:13.525789 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.525718 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 10:03:11 +0000 UTC" deadline="2028-01-22 11:14:05.731849786 +0000 UTC" Jul 28 10:08:13.525789 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.525780 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13033h5m52.206074227s" Jul 28 10:08:13.672788 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.672661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:13.672930 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.672803 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:13.673226 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:13.673203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:13.673462 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:13.673414 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:14.671001 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:14.670503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:14.671001 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:14.670623 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:14.712233 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:14.712187 2564 generic.go:356] "Generic (PLEG): container finished" podID="3cd0084e185b4041597a99660d45f31b" containerID="3a2fe3c9c330673ab707812ff08904d2eff29de23a425c1053d20af6a29fc049" exitCode=0 Jul 28 10:08:14.712393 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:14.712246 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" event={"ID":"3cd0084e185b4041597a99660d45f31b","Type":"ContainerDied","Data":"3a2fe3c9c330673ab707812ff08904d2eff29de23a425c1053d20af6a29fc049"} Jul 28 10:08:14.729603 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:14.729550 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-25.ec2.internal" podStartSLOduration=3.7295318650000002 podStartE2EDuration="3.729531865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:12.700962264 +0000 UTC m=+3.572163476" watchObservedRunningTime="2026-07-28 10:08:14.729531865 +0000 UTC m=+5.600733100" Jul 28 10:08:15.122554 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:15.121867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:15.122554 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:15.121920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:15.122554 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.122051 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:15.122554 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.122110 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:19.122092509 +0000 UTC m=+9.993293702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:15.122554 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.122467 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:15.122554 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.122512 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:19.122496409 +0000 UTC m=+9.993697601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:15.323831 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:15.323794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:15.324021 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.324005 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:15.324088 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.324029 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:15.324088 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.324041 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:15.324186 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.324098 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:08:19.324080805 +0000 UTC m=+10.195281998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:15.672288 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:15.672248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:15.672771 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.672372 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:15.672771 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:15.672427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:15.672771 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:15.672505 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:16.670091 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:16.670060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:16.670283 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:16.670186 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:17.669890 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:17.669847 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:17.670337 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:17.669994 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:17.670403 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:17.670366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:17.670483 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:17.670460 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:18.670978 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:18.670788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:18.670978 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:18.670916 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:19.159206 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:19.159169 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:19.159387 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:19.159220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:19.159387 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.159329 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:19.159387 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.159334 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:19.159557 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.159390 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:27.159371695 +0000 UTC m=+18.030572889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:19.159557 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.159411 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:27.159400749 +0000 UTC m=+18.030601946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:19.360909 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:19.360873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:19.361077 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.361028 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:19.361077 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.361046 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:19.361077 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.361058 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:19.361213 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.361112 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:08:27.361094382 +0000 UTC m=+18.232295572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:19.671613 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:19.670088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:19.671613 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.670211 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:19.672144 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:19.671731 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:19.672144 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:19.671815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:20.670406 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:20.670375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:20.670574 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:20.670497 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:21.670759 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:21.670725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:21.671225 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:21.670850 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:21.671225 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:21.671194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:21.671715 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:21.671299 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:22.670764 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:22.670733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:22.671126 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:22.670821 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:23.670768 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:23.670733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:23.671207 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:23.670862 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:23.671207 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:23.670884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:23.671207 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:23.670975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:24.669827 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:24.669793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:24.669995 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:24.669926 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:25.670834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:25.670796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:25.671243 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:25.670842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:25.671243 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:25.670929 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:25.671243 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:25.671050 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:26.669861 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:26.669834 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:26.670019 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:26.669944 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:27.224517 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:27.224476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:27.225000 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:27.224574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:27.225000 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.224644 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:27.225000 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.224699 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:27.225000 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.224733 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:43.224712273 +0000 UTC m=+34.095913487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:27.225000 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.224754 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:43.224745898 +0000 UTC m=+34.095947088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:27.425964 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:27.425926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:27.426141 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.426064 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:27.426141 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.426089 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:27.426141 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.426101 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:27.426311 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.426164 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:08:43.426145078 +0000 UTC m=+34.297346267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:27.670781 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:27.670737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:27.670967 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.670854 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:27.670967 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:27.670916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:27.671078 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:27.671032 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:28.670795 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:28.670763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:28.671194 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:28.670881 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:29.671500 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:29.671463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:29.671987 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:29.671578 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:29.671987 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:29.671651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:29.671987 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:29.671790 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:30.669970 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:30.669936 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:30.670102 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:30.670027 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:31.670839 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.670465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:31.671610 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:31.671566 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:31.674468 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.670465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:31.674468 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:31.671912 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:31.745880 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.745810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tjgzh" event={"ID":"e5b9839d-062b-4dff-aaab-f3d18085fe1f","Type":"ContainerStarted","Data":"db40b5beeddcb8732eeffff9996b95f3a42f0abff52636e5228c37a1defe4d45"} Jul 28 10:08:31.748771 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.748746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"cf5332555bdf6bd11020e283b9ca1a434fc209c7184929ba43068d359f63a350"} Jul 28 10:08:31.748896 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.748813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"c624d99b021c92c71b437bb2cc484c749a276b6f553b18c6733f967523e24ef7"} Jul 28 10:08:31.748896 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.748855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"46811315ac036bee7a55417009213ae835e86d1ee69ba8f4a016f22f91b8491c"} Jul 28 10:08:31.748973 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.748895 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"6cd645e109a34aa2629e9c41929e1755dcc05b03b2b8b2455e93e2f91b1ae2c0"} Jul 28 10:08:31.748973 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.748925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"b86250b2ee25d347e4323c2a90e4a9312a735d0fae3e0d3a0a960f1422131f46"} Jul 28 10:08:31.748973 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.748960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"76fecc0856c88127fd33fdba8bb3b3ec093b6817f4934544c5ba57e4cf69108b"} Jul 28 10:08:31.750650 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.750627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" event={"ID":"3cd0084e185b4041597a99660d45f31b","Type":"ContainerStarted","Data":"bb444d750080c2137f13e9d579920d921907d8058db09a7f4bf26c9377728503"} Jul 28 10:08:31.752151 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.752118 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" event={"ID":"bc5894d7-0660-4bf2-a5df-8502004ccb38","Type":"ContainerStarted","Data":"9fc29e318267b7a42cced7757f5a98196ff609a0db0c69aa9fbc52f2923efd38"} Jul 28 10:08:31.753550 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.753530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" event={"ID":"37fed524-d60e-4a6c-a693-b2039cff7e78","Type":"ContainerStarted","Data":"7339a253918a853be701135015420ca0e21592dd4981874da474a12091669c80"} Jul 28 10:08:31.754942 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.754917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8d9xc" event={"ID":"75355376-580f-4b6c-a2d5-12c4938c5442","Type":"ContainerStarted","Data":"5ea1df2e8ccff26bea9b122df5595bead20304b3dc5a07775bcacdcb5c7d8a09"} Jul 28 10:08:31.756528 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.756503 2564 generic.go:356] "Generic (PLEG): container finished" podID="58bb0eef-bfa4-48f2-822e-feec47bdff90" containerID="826c07d894d2624bac497dcc2a85a61bc5a8e6acaca28ae5e3c7c18da7ed1015" exitCode=0 Jul 28 10:08:31.756603 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.756535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerDied","Data":"826c07d894d2624bac497dcc2a85a61bc5a8e6acaca28ae5e3c7c18da7ed1015"} Jul 28 10:08:31.758537 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.758105 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gvzkw" event={"ID":"c7b3e677-1de7-4eb1-9be9-6d1633d4d63b","Type":"ContainerStarted","Data":"c848ed69caf4faba56919cb7545163657f0ff4e8626dd81b699c74a72294f896"} Jul 28 10:08:31.759603 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.759585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bhkmj" event={"ID":"71338c5e-4d44-435c-86c7-90d3a2565f3f","Type":"ContainerStarted","Data":"2edf8bf271550030045fd345bf0e23b4b13ab5208fa1c384d9c8cdf90f3610ad"} Jul 28 10:08:31.761238 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.761196 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tjgzh" podStartSLOduration=8.390664672 podStartE2EDuration="22.761184187s" totalImagesPullingTime="14.370519515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:31.76097464 +0000 UTC m=+22.632175849" watchObservedRunningTime="2026-07-28 10:08:31.761184187 +0000 UTC m=+22.632385399" Jul 28 10:08:31.794494 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.794449 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wvdgn" podStartSLOduration=4.140356306 podStartE2EDuration="22.794435865s" totalImagesPullingTime="18.654079559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:31.794225037 +0000 UTC m=+22.665426275" watchObservedRunningTime="2026-07-28 10:08:31.794435865 +0000 UTC m=+22.665637076" Jul 28 10:08:31.794907 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.794884 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gvzkw" podStartSLOduration=4.143864207 podStartE2EDuration="22.794877398s" totalImagesPullingTime="18.651013191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:31.777731026 +0000 UTC m=+22.648932240" watchObservedRunningTime="2026-07-28 10:08:31.794877398 +0000 UTC m=+22.666078610" Jul 28 10:08:31.811338 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.811296 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bhkmj" podStartSLOduration=4.118257227 podStartE2EDuration="22.811281671s" totalImagesPullingTime="18.693024444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:31.810976184 +0000 UTC m=+22.682177396" watchObservedRunningTime="2026-07-28 10:08:31.811281671 +0000 UTC m=+22.682482883" Jul 28 10:08:31.850737 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.850663 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8d9xc" podStartSLOduration=4.168635004 podStartE2EDuration="22.850643084s" totalImagesPullingTime="18.68200808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:31.850567099 +0000 UTC m=+22.721768311" watchObservedRunningTime="2026-07-28 10:08:31.850643084 +0000 UTC m=+22.721844297" Jul 28 10:08:31.865896 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.865850 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-25.ec2.internal" podStartSLOduration=20.865834476 podStartE2EDuration="20.865834476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:31.865340176 +0000 UTC m=+22.736541386" watchObservedRunningTime="2026-07-28 10:08:31.865834476 +0000 UTC m=+22.737035688" Jul 28 10:08:31.959834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:31.959799 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:32.041209 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.041183 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:32.228343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.228322 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 10:08:32.254709 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.254659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:32.551925 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.551814 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T10:08:32.228339171Z","UUID":"3b920667-0e9a-4efb-b370-ae85686b0237","Handler":null,"Name":"","Endpoint":""} Jul 28 10:08:32.553358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.553333 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 10:08:32.553473 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.553376 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 10:08:32.670092 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.670064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:32.670288 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:32.670183 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:32.764031 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.763999 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" event={"ID":"37fed524-d60e-4a6c-a693-b2039cff7e78","Type":"ContainerStarted","Data":"f77e7f3bf2302ade2f620d878796cf92d9148f157ba929e362a9030066806e18"} Jul 28 10:08:32.765842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.765712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-clmsw" event={"ID":"a498780a-bdbb-4b8d-8633-aef26c9c17a0","Type":"ContainerStarted","Data":"4ad2cfad769d9e6f7e02a8b15b5511e48285f1ff860fb47760f2ffe236c889bc"} Jul 28 10:08:32.781295 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.781246 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-clmsw" podStartSLOduration=5.106474779 podStartE2EDuration="23.781227917s" totalImagesPullingTime="18.674753138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:32.780977595 +0000 UTC m=+23.652178808" watchObservedRunningTime="2026-07-28 10:08:32.781227917 +0000 UTC m=+23.652429131" Jul 28 10:08:32.912235 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:32.912153 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:33.012685 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:33.012637 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:33.670860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:33.670775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:33.671045 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:33.670903 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:33.671045 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:33.670964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:33.671176 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:33.671080 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:33.771009 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:33.770975 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" event={"ID":"37fed524-d60e-4a6c-a693-b2039cff7e78","Type":"ContainerStarted","Data":"547cbd13ddf3169726e90b0a8df9c10df0d3ba26d4b27d4362a6fa453e384d88"} Jul 28 10:08:33.789842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:33.789799 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jspvd" podStartSLOduration=4.053683148 podStartE2EDuration="24.789784201s" totalImagesPullingTime="20.736101053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:33.789280622 +0000 UTC m=+24.660481834" watchObservedRunningTime="2026-07-28 10:08:33.789784201 +0000 UTC m=+24.660985412" Jul 28 10:08:34.235294 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:34.235104 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:34.331940 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:34.331892 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:34.433790 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:34.433752 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:34.670054 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:34.670023 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:34.670236 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:34.670143 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:34.777160 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:34.777124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"30a0b31d149a6000e513aa55ff58d49db172bad663b4ea98fcb798a9c6a07a8f"} Jul 28 10:08:35.177678 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.177625 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.245013 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.244949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:35.255024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.254983 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:35.255809 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.255790 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:35.670173 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.670144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:35.670348 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:35.670264 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:35.670348 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.670321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:35.670473 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:35.670446 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:35.780081 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.780058 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8d9xc" Jul 28 10:08:35.850833 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:35.850801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.247859 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.247660 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.348546 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.348520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.670677 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.670649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:36.670870 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:36.670757 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:36.783217 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.783186 2564 generic.go:356] "Generic (PLEG): container finished" podID="58bb0eef-bfa4-48f2-822e-feec47bdff90" containerID="63d3842d5eab5d9cbec722779f1dca193816b35ddff6d6c3b1e1f70e912931f1" exitCode=0 Jul 28 10:08:36.783965 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.783270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerDied","Data":"63d3842d5eab5d9cbec722779f1dca193816b35ddff6d6c3b1e1f70e912931f1"} Jul 28 10:08:36.787135 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.787115 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" event={"ID":"ef2dbf6c-8573-431b-9797-18c7b5c6000c","Type":"ContainerStarted","Data":"2601b9827627f0014a053ff3093d80dce196c4b0eeebdbb81142bb0b3a39b351"} Jul 28 10:08:36.836848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.836808 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" podStartSLOduration=8.945337107 podStartE2EDuration="27.836796259s" totalImagesPullingTime="18.891459152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:36.836133962 +0000 UTC m=+27.707335173" watchObservedRunningTime="2026-07-28 10:08:36.836796259 +0000 UTC m=+27.707997472" Jul 28 10:08:36.915931 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.915908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:36.974023 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:36.973955 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.203617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.203548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:37.670114 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.670081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:37.670287 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.670086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:37.670287 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:37.670221 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:37.670400 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:37.670308 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:37.791842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.791809 2564 generic.go:356] "Generic (PLEG): container finished" podID="58bb0eef-bfa4-48f2-822e-feec47bdff90" containerID="9616a287b33b6ccc0b0c240498077dd8d1c365e28c2d827284d62faf9ba16428" exitCode=0 Jul 28 10:08:37.792228 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.791899 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerDied","Data":"9616a287b33b6ccc0b0c240498077dd8d1c365e28c2d827284d62faf9ba16428"} Jul 28 10:08:37.792368 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.792320 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:37.792475 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.792398 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:37.792475 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.792446 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:37.809225 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.809205 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:37.809321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:37.809304 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:08:38.060828 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.060762 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zz62r"] Jul 28 10:08:38.060956 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.060875 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:38.060996 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:38.060964 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:38.064190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.064160 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnq8m"] Jul 28 10:08:38.064342 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.064283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:38.064410 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:38.064375 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:38.064857 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.064836 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bswb7"] Jul 28 10:08:38.064992 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.064945 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:38.065071 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:38.065050 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:38.796241 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.796067 2564 generic.go:356] "Generic (PLEG): container finished" podID="58bb0eef-bfa4-48f2-822e-feec47bdff90" containerID="fdc4e18470bc20d6dad2e0c1b05f55a658fa9f75532c4e31a17cde428547e9f7" exitCode=0 Jul 28 10:08:38.796657 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:38.796147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerDied","Data":"fdc4e18470bc20d6dad2e0c1b05f55a658fa9f75532c4e31a17cde428547e9f7"} Jul 28 10:08:39.672059 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:39.672027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:39.672263 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:39.672112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:39.672263 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:39.672154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:39.672263 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:39.672163 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:39.672263 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:39.672231 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:39.672456 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:39.672353 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:41.670578 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:41.670152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:41.670578 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:41.670187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:41.670578 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:41.670155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:41.670578 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:41.670292 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:41.670578 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:41.670384 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:41.670578 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:41.670471 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:43.251490 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.251468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:43.251900 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.251505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:43.251900 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.251594 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:43.251900 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.251612 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:43.251900 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.251647 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs podName:4f22e723-9f46-4b50-8a3f-e8d624539b30 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:15.251634235 +0000 UTC m=+66.122835424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs") pod "network-metrics-daemon-bswb7" (UID: "4f22e723-9f46-4b50-8a3f-e8d624539b30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 10:08:43.251900 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.251661 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret podName:a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:15.251654562 +0000 UTC m=+66.122855752 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret") pod "global-pull-secret-syncer-zz62r" (UID: "a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26") : object "kube-system"/"original-pull-secret" not registered Jul 28 10:08:43.453358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.453294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:43.453484 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.453465 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 10:08:43.453533 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.453491 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 10:08:43.453533 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.453502 2564 projected.go:196] Error preparing data for projected volume kube-api-access-r5m9m for pod openshift-network-diagnostics/network-check-target-dnq8m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:43.453594 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.453552 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m podName:6893d4b7-a33c-4886-bf2f-5ad28663106c nodeName:}" failed. No retries permitted until 2026-07-28 10:09:15.453538348 +0000 UTC m=+66.324739558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5m9m" (UniqueName: "kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m") pod "network-check-target-dnq8m" (UID: "6893d4b7-a33c-4886-bf2f-5ad28663106c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 10:08:43.670751 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.670726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:43.670847 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.670726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:43.670847 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.670829 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bswb7" podUID="4f22e723-9f46-4b50-8a3f-e8d624539b30" Jul 28 10:08:43.670917 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.670890 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zz62r" podUID="a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26" Jul 28 10:08:43.670917 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.670732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:43.670975 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:43.670952 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnq8m" podUID="6893d4b7-a33c-4886-bf2f-5ad28663106c" Jul 28 10:08:43.809902 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.809872 2564 generic.go:356] "Generic (PLEG): container finished" podID="58bb0eef-bfa4-48f2-822e-feec47bdff90" containerID="b2b41fb9f6cb03101b22ea12e53c279d72ba1021288f37b601bd13523acafa38" exitCode=0 Jul 28 10:08:43.810003 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.809913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerDied","Data":"b2b41fb9f6cb03101b22ea12e53c279d72ba1021288f37b601bd13523acafa38"} Jul 28 10:08:43.993655 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.993635 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-25.ec2.internal" event="NodeReady" Jul 28 10:08:43.993760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:43.993749 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 10:08:44.041139 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.041112 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t2xdd"] Jul 28 10:08:44.050629 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.050609 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5qg6s"] Jul 28 10:08:44.050758 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.050743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.054026 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.053859 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kvgz4\"" Jul 28 10:08:44.054026 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.053861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 10:08:44.054026 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.053867 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 10:08:44.058607 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.058578 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qg6s"] Jul 28 10:08:44.058700 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.058616 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t2xdd"] Jul 28 10:08:44.058764 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.058731 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.060817 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.060769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 10:08:44.060912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.060843 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 10:08:44.060912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.060891 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 10:08:44.061156 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.061140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7qffd\"" Jul 28 10:08:44.159059 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.159038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-config-volume\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.159161 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.159062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9x8c\" (UniqueName: \"kubernetes.io/projected/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-kube-api-access-r9x8c\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.159161 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.159086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-tmp-dir\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.159161 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.159133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25-cert\") pod \"ingress-canary-5qg6s\" (UID: \"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25\") " pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.159280 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.159191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglgc\" (UniqueName: \"kubernetes.io/projected/fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25-kube-api-access-vglgc\") pod \"ingress-canary-5qg6s\" (UID: \"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25\") " pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.159280 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.159238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.260346 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-config-volume\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9x8c\" (UniqueName: \"kubernetes.io/projected/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-kube-api-access-r9x8c\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-tmp-dir\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25-cert\") pod \"ingress-canary-5qg6s\" (UID: \"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25\") " pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglgc\" (UniqueName: \"kubernetes.io/projected/fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25-kube-api-access-vglgc\") pod \"ingress-canary-5qg6s\" (UID: \"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25\") " pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:44.260581 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:44.260642 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls podName:3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:44.760623752 +0000 UTC m=+35.631824942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls") pod "dns-default-t2xdd" (UID: "3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d") : secret "dns-default-metrics-tls" not found Jul 28 10:08:44.260860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-tmp-dir\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.261102 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.260962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-config-volume\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.264470 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.264454 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25-cert\") pod \"ingress-canary-5qg6s\" (UID: \"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25\") " pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.269287 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.269267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9x8c\" (UniqueName: \"kubernetes.io/projected/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-kube-api-access-r9x8c\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.269383 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.269272 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglgc\" (UniqueName: \"kubernetes.io/projected/fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25-kube-api-access-vglgc\") pod \"ingress-canary-5qg6s\" (UID: \"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25\") " pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.368058 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.367997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5qg6s" Jul 28 10:08:44.544968 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.544806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5qg6s"] Jul 28 10:08:44.548278 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:44.548237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba6bf81_d9ff_41d8_a5a8_6c84ec6f4f25.slice/crio-27ca1d47ec3246f029fe25818fdb8bdd96e4ca370b1c3ead8597505df292ab05 WatchSource:0}: Error finding container 27ca1d47ec3246f029fe25818fdb8bdd96e4ca370b1c3ead8597505df292ab05: Status 404 returned error can't find the container with id 27ca1d47ec3246f029fe25818fdb8bdd96e4ca370b1c3ead8597505df292ab05 Jul 28 10:08:44.764183 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.764154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:44.767065 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:44.764599 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 10:08:44.767065 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:44.764702 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls podName:3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:45.764663286 +0000 UTC m=+36.635864489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls") pod "dns-default-t2xdd" (UID: "3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d") : secret "dns-default-metrics-tls" not found Jul 28 10:08:44.813546 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.813517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qg6s" event={"ID":"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25","Type":"ContainerStarted","Data":"27ca1d47ec3246f029fe25818fdb8bdd96e4ca370b1c3ead8597505df292ab05"} Jul 28 10:08:44.816351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.816329 2564 generic.go:356] "Generic (PLEG): container finished" podID="58bb0eef-bfa4-48f2-822e-feec47bdff90" containerID="ad71eb4069b291358420b87cc4681b28cba3e0847b839b8af1a8610da57d3cd4" exitCode=0 Jul 28 10:08:44.816438 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:44.816359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerDied","Data":"ad71eb4069b291358420b87cc4681b28cba3e0847b839b8af1a8610da57d3cd4"} Jul 28 10:08:45.464396 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.464362 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-rwz6k"] Jul 28 10:08:45.502783 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.502741 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76b8d776f9-wfnxj"] Jul 28 10:08:45.502947 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.502881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.505431 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.505404 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4f7ch\"" Jul 28 10:08:45.505785 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.505766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 10:08:45.506100 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.506078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 10:08:45.506209 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.506082 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 10:08:45.506209 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.506086 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 10:08:45.511123 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.511037 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 10:08:45.518821 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.518801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-rwz6k"] Jul 28 10:08:45.518948 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.518836 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b8d776f9-wfnxj"] Jul 28 10:08:45.518948 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.518924 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.521823 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.521804 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 10:08:45.522554 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.522536 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 10:08:45.522695 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.522561 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 10:08:45.522695 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.522569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8sdfm\"" Jul 28 10:08:45.522845 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.522742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 10:08:45.522899 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.522856 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 10:08:45.522969 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.522960 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 10:08:45.650718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.650690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:45.670231 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.670203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:08:45.670349 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.670203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:08:45.670349 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.670330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:08:45.672894 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.672659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwnjm\"" Jul 28 10:08:45.673017 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.672902 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 10:08:45.673086 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.673041 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 10:08:45.673086 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.673050 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 10:08:45.673190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.673119 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgfjj\"" Jul 28 10:08:45.673190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.673165 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 10:08:45.675260 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52hqt\" (UniqueName: \"kubernetes.io/projected/7dc98088-96cc-451e-bf44-35c4da4d9d74-kube-api-access-52hqt\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.675371 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc98088-96cc-451e-bf44-35c4da4d9d74-service-ca-bundle\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.675371 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-default-certificate\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.675371 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5cm\" (UniqueName: \"kubernetes.io/projected/f2606335-2452-486c-9446-f6e11a09c116-kube-api-access-9k5cm\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.675535 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dc98088-96cc-451e-bf44-35c4da4d9d74-serving-cert\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.675535 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.675535 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.675535 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dc98088-96cc-451e-bf44-35c4da4d9d74-tmp\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.675754 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dc98088-96cc-451e-bf44-35c4da4d9d74-snapshots\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.675754 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-stats-auth\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.675754 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.675681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc98088-96cc-451e-bf44-35c4da4d9d74-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.712325 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.712303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:45.776405 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:45.776535 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc98088-96cc-451e-bf44-35c4da4d9d74-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.776535 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52hqt\" (UniqueName: \"kubernetes.io/projected/7dc98088-96cc-451e-bf44-35c4da4d9d74-kube-api-access-52hqt\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.776650 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc98088-96cc-451e-bf44-35c4da4d9d74-service-ca-bundle\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.776735 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-default-certificate\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.776735 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5cm\" (UniqueName: \"kubernetes.io/projected/f2606335-2452-486c-9446-f6e11a09c116-kube-api-access-9k5cm\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.776826 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dc98088-96cc-451e-bf44-35c4da4d9d74-serving-cert\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.776826 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.776826 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.776961 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dc98088-96cc-451e-bf44-35c4da4d9d74-tmp\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.776961 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dc98088-96cc-451e-bf44-35c4da4d9d74-snapshots\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.776961 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.776926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-stats-auth\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.777093 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:45.777008 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 10:08:45.777093 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:45.777080 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls podName:3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:47.777056777 +0000 UTC m=+38.648257970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls") pod "dns-default-t2xdd" (UID: "3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d") : secret "dns-default-metrics-tls" not found Jul 28 10:08:45.777506 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.777485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc98088-96cc-451e-bf44-35c4da4d9d74-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.777602 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:45.777582 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 10:08:45.777689 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:45.777632 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:46.277616135 +0000 UTC m=+37.148817328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : secret "router-metrics-certs-default" not found Jul 28 10:08:45.777756 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:45.777737 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:46.27772467 +0000 UTC m=+37.148925864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : configmap references non-existent config key: service-ca.crt Jul 28 10:08:45.777811 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.777770 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc98088-96cc-451e-bf44-35c4da4d9d74-service-ca-bundle\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.778253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.778079 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dc98088-96cc-451e-bf44-35c4da4d9d74-tmp\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.778479 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.778452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dc98088-96cc-451e-bf44-35c4da4d9d74-snapshots\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.781430 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.781410 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dc98088-96cc-451e-bf44-35c4da4d9d74-serving-cert\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.781562 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.781544 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-default-certificate\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.781615 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.781575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-stats-auth\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.790161 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.788268 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52hqt\" (UniqueName: \"kubernetes.io/projected/7dc98088-96cc-451e-bf44-35c4da4d9d74-kube-api-access-52hqt\") pod \"insights-operator-5885fdb759-rwz6k\" (UID: \"7dc98088-96cc-451e-bf44-35c4da4d9d74\") " pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.790161 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.788319 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5cm\" (UniqueName: \"kubernetes.io/projected/f2606335-2452-486c-9446-f6e11a09c116-kube-api-access-9k5cm\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:45.814930 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.814899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" Jul 28 10:08:45.822381 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.822354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z96mn" event={"ID":"58bb0eef-bfa4-48f2-822e-feec47bdff90","Type":"ContainerStarted","Data":"23ae0e4780c7b2a0600fe7795bd58b8f263ababa0b5554fe46dc232d43c91631"} Jul 28 10:08:45.844848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.844810 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z96mn" podStartSLOduration=8.208051007 podStartE2EDuration="36.844797887s" totalImagesPullingTime="28.63674688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:45.843427005 +0000 UTC m=+36.714628217" watchObservedRunningTime="2026-07-28 10:08:45.844797887 +0000 UTC m=+36.715999139" Jul 28 10:08:45.976911 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.976881 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-rwz6k"] Jul 28 10:08:45.978215 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:45.978184 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:45.980453 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:08:45.980433 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc98088_96cc_451e_bf44_35c4da4d9d74.slice/crio-d652ac499af28f34a39ab35495e25e0060dee9b1bea72fbcee583a962226f640 WatchSource:0}: Error finding container d652ac499af28f34a39ab35495e25e0060dee9b1bea72fbcee583a962226f640: Status 404 returned error can't find the container with id d652ac499af28f34a39ab35495e25e0060dee9b1bea72fbcee583a962226f640 Jul 28 10:08:46.071368 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:46.071306 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:46.280594 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:46.280554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:46.280748 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:46.280601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:46.280748 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:46.280728 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:47.280703633 +0000 UTC m=+38.151904842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : configmap references non-existent config key: service-ca.crt Jul 28 10:08:46.280866 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:46.280768 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 10:08:46.280866 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:46.280836 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:47.280822641 +0000 UTC m=+38.152023831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : secret "router-metrics-certs-default" not found Jul 28 10:08:46.825403 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:46.825373 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" event={"ID":"7dc98088-96cc-451e-bf44-35c4da4d9d74","Type":"ContainerStarted","Data":"d652ac499af28f34a39ab35495e25e0060dee9b1bea72fbcee583a962226f640"} Jul 28 10:08:47.289376 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.289342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:47.289376 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.289383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:47.289620 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:47.289493 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 10:08:47.289620 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:47.289555 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:49.28953518 +0000 UTC m=+40.160736398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : secret "router-metrics-certs-default" not found Jul 28 10:08:47.289760 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:47.289638 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:49.289614821 +0000 UTC m=+40.160816027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : configmap references non-existent config key: service-ca.crt Jul 28 10:08:47.355310 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.355263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:47.458051 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.457951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:47.794358 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.794323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:47.794518 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:47.794468 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 10:08:47.794597 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:47.794542 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls podName:3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:51.794520813 +0000 UTC m=+42.665722003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls") pod "dns-default-t2xdd" (UID: "3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d") : secret "dns-default-metrics-tls" not found Jul 28 10:08:47.829110 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.829083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5qg6s" event={"ID":"fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25","Type":"ContainerStarted","Data":"7e3b4fa277aa182fd90240dd955a0618527a5c9e22f962dc7ba0b1c44f3c0950"} Jul 28 10:08:47.854231 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:47.854187 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5qg6s" podStartSLOduration=1.371355729 podStartE2EDuration="3.854167468s" totalImagesPullingTime="2.482811739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:47.853530677 +0000 UTC m=+38.724731892" watchObservedRunningTime="2026-07-28 10:08:47.854167468 +0000 UTC m=+38.725368680" Jul 28 10:08:49.305833 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.305581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:49.305833 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:49.305756 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.30573897 +0000 UTC m=+44.176940163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : configmap references non-existent config key: service-ca.crt Jul 28 10:08:49.306245 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.305862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:49.306245 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:49.305992 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 10:08:49.306245 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:49.306049 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.306035016 +0000 UTC m=+44.177236210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : secret "router-metrics-certs-default" not found Jul 28 10:08:49.467183 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.467136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:49.565467 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.565396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:49.835492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.835403 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" event={"ID":"7dc98088-96cc-451e-bf44-35c4da4d9d74","Type":"ContainerStarted","Data":"71a13cb4c15d4a6cd640aaa74114e5cb23b22d100776373c7454b1f6787f7bb0"} Jul 28 10:08:49.853511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.853466 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" podStartSLOduration=1.977205857 podStartE2EDuration="4.853451417s" totalImagesPullingTime="2.87624556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:49.852374223 +0000 UTC m=+40.723575434" watchObservedRunningTime="2026-07-28 10:08:49.853451417 +0000 UTC m=+40.724652647" Jul 28 10:08:49.977034 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:49.976997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:50.078297 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.078266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:50.193787 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.193708 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-swz2d"] Jul 28 10:08:50.215891 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.215867 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:50.225337 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.225304 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swz2d"] Jul 28 10:08:50.225433 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.225417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.227841 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.227820 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 10:08:50.227951 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.227822 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 10:08:50.227951 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.227893 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsm7x\"" Jul 28 10:08:50.314232 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.314208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.314515 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.314234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.314515 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.314263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a74dd63-e2e6-4c30-9a09-9c91791e7658-data-volume\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.314515 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.314279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthmb\" (UniqueName: \"kubernetes.io/projected/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-api-access-nthmb\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.314515 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.314373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a74dd63-e2e6-4c30-9a09-9c91791e7658-crio-socket\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.364011 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.363967 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:50.415618 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.415594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.415730 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.415627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.415730 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.415660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a74dd63-e2e6-4c30-9a09-9c91791e7658-data-volume\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.415815 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.415729 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 10:08:50.415815 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.415758 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 10:08:50.415815 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.415789 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:50.915770556 +0000 UTC m=+41.786971752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : configmap "kube-rbac-proxy" not found Jul 28 10:08:50.415815 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.415808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nthmb\" (UniqueName: \"kubernetes.io/projected/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-api-access-nthmb\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.415976 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.415905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a74dd63-e2e6-4c30-9a09-9c91791e7658-crio-socket\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.415976 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.415942 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:50.915917186 +0000 UTC m=+41.787118390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : secret "insights-runtime-extractor-tls" not found Jul 28 10:08:50.416075 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.415983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a74dd63-e2e6-4c30-9a09-9c91791e7658-data-volume\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.416075 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.416060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a74dd63-e2e6-4c30-9a09-9c91791e7658-crio-socket\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.425814 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.425795 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthmb\" (UniqueName: \"kubernetes.io/projected/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-api-access-nthmb\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.463736 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.463638 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:50.919172 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.919135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.919334 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:50.919195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:50.919334 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.919243 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 10:08:50.919334 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.919316 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:51.919295296 +0000 UTC m=+42.790496490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : configmap "kube-rbac-proxy" not found Jul 28 10:08:50.919488 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.919341 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 10:08:50.919488 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:50.919419 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:51.919402586 +0000 UTC m=+42.790603775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : secret "insights-runtime-extractor-tls" not found Jul 28 10:08:51.826843 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:51.826812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:51.827195 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:51.826912 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 10:08:51.827195 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:51.826961 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls podName:3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:59.826948994 +0000 UTC m=+50.698150184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls") pod "dns-default-t2xdd" (UID: "3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d") : secret "dns-default-metrics-tls" not found Jul 28 10:08:51.927637 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:51.927603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:51.927637 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:51.927640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:51.927851 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:51.927705 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 10:08:51.927851 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:51.927773 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.927751752 +0000 UTC m=+44.798952942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : configmap "kube-rbac-proxy" not found Jul 28 10:08:51.927851 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:51.927817 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 10:08:51.927959 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:51.927861 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.927849312 +0000 UTC m=+44.799050516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : secret "insights-runtime-extractor-tls" not found Jul 28 10:08:52.040895 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:52.040861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:52.111861 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:52.111767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:08:52.257645 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:52.257620 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gvzkw_c7b3e677-1de7-4eb1-9be9-6d1633d4d63b/dns-node-resolver/0.log" Jul 28 10:08:53.259369 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:53.259341 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tjgzh_e5b9839d-062b-4dff-aaab-f3d18085fe1f/node-ca/0.log" Jul 28 10:08:53.337804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:53.337778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:53.337916 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:53.337809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:08:53.337951 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.337929 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:01.337913617 +0000 UTC m=+52.209114811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : configmap references non-existent config key: service-ca.crt Jul 28 10:08:53.337988 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.337954 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 10:08:53.338025 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.337991 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:01.337979651 +0000 UTC m=+52.209180840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : secret "router-metrics-certs-default" not found Jul 28 10:08:53.658945 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:53.658880 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qg6s_fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25/serve-healthcheck-canary/0.log" Jul 28 10:08:53.942904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:53.942825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:53.942904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:53.942859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:53.943129 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.942956 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 10:08:53.943129 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.942965 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 10:08:53.943129 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.943027 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:57.94300672 +0000 UTC m=+48.814207925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : configmap "kube-rbac-proxy" not found Jul 28 10:08:53.943129 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:53.943070 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:57.943055074 +0000 UTC m=+48.814256269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : secret "insights-runtime-extractor-tls" not found Jul 28 10:08:57.969725 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:57.969689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:57.970145 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:57.969744 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 10:08:57.970145 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:57.969741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:08:57.970145 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:57.969805 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:05.969786116 +0000 UTC m=+56.840987312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : configmap "kube-rbac-proxy" not found Jul 28 10:08:57.970145 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:57.969818 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 10:08:57.970145 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:57.969852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:05.969842621 +0000 UTC m=+56.841043822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : secret "insights-runtime-extractor-tls" not found Jul 28 10:08:59.886285 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:08:59.886255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:08:59.886737 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:59.886373 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 10:08:59.886737 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:08:59.886428 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls podName:3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d nodeName:}" failed. No retries permitted until 2026-07-28 10:09:15.886411085 +0000 UTC m=+66.757612277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls") pod "dns-default-t2xdd" (UID: "3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d") : secret "dns-default-metrics-tls" not found Jul 28 10:09:01.046303 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.046270 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.269073 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.269041 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.384130 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.384058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.395725 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.395700 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5"] Jul 28 10:09:01.397401 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.397383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" Jul 28 10:09:01.399586 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.399564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:01.399728 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.399593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:01.399728 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:01.399718 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 10:09:01.399842 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:01.399773 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:17.399751051 +0000 UTC m=+68.270952241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : configmap references non-existent config key: service-ca.crt Jul 28 10:09:01.399842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.399786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 10:09:01.399842 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:01.399797 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs podName:f2606335-2452-486c-9446-f6e11a09c116 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:17.399786365 +0000 UTC m=+68.270987555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs") pod "router-default-76b8d776f9-wfnxj" (UID: "f2606335-2452-486c-9446-f6e11a09c116") : secret "router-metrics-certs-default" not found Jul 28 10:09:01.399842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.399820 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bn8d7\"" Jul 28 10:09:01.400709 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.400692 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 10:09:01.407746 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.407729 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5"] Jul 28 10:09:01.473250 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.473224 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.500597 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.500571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fl6n\" (UniqueName: \"kubernetes.io/projected/f7884fcc-6c40-4605-9016-2e0084583854-kube-api-access-6fl6n\") pod \"migrator-6865c9967-ms8j5\" (UID: \"f7884fcc-6c40-4605-9016-2e0084583854\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" Jul 28 10:09:01.573389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.573356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.602000 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.601977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fl6n\" (UniqueName: \"kubernetes.io/projected/f7884fcc-6c40-4605-9016-2e0084583854-kube-api-access-6fl6n\") pod \"migrator-6865c9967-ms8j5\" (UID: \"f7884fcc-6c40-4605-9016-2e0084583854\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" Jul 28 10:09:01.611140 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.611114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fl6n\" (UniqueName: \"kubernetes.io/projected/f7884fcc-6c40-4605-9016-2e0084583854-kube-api-access-6fl6n\") pod \"migrator-6865c9967-ms8j5\" (UID: \"f7884fcc-6c40-4605-9016-2e0084583854\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" Jul 28 10:09:01.706717 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.706641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" Jul 28 10:09:01.764634 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.764568 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.822233 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.822205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5"] Jul 28 10:09:01.826224 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:01.826191 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7884fcc_6c40_4605_9016_2e0084583854.slice/crio-aca5e1eabf4477f4f1d74a9224817d76c01239b002edb07b71feecfe74f1579f WatchSource:0}: Error finding container aca5e1eabf4477f4f1d74a9224817d76c01239b002edb07b71feecfe74f1579f: Status 404 returned error can't find the container with id aca5e1eabf4477f4f1d74a9224817d76c01239b002edb07b71feecfe74f1579f Jul 28 10:09:01.827197 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.827114 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:01.864336 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:01.864308 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" event={"ID":"f7884fcc-6c40-4605-9016-2e0084583854","Type":"ContainerStarted","Data":"aca5e1eabf4477f4f1d74a9224817d76c01239b002edb07b71feecfe74f1579f"} Jul 28 10:09:03.393965 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:03.393927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:03.481956 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:03.481887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:03.871061 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:03.871029 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" event={"ID":"f7884fcc-6c40-4605-9016-2e0084583854","Type":"ContainerStarted","Data":"652d3379b2e5c0ab92458d08530d655914bf181165479b052dac45c8890bd0ba"} Jul 28 10:09:03.871311 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:03.871079 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" event={"ID":"f7884fcc-6c40-4605-9016-2e0084583854","Type":"ContainerStarted","Data":"0edff5440f80c7cc4a117437aae0f3d15d8b3d3aec0a82b0962c53e24d1b471f"} Jul 28 10:09:03.890148 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:03.890101 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ms8j5" podStartSLOduration=1.552717567 podStartE2EDuration="2.890088021s" totalImagesPullingTime="1.337370454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:03.888214722 +0000 UTC m=+54.759415934" watchObservedRunningTime="2026-07-28 10:09:03.890088021 +0000 UTC m=+54.761289232" Jul 28 10:09:03.987692 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:03.986325 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:04.081012 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:04.080982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:04.455610 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:04.455578 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:06.037760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:06.037714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:09:06.037760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:06.037760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:09:06.038284 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:06.037865 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 10:09:06.038284 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:06.037918 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls podName:0a74dd63-e2e6-4c30-9a09-9c91791e7658 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:22.037904775 +0000 UTC m=+72.909105965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swz2d" (UID: "0a74dd63-e2e6-4c30-9a09-9c91791e7658") : secret "insights-runtime-extractor-tls" not found Jul 28 10:09:06.038284 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:06.038218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a74dd63-e2e6-4c30-9a09-9c91791e7658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:09:06.907975 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:06.907943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:06.980593 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:06.980564 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:07.117652 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:07.117616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:07.414198 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:07.414171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:07.511171 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:07.511144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:07.613944 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:07.613910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:07.752388 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:07.752319 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:07.831249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:07.831220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:08.103626 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:08.103597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:08.897246 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:08.897216 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:09.118092 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:09.118062 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:09.696712 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:09.696681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:09.808637 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:09.808610 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bbtd" Jul 28 10:09:09.895467 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:09.895441 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:10.294901 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:10.294865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:10.697409 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:10.697322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:10.857765 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:10.857732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:11.003511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:11.003443 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:11.103861 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:11.103837 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:11.494568 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:11.494531 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:11.897591 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:11.897561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:11.954851 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:11.954822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:12.090031 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:12.090006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:12.285492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:12.285468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:12.496253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:12.496223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:14.098271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:14.098231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:14.206044 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:14.206015 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:14.403748 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:14.403658 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:14.698227 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:14.698148 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:15.308249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.308215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:09:15.308249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.308252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:09:15.310797 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.310778 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 10:09:15.311775 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.311762 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 10:09:15.318044 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.318019 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:15.320852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.320832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26-original-pull-secret\") pod \"global-pull-secret-syncer-zz62r\" (UID: \"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26\") " pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:09:15.320952 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.320929 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f22e723-9f46-4b50-8a3f-e8d624539b30-metrics-certs\") pod \"network-metrics-daemon-bswb7\" (UID: \"4f22e723-9f46-4b50-8a3f-e8d624539b30\") " pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:09:15.391890 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.391871 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgfjj\"" Jul 28 10:09:15.394902 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.394887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zz62r" Jul 28 10:09:15.400010 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.399996 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bswb7" Jul 28 10:09:15.510378 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.510344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:09:15.513291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.513237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 10:09:15.523391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.523368 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 10:09:15.533997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.533941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:15.534327 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.534276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5m9m\" (UniqueName: \"kubernetes.io/projected/6893d4b7-a33c-4886-bf2f-5ad28663106c-kube-api-access-r5m9m\") pod \"network-check-target-dnq8m\" (UID: \"6893d4b7-a33c-4886-bf2f-5ad28663106c\") " pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:09:15.554312 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.554286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zz62r"] Jul 28 10:09:15.557293 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:15.557264 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b2ca42_51a0_4b63_bb5b_5615d5ab0f26.slice/crio-7609f439ff898f765da3988e0e226f058c555db76319503cf0fec86296d20e1a WatchSource:0}: Error finding container 7609f439ff898f765da3988e0e226f058c555db76319503cf0fec86296d20e1a: Status 404 returned error can't find the container with id 7609f439ff898f765da3988e0e226f058c555db76319503cf0fec86296d20e1a Jul 28 10:09:15.570726 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.570705 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bswb7"] Jul 28 10:09:15.573289 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:15.573270 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f22e723_9f46_4b50_8a3f_e8d624539b30.slice/crio-6b73f0e416cf38237832083376bc9a65233a0c449c2d13c5f06d40f3d795ddca WatchSource:0}: Error finding container 6b73f0e416cf38237832083376bc9a65233a0c449c2d13c5f06d40f3d795ddca: Status 404 returned error can't find the container with id 6b73f0e416cf38237832083376bc9a65233a0c449c2d13c5f06d40f3d795ddca Jul 28 10:09:15.683888 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.683861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwnjm\"" Jul 28 10:09:15.691891 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.691873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:09:15.841378 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.841308 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnq8m"] Jul 28 10:09:15.844153 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:15.844125 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6893d4b7_a33c_4886_bf2f_5ad28663106c.slice/crio-b800cb299fc52d60db4014cf17d11ec5e43ee74e110089d3e5851ef8e1db3e3e WatchSource:0}: Error finding container b800cb299fc52d60db4014cf17d11ec5e43ee74e110089d3e5851ef8e1db3e3e: Status 404 returned error can't find the container with id b800cb299fc52d60db4014cf17d11ec5e43ee74e110089d3e5851ef8e1db3e3e Jul 28 10:09:15.893469 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.893444 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:15.900078 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.900052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bswb7" event={"ID":"4f22e723-9f46-4b50-8a3f-e8d624539b30","Type":"ContainerStarted","Data":"6b73f0e416cf38237832083376bc9a65233a0c449c2d13c5f06d40f3d795ddca"} Jul 28 10:09:15.901135 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.901112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnq8m" event={"ID":"6893d4b7-a33c-4886-bf2f-5ad28663106c","Type":"ContainerStarted","Data":"b800cb299fc52d60db4014cf17d11ec5e43ee74e110089d3e5851ef8e1db3e3e"} Jul 28 10:09:15.902105 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.902085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zz62r" event={"ID":"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26","Type":"ContainerStarted","Data":"7609f439ff898f765da3988e0e226f058c555db76319503cf0fec86296d20e1a"} Jul 28 10:09:15.914378 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.914360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:09:15.916373 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:15.916357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d-metrics-tls\") pod \"dns-default-t2xdd\" (UID: \"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d\") " pod="openshift-dns/dns-default-t2xdd" Jul 28 10:09:16.164465 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.164389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kvgz4\"" Jul 28 10:09:16.172778 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.172745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2xdd" Jul 28 10:09:16.493052 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.493024 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:16.501631 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.501606 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t2xdd"] Jul 28 10:09:16.505375 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:16.505347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfa7a5e_00f5_4e0b_acc7_3494e9a18f3d.slice/crio-91e3eb4cef62c0490c464557ab10acb539cf7b1efac0de80b173ee5a433a7082 WatchSource:0}: Error finding container 91e3eb4cef62c0490c464557ab10acb539cf7b1efac0de80b173ee5a433a7082: Status 404 returned error can't find the container with id 91e3eb4cef62c0490c464557ab10acb539cf7b1efac0de80b173ee5a433a7082 Jul 28 10:09:16.886434 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.886393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:16.908294 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.908260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bswb7" event={"ID":"4f22e723-9f46-4b50-8a3f-e8d624539b30","Type":"ContainerStarted","Data":"807076da7fdbf02979ff26f3fb01fe6160aa0d2a70dce39ef45eeb1cff9398bb"} Jul 28 10:09:16.908461 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.908324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bswb7" event={"ID":"4f22e723-9f46-4b50-8a3f-e8d624539b30","Type":"ContainerStarted","Data":"3bd85245f48bf69c137886b34a3ba6ddc258e2b342a4c35222f0b9dac87957f8"} Jul 28 10:09:16.909934 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.909881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2xdd" event={"ID":"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d","Type":"ContainerStarted","Data":"91e3eb4cef62c0490c464557ab10acb539cf7b1efac0de80b173ee5a433a7082"} Jul 28 10:09:16.925808 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:16.925756 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bswb7" podStartSLOduration=67.110518043 podStartE2EDuration="1m7.925738395s" totalImagesPullingTime="815.220352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:16.924441771 +0000 UTC m=+67.795642984" watchObservedRunningTime="2026-07-28 10:09:16.925738395 +0000 UTC m=+67.796939610" Jul 28 10:09:17.301171 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.301080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:17.427842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.427274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:17.427842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.427318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:17.428404 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.428371 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2606335-2452-486c-9446-f6e11a09c116-service-ca-bundle\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:17.430904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.430861 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2606335-2452-486c-9446-f6e11a09c116-metrics-certs\") pod \"router-default-76b8d776f9-wfnxj\" (UID: \"f2606335-2452-486c-9446-f6e11a09c116\") " pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:17.503971 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.503939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:17.631768 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.631697 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8sdfm\"" Jul 28 10:09:17.639901 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.639744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:17.790987 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.790950 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b8d776f9-wfnxj"] Jul 28 10:09:17.795136 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:17.795104 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2606335_2452_486c_9446_f6e11a09c116.slice/crio-7f519138f5136f2018eb922d7ece78f31594ccb6e38e75960d3c77be873758fb WatchSource:0}: Error finding container 7f519138f5136f2018eb922d7ece78f31594ccb6e38e75960d3c77be873758fb: Status 404 returned error can't find the container with id 7f519138f5136f2018eb922d7ece78f31594ccb6e38e75960d3c77be873758fb Jul 28 10:09:17.902389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.902269 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:17.916592 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.916551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" event={"ID":"f2606335-2452-486c-9446-f6e11a09c116","Type":"ContainerStarted","Data":"86a2b8de184fb123d74d0bcbb103fc740cc43452ebf4e25d2f3c85c1fdcd4ae9"} Jul 28 10:09:17.916769 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.916619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" event={"ID":"f2606335-2452-486c-9446-f6e11a09c116","Type":"ContainerStarted","Data":"7f519138f5136f2018eb922d7ece78f31594ccb6e38e75960d3c77be873758fb"} Jul 28 10:09:17.936085 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:17.936042 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" podStartSLOduration=32.936029819 podStartE2EDuration="32.936029819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:17.935050986 +0000 UTC m=+68.806252202" watchObservedRunningTime="2026-07-28 10:09:17.936029819 +0000 UTC m=+68.807231030" Jul 28 10:09:18.090548 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:18.090464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:18.640450 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:18.640423 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:18.643684 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:18.643641 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:18.922201 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:18.922117 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2xdd" event={"ID":"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d","Type":"ContainerStarted","Data":"08f2b27a992d851cc6c5af6a8f1ff463ebc9f78909d6a9f533bfa3ba38ca036a"} Jul 28 10:09:18.922487 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:18.922459 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:18.923806 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:18.923787 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76b8d776f9-wfnxj" Jul 28 10:09:19.541190 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:19.541143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:19.640283 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:19.640250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:19.831449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:19.831362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:19.966657 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:19.966622 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.066082 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.066034 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.207282 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.207189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.308508 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.308472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.377184 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.377146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.635942 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.635910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.838734 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.838704 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:20.912574 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:20.912491 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:21.220918 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.220843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:21.419130 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.419099 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:21.934760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.934724 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:21.935239 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.934835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnq8m" event={"ID":"6893d4b7-a33c-4886-bf2f-5ad28663106c","Type":"ContainerStarted","Data":"ba34cf6fd94e5076e7b638070da18065c600831d1efa619415f12c1be1b43025"} Jul 28 10:09:21.935239 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.934971 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:09:21.936654 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.936631 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2xdd" event={"ID":"3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d","Type":"ContainerStarted","Data":"eeedcf3d2ea9b6ea16f91450a9f457aa4bef73b7fc0dff96d6ee53ac39491d32"} Jul 28 10:09:21.936786 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.936696 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t2xdd" Jul 28 10:09:21.937999 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.937981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zz62r" event={"ID":"a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26","Type":"ContainerStarted","Data":"3e72addaca8eb5d2164572cdb89b8b16b00f513e19b5dd22964d0095fc721c5e"} Jul 28 10:09:21.963799 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.963758 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dnq8m" podStartSLOduration=67.781962093 podStartE2EDuration="1m12.963746548s" totalImagesPullingTime="5.181784455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:21.9613167 +0000 UTC m=+72.832517911" watchObservedRunningTime="2026-07-28 10:09:21.963746548 +0000 UTC m=+72.834947759" Jul 28 10:09:21.988896 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:21.988848 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zz62r" podStartSLOduration=67.51105684 podStartE2EDuration="1m12.988831198s" totalImagesPullingTime="5.477774358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:21.988039095 +0000 UTC m=+72.859240307" watchObservedRunningTime="2026-07-28 10:09:21.988831198 +0000 UTC m=+72.860032411" Jul 28 10:09:22.011918 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.011880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t2xdd" podStartSLOduration=35.893728836 podStartE2EDuration="38.011866668s" totalImagesPullingTime="2.118137832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:22.011120783 +0000 UTC m=+72.882322220" watchObservedRunningTime="2026-07-28 10:09:22.011866668 +0000 UTC m=+72.883067894" Jul 28 10:09:22.022898 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.022875 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dc7fb86bd-trztl"] Jul 28 10:09:22.039360 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.039329 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:22.041218 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.041190 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r"] Jul 28 10:09:22.041338 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.041293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.044026 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.043999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 10:09:22.044178 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.044015 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 10:09:22.044178 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.044162 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 10:09:22.046551 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.046530 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bcfzv\"" Jul 28 10:09:22.049857 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.049834 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 10:09:22.063827 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.063799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:09:22.064704 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.064661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc7fb86bd-trztl"] Jul 28 10:09:22.064794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.064712 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r"] Jul 28 10:09:22.064794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.064767 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.066233 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.066211 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a74dd63-e2e6-4c30-9a09-9c91791e7658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swz2d\" (UID: \"0a74dd63-e2e6-4c30-9a09-9c91791e7658\") " pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:09:22.067373 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.067353 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 10:09:22.067524 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.067495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 10:09:22.067524 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.067501 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 10:09:22.067888 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.067870 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xjs5c\"" Jul 28 10:09:22.067970 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.067926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 10:09:22.118796 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.118774 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dc7fb86bd-trztl"] Jul 28 10:09:22.118944 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:22.118925 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-brc59 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" podUID="e3f2c810-2ddf-4190-a01e-22dcf132a0c0" Jul 28 10:09:22.158200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.158175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:22.164217 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brc59\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-kube-api-access-brc59\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sf6w\" (UniqueName: \"kubernetes.io/projected/2ec71851-0381-4ea6-b11e-3a8bd1377db3-kube-api-access-4sf6w\") pod \"managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r\" (UID: \"2ec71851-0381-4ea6-b11e-3a8bd1377db3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.164271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-ca-trust-extracted\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-certificates\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164368 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-trusted-ca\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-installation-pull-secrets\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164435 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-bound-sa-token\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164468 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-tls\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164497 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-image-registry-private-configuration\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.164529 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.164502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ec71851-0381-4ea6-b11e-3a8bd1377db3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r\" (UID: \"2ec71851-0381-4ea6-b11e-3a8bd1377db3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.256214 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.256157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:22.265438 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brc59\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-kube-api-access-brc59\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265514 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sf6w\" (UniqueName: \"kubernetes.io/projected/2ec71851-0381-4ea6-b11e-3a8bd1377db3-kube-api-access-4sf6w\") pod \"managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r\" (UID: \"2ec71851-0381-4ea6-b11e-3a8bd1377db3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.265514 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-ca-trust-extracted\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265514 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-certificates\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265639 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-trusted-ca\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265639 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-installation-pull-secrets\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265639 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-bound-sa-token\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265639 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-tls\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265639 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-image-registry-private-configuration\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.265948 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ec71851-0381-4ea6-b11e-3a8bd1377db3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r\" (UID: \"2ec71851-0381-4ea6-b11e-3a8bd1377db3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.265948 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.265896 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-ca-trust-extracted\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.266490 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.266469 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-certificates\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.266580 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.266526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-trusted-ca\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.268150 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.268130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-installation-pull-secrets\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.268260 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.268241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-image-registry-private-configuration\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.268392 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.268377 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-tls\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.268510 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.268493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ec71851-0381-4ea6-b11e-3a8bd1377db3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r\" (UID: \"2ec71851-0381-4ea6-b11e-3a8bd1377db3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.275354 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.275331 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brc59\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-kube-api-access-brc59\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.275637 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.275616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-bound-sa-token\") pod \"image-registry-6dc7fb86bd-trztl\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.276626 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.276609 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sf6w\" (UniqueName: \"kubernetes.io/projected/2ec71851-0381-4ea6-b11e-3a8bd1377db3-kube-api-access-4sf6w\") pod \"managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r\" (UID: \"2ec71851-0381-4ea6-b11e-3a8bd1377db3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.336880 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.336857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsm7x\"" Jul 28 10:09:22.345883 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.345863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swz2d" Jul 28 10:09:22.351568 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.351549 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:22.388105 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.388086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" Jul 28 10:09:22.502123 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.502092 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swz2d"] Jul 28 10:09:22.505821 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:22.505794 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a74dd63_e2e6_4c30_9a09_9c91791e7658.slice/crio-8969ee8942838b6015cc040163e37d427a0882522a1efc5038f5ca8b5164bcf9 WatchSource:0}: Error finding container 8969ee8942838b6015cc040163e37d427a0882522a1efc5038f5ca8b5164bcf9: Status 404 returned error can't find the container with id 8969ee8942838b6015cc040163e37d427a0882522a1efc5038f5ca8b5164bcf9 Jul 28 10:09:22.554006 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.553948 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r"] Jul 28 10:09:22.557301 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:22.557278 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ec71851_0381_4ea6_b11e_3a8bd1377db3.slice/crio-3e9110e023763953389cdb916bef1ecbbfa065e67c78e208f889ef565c3a97e3 WatchSource:0}: Error finding container 3e9110e023763953389cdb916bef1ecbbfa065e67c78e208f889ef565c3a97e3: Status 404 returned error can't find the container with id 3e9110e023763953389cdb916bef1ecbbfa065e67c78e208f889ef565c3a97e3 Jul 28 10:09:22.944006 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.943925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" event={"ID":"2ec71851-0381-4ea6-b11e-3a8bd1377db3","Type":"ContainerStarted","Data":"3e9110e023763953389cdb916bef1ecbbfa065e67c78e208f889ef565c3a97e3"} Jul 28 10:09:22.945526 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.945425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swz2d" event={"ID":"0a74dd63-e2e6-4c30-9a09-9c91791e7658","Type":"ContainerStarted","Data":"8969ee8942838b6015cc040163e37d427a0882522a1efc5038f5ca8b5164bcf9"} Jul 28 10:09:22.945752 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.945638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:22.952838 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:22.952729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070218 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-installation-pull-secrets\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070303 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-trusted-ca\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070346 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-bound-sa-token\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070384 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-ca-trust-extracted\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070408 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-image-registry-private-configuration\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070440 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brc59\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-kube-api-access-brc59\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070465 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-tls\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.070565 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070493 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-certificates\") pod \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\" (UID: \"e3f2c810-2ddf-4190-a01e-22dcf132a0c0\") " Jul 28 10:09:23.071160 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.070744 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:09:23.071160 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.071115 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:23.071327 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.071302 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-trusted-ca\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.071327 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.071328 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-ca-trust-extracted\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.072019 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.071992 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:09:23.078027 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.078001 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:09:23.078137 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.078032 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:23.080515 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.080469 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-kube-api-access-brc59" (OuterVolumeSpecName: "kube-api-access-brc59") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "kube-api-access-brc59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:09:23.080618 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.080506 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:09:23.081124 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.081096 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e3f2c810-2ddf-4190-a01e-22dcf132a0c0" (UID: "e3f2c810-2ddf-4190-a01e-22dcf132a0c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:09:23.172239 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.172196 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-bound-sa-token\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.172239 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.172231 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-image-registry-private-configuration\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.172410 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.172247 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brc59\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-kube-api-access-brc59\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.172410 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.172262 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-tls\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.172410 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.172274 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-registry-certificates\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.172410 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.172291 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f2c810-2ddf-4190-a01e-22dcf132a0c0-installation-pull-secrets\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:09:23.240704 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.240605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:23.297052 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.297010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:23.949771 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.949576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc7fb86bd-trztl" Jul 28 10:09:23.982831 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.982799 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dc7fb86bd-trztl"] Jul 28 10:09:23.987544 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:23.987488 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dc7fb86bd-trztl"] Jul 28 10:09:25.549115 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:25.549081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:25.649275 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:25.649239 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:25.674855 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:25.674820 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3f2c810-2ddf-4190-a01e-22dcf132a0c0" path="/var/lib/kubelet/pods/e3f2c810-2ddf-4190-a01e-22dcf132a0c0/volumes" Jul 28 10:09:25.707066 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:25.707039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:26.040183 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.040144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:26.088501 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.088472 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-s7fcl"] Jul 28 10:09:26.101620 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.101593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-s7fcl"] Jul 28 10:09:26.101801 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.101704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.104683 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.104652 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 10:09:26.104795 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.104767 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 10:09:26.104869 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.104842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 10:09:26.104926 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.104904 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 10:09:26.106123 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.105994 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 10:09:26.106123 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.106016 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tdsz7\"" Jul 28 10:09:26.123975 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.123939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:26.197404 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.197365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08da5972-f9e9-4b69-a48c-65a3996f2b13-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.197556 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.197421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c77t\" (UniqueName: \"kubernetes.io/projected/08da5972-f9e9-4b69-a48c-65a3996f2b13-kube-api-access-5c77t\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.197556 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.197457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.197556 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.197487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.298766 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.298691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c77t\" (UniqueName: \"kubernetes.io/projected/08da5972-f9e9-4b69-a48c-65a3996f2b13-kube-api-access-5c77t\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.298766 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.298738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.298976 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.298776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.298976 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.298830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08da5972-f9e9-4b69-a48c-65a3996f2b13-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.298976 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:26.298938 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 10:09:26.299143 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:26.299018 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-tls podName:08da5972-f9e9-4b69-a48c-65a3996f2b13 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:26.798999983 +0000 UTC m=+77.670201173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-s7fcl" (UID: "08da5972-f9e9-4b69-a48c-65a3996f2b13") : secret "prometheus-operator-tls" not found Jul 28 10:09:26.299537 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.299515 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08da5972-f9e9-4b69-a48c-65a3996f2b13-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.301326 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.301307 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.308026 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.308004 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c77t\" (UniqueName: \"kubernetes.io/projected/08da5972-f9e9-4b69-a48c-65a3996f2b13-kube-api-access-5c77t\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.448935 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.448903 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:26.802640 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.802599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:26.805208 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:26.805171 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08da5972-f9e9-4b69-a48c-65a3996f2b13-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7fcl\" (UID: \"08da5972-f9e9-4b69-a48c-65a3996f2b13\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:27.011918 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:27.011882 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" Jul 28 10:09:28.352512 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:28.352489 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-s7fcl"] Jul 28 10:09:28.355576 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:28.355549 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08da5972_f9e9_4b69_a48c_65a3996f2b13.slice/crio-d425bee71c95936b9a24fe7e8f9ea0dbb3f3226b9068f594e67be69b191dfe5e WatchSource:0}: Error finding container d425bee71c95936b9a24fe7e8f9ea0dbb3f3226b9068f594e67be69b191dfe5e: Status 404 returned error can't find the container with id d425bee71c95936b9a24fe7e8f9ea0dbb3f3226b9068f594e67be69b191dfe5e Jul 28 10:09:28.949486 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:28.948783 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t2xdd" Jul 28 10:09:28.971228 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:28.971174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" event={"ID":"2ec71851-0381-4ea6-b11e-3a8bd1377db3","Type":"ContainerStarted","Data":"6870aef8ea67d0a3ff6644c39da16159a8f305c48b6eeb87a1dccdc514302971"} Jul 28 10:09:28.974212 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:28.974142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swz2d" event={"ID":"0a74dd63-e2e6-4c30-9a09-9c91791e7658","Type":"ContainerStarted","Data":"901931f76a40ed7c4e9ce1122056c783e21d2557eb7df019588efaf5d0dbfc05"} Jul 28 10:09:28.976258 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:28.976229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" event={"ID":"08da5972-f9e9-4b69-a48c-65a3996f2b13","Type":"ContainerStarted","Data":"d425bee71c95936b9a24fe7e8f9ea0dbb3f3226b9068f594e67be69b191dfe5e"} Jul 28 10:09:28.989261 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:28.989205 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b4f7d8b8-9j96r" podStartSLOduration=1.3227183 podStartE2EDuration="6.989191818s" totalImagesPullingTime="5.666473518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:28.988506736 +0000 UTC m=+79.859707950" watchObservedRunningTime="2026-07-28 10:09:28.989191818 +0000 UTC m=+79.860393082" Jul 28 10:09:29.982516 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:29.982481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" event={"ID":"08da5972-f9e9-4b69-a48c-65a3996f2b13","Type":"ContainerStarted","Data":"ea7512c485d08f55d7c7dd6bfb58bff8a722ee4da8b008cad9d42a43a299af9e"} Jul 28 10:09:29.982965 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:29.982543 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" event={"ID":"08da5972-f9e9-4b69-a48c-65a3996f2b13","Type":"ContainerStarted","Data":"d2bdb3327412a760c4d9c2c3933583f0c0d86fc619756f8622bc848a0c688ae2"} Jul 28 10:09:30.002129 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:30.001850 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7fcl" podStartSLOduration=2.5886286910000003 podStartE2EDuration="4.001830755s" totalImagesPullingTime="1.413202064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:30.000250434 +0000 UTC m=+80.871451673" watchObservedRunningTime="2026-07-28 10:09:30.001830755 +0000 UTC m=+80.873031972" Jul 28 10:09:30.690250 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:30.690211 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:31.223088 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.223057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:31.431377 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.431267 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:31.457258 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.457232 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6"] Jul 28 10:09:31.466938 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.466911 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.469649 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.469621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zxj25\"" Jul 28 10:09:31.469788 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.469621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 10:09:31.469788 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.469687 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 10:09:31.472056 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.472036 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6"] Jul 28 10:09:31.484276 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.484248 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2ldd9"] Jul 28 10:09:31.487659 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.487640 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.490576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.490387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 10:09:31.490576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.490466 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 10:09:31.490576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.490390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nvjpc\"" Jul 28 10:09:31.490827 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.490650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 10:09:31.525915 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.525888 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:31.597312 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.597265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:31.641346 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98c9x\" (UniqueName: \"kubernetes.io/projected/58e91296-2670-4ef1-812d-7bc03b30f9f5-kube-api-access-98c9x\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.641517 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e91296-2670-4ef1-812d-7bc03b30f9f5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.641517 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e91296-2670-4ef1-812d-7bc03b30f9f5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.641517 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-tls\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58e91296-2670-4ef1-812d-7bc03b30f9f5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.641662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-textfile\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b13b45-f814-43d8-82ff-047f0215f2f2-metrics-client-ca\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-wtmp\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641856 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641677 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641856 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-sys\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641856 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-root\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.641856 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.641779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/70b13b45-f814-43d8-82ff-047f0215f2f2-kube-api-access-fzq98\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742415 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-tls\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742415 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742631 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:31.742516 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 10:09:31.742631 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58e91296-2670-4ef1-812d-7bc03b30f9f5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.742631 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-textfile\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742631 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:31.742588 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-tls podName:70b13b45-f814-43d8-82ff-047f0215f2f2 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:32.242567668 +0000 UTC m=+83.113768879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-tls") pod "node-exporter-2ldd9" (UID: "70b13b45-f814-43d8-82ff-047f0215f2f2") : secret "node-exporter-tls" not found Jul 28 10:09:31.742631 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b13b45-f814-43d8-82ff-047f0215f2f2-metrics-client-ca\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-wtmp\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-sys\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-root\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/70b13b45-f814-43d8-82ff-047f0215f2f2-kube-api-access-fzq98\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98c9x\" (UniqueName: \"kubernetes.io/projected/58e91296-2670-4ef1-812d-7bc03b30f9f5-kube-api-access-98c9x\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e91296-2670-4ef1-812d-7bc03b30f9f5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-textfile\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.742933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e91296-2670-4ef1-812d-7bc03b30f9f5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.743421 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.742991 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-wtmp\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.743421 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.743051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-sys\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.743421 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.743088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70b13b45-f814-43d8-82ff-047f0215f2f2-root\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.743421 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.743179 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b13b45-f814-43d8-82ff-047f0215f2f2-metrics-client-ca\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.743421 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.743263 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.743830 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.743803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e91296-2670-4ef1-812d-7bc03b30f9f5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.745350 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.745328 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58e91296-2670-4ef1-812d-7bc03b30f9f5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.745485 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.745348 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.745569 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.745548 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e91296-2670-4ef1-812d-7bc03b30f9f5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.754521 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.754500 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/70b13b45-f814-43d8-82ff-047f0215f2f2-kube-api-access-fzq98\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:31.754620 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.754516 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98c9x\" (UniqueName: \"kubernetes.io/projected/58e91296-2670-4ef1-812d-7bc03b30f9f5-kube-api-access-98c9x\") pod \"openshift-state-metrics-b8f49f5c6-jksc6\" (UID: \"58e91296-2670-4ef1-812d-7bc03b30f9f5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:31.778522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:31.778502 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" Jul 28 10:09:32.012239 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.012217 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6"] Jul 28 10:09:32.014414 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:32.014391 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e91296_2670_4ef1_812d_7bc03b30f9f5.slice/crio-c41fc3d57aded1d0b54f4353dc35c5a9c15ebdc92f90336e1fb7c7473b3ee80e WatchSource:0}: Error finding container c41fc3d57aded1d0b54f4353dc35c5a9c15ebdc92f90336e1fb7c7473b3ee80e: Status 404 returned error can't find the container with id c41fc3d57aded1d0b54f4353dc35c5a9c15ebdc92f90336e1fb7c7473b3ee80e Jul 28 10:09:32.206435 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.206406 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:32.246573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.246546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-tls\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:32.248816 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.248776 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70b13b45-f814-43d8-82ff-047f0215f2f2-node-exporter-tls\") pod \"node-exporter-2ldd9\" (UID: \"70b13b45-f814-43d8-82ff-047f0215f2f2\") " pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:32.306575 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.306545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:32.398191 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.398162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2ldd9" Jul 28 10:09:32.409310 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:32.409274 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b13b45_f814_43d8_82ff_047f0215f2f2.slice/crio-3ad2935bd65ba27f40de3f2e8327a5e16ff36e6419b65ffd2fdf32be76b76cd7 WatchSource:0}: Error finding container 3ad2935bd65ba27f40de3f2e8327a5e16ff36e6419b65ffd2fdf32be76b76cd7: Status 404 returned error can't find the container with id 3ad2935bd65ba27f40de3f2e8327a5e16ff36e6419b65ffd2fdf32be76b76cd7 Jul 28 10:09:32.475018 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.474973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:32.580887 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.580859 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:32.647101 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.647045 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:32.997541 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.997448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" event={"ID":"58e91296-2670-4ef1-812d-7bc03b30f9f5","Type":"ContainerStarted","Data":"5a2d38d0d72b7399086a6a113c8ff76a6a3f05934f28da65241fa63f2c423d39"} Jul 28 10:09:32.997541 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.997521 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" event={"ID":"58e91296-2670-4ef1-812d-7bc03b30f9f5","Type":"ContainerStarted","Data":"fc26095c5dd31bb10395fcfc0789a4d9c954a93813ed154c3a394965d4db7731"} Jul 28 10:09:32.997799 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:32.997550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" event={"ID":"58e91296-2670-4ef1-812d-7bc03b30f9f5","Type":"ContainerStarted","Data":"c41fc3d57aded1d0b54f4353dc35c5a9c15ebdc92f90336e1fb7c7473b3ee80e"} Jul 28 10:09:33.000068 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:33.000006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swz2d" event={"ID":"0a74dd63-e2e6-4c30-9a09-9c91791e7658","Type":"ContainerStarted","Data":"85bcb8ab3368db02b2af760f81bad7ca9e1b3d34afbf39497ea8b675106247fc"} Jul 28 10:09:33.001887 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:33.001831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ldd9" event={"ID":"70b13b45-f814-43d8-82ff-047f0215f2f2","Type":"ContainerStarted","Data":"3ad2935bd65ba27f40de3f2e8327a5e16ff36e6419b65ffd2fdf32be76b76cd7"} Jul 28 10:09:33.259320 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:33.259274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:34.008650 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.008608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" event={"ID":"58e91296-2670-4ef1-812d-7bc03b30f9f5","Type":"ContainerStarted","Data":"4646d4afc11adc0ddcfbdfb151f9ffb370ac6cb960f359a607eb72fe73e6d3d5"} Jul 28 10:09:34.010617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.010584 2564 generic.go:356] "Generic (PLEG): container finished" podID="70b13b45-f814-43d8-82ff-047f0215f2f2" containerID="eb9fee4c2bc85a2844761444f6479d383cd256c1aafa53f90a0e84894bcaa941" exitCode=0 Jul 28 10:09:34.010760 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.010642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ldd9" event={"ID":"70b13b45-f814-43d8-82ff-047f0215f2f2","Type":"ContainerDied","Data":"eb9fee4c2bc85a2844761444f6479d383cd256c1aafa53f90a0e84894bcaa941"} Jul 28 10:09:34.025371 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.025316 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jksc6" podStartSLOduration=1.711799021 podStartE2EDuration="3.025298819s" totalImagesPullingTime="1.313499798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:34.025285373 +0000 UTC m=+84.896486585" watchObservedRunningTime="2026-07-28 10:09:34.025298819 +0000 UTC m=+84.896500031" Jul 28 10:09:34.433175 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.433088 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:34.534405 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.534366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:34.563021 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.562981 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5759559c66-f7rvk"] Jul 28 10:09:34.577145 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.577113 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5759559c66-f7rvk"] Jul 28 10:09:34.577288 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.577255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.580449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 10:09:34.580449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580176 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 10:09:34.580449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qnsd4\"" Jul 28 10:09:34.580449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580293 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 10:09:34.580449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580373 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 10:09:34.580807 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580729 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eg6hipvhpm980\"" Jul 28 10:09:34.580980 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.580963 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 10:09:34.651734 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.651650 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:34.667855 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.667826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a906637-24ff-4357-8f5f-45b7e8c8edfc-metrics-client-ca\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.667983 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.667867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cngwf\" (UniqueName: \"kubernetes.io/projected/5a906637-24ff-4357-8f5f-45b7e8c8edfc-kube-api-access-cngwf\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.667983 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.667962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.668108 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.668030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.668108 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.668064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.668219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.668103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.668219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.668128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-grpc-tls\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.668219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.668188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-tls\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769097 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a906637-24ff-4357-8f5f-45b7e8c8edfc-metrics-client-ca\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cngwf\" (UniqueName: \"kubernetes.io/projected/5a906637-24ff-4357-8f5f-45b7e8c8edfc-kube-api-access-cngwf\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769271 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769496 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769496 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-grpc-tls\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769496 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-tls\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.769995 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.769854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a906637-24ff-4357-8f5f-45b7e8c8edfc-metrics-client-ca\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.772504 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.772477 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.772641 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.772565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.773907 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.773076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-tls\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.773907 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.773444 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.774448 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.774426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.775128 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.775108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a906637-24ff-4357-8f5f-45b7e8c8edfc-secret-grpc-tls\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.778152 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.778125 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cngwf\" (UniqueName: \"kubernetes.io/projected/5a906637-24ff-4357-8f5f-45b7e8c8edfc-kube-api-access-cngwf\") pod \"thanos-querier-5759559c66-f7rvk\" (UID: \"5a906637-24ff-4357-8f5f-45b7e8c8edfc\") " pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.888477 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.888444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:34.916388 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:34.916342 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:35.040604 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:35.040513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:35.676804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:35.676465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5759559c66-f7rvk"] Jul 28 10:09:36.019573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.019542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ldd9" event={"ID":"70b13b45-f814-43d8-82ff-047f0215f2f2","Type":"ContainerStarted","Data":"211b3502a5ac913810206ed33c3b22705e4e34fc7b46417ce2ff50bf6227b3f5"} Jul 28 10:09:36.019768 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.019601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ldd9" event={"ID":"70b13b45-f814-43d8-82ff-047f0215f2f2","Type":"ContainerStarted","Data":"d9f5b2f8c68b1c36d39b8aed7f1c466a69ffb8210a6afc0111634b50eee2775f"} Jul 28 10:09:36.020714 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.020691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"18316870c97c07fb0e146c62dec3e29f430914a9b04fb4ab9b1b1105abe66620"} Jul 28 10:09:36.022538 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.022518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swz2d" event={"ID":"0a74dd63-e2e6-4c30-9a09-9c91791e7658","Type":"ContainerStarted","Data":"338b227c5dc71f174278a11a71d5b6b5e472774b2f1ff048aac7fc1511de2e4b"} Jul 28 10:09:36.038192 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.038136 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2ldd9" podStartSLOduration=3.894104207 podStartE2EDuration="5.038118912s" totalImagesPullingTime="1.072973158s" totalInitContainerRuntime="71.041547ms" isStatefulPod=true podCreationTimestamp="2026-07-28 10:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:36.037792527 +0000 UTC m=+86.908993739" watchObservedRunningTime="2026-07-28 10:09:36.038118912 +0000 UTC m=+86.909320125" Jul 28 10:09:36.059945 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.059903 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-swz2d" podStartSLOduration=33.08628493 podStartE2EDuration="46.059890366s" totalImagesPullingTime="12.973605436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:36.058157708 +0000 UTC m=+86.929358921" watchObservedRunningTime="2026-07-28 10:09:36.059890366 +0000 UTC m=+86.931091577" Jul 28 10:09:36.238290 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.238255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:36.249423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.249384 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm"] Jul 28 10:09:36.253965 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.253940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.256280 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.256262 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j6sxv\"" Jul 28 10:09:36.256432 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.256280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 10:09:36.261030 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.260966 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm"] Jul 28 10:09:36.383938 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.383864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e06fc3f7-b2bc-48e0-af60-7b332070e838-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.383938 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.383896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzph\" (UniqueName: \"kubernetes.io/projected/e06fc3f7-b2bc-48e0-af60-7b332070e838-kube-api-access-4mzph\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.443719 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.443684 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c56d7655-dhmpt"] Jul 28 10:09:36.446932 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.446906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.449025 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.449002 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 10:09:36.449642 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.449349 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 10:09:36.449642 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.449431 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 10:09:36.449642 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.449476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m9p49\"" Jul 28 10:09:36.449912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.449715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 10:09:36.449963 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.449910 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 10:09:36.450307 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.450102 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 10:09:36.450509 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.450475 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 10:09:36.457079 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.456643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c56d7655-dhmpt"] Jul 28 10:09:36.461450 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.461431 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 10:09:36.484317 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.484292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e06fc3f7-b2bc-48e0-af60-7b332070e838-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.484405 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.484324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzph\" (UniqueName: \"kubernetes.io/projected/e06fc3f7-b2bc-48e0-af60-7b332070e838-kube-api-access-4mzph\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.484460 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:36.484442 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 10:09:36.484521 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:09:36.484510 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06fc3f7-b2bc-48e0-af60-7b332070e838-monitoring-plugin-cert podName:e06fc3f7-b2bc-48e0-af60-7b332070e838 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:36.98449015 +0000 UTC m=+87.855691355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e06fc3f7-b2bc-48e0-af60-7b332070e838-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-sc4gm" (UID: "e06fc3f7-b2bc-48e0-af60-7b332070e838") : secret "monitoring-plugin-cert" not found Jul 28 10:09:36.497657 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.497635 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzph\" (UniqueName: \"kubernetes.io/projected/e06fc3f7-b2bc-48e0-af60-7b332070e838-kube-api-access-4mzph\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.585621 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-oauth-config\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.585758 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-serving-cert\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.585758 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tldb\" (UniqueName: \"kubernetes.io/projected/b1c03a5e-99e0-4158-968c-7d0a8a398119-kube-api-access-4tldb\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.585865 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-trusted-ca-bundle\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.585865 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-config\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.585865 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-oauth-serving-cert\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.585989 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.585891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-service-ca\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686241 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-trusted-ca-bundle\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686241 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-config\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686241 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-oauth-serving-cert\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686750 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-service-ca\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686750 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-oauth-config\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686750 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-serving-cert\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.686750 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.686325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tldb\" (UniqueName: \"kubernetes.io/projected/b1c03a5e-99e0-4158-968c-7d0a8a398119-kube-api-access-4tldb\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.687078 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.687058 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-config\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.687118 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.687060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-oauth-serving-cert\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.687118 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.687095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-service-ca\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.687323 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.687300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-trusted-ca-bundle\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.688897 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.688873 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-oauth-config\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.688989 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.688880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-serving-cert\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.695706 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.695681 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tldb\" (UniqueName: \"kubernetes.io/projected/b1c03a5e-99e0-4158-968c-7d0a8a398119-kube-api-access-4tldb\") pod \"console-74c56d7655-dhmpt\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.760822 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.760801 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:36.890447 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.890420 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c56d7655-dhmpt"] Jul 28 10:09:36.893139 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:36.893101 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c03a5e_99e0_4158_968c_7d0a8a398119.slice/crio-7d54d4b841c0f60ab9baf12e8e2c49a57ee7cda7ebc248d07deecf967a62a045 WatchSource:0}: Error finding container 7d54d4b841c0f60ab9baf12e8e2c49a57ee7cda7ebc248d07deecf967a62a045: Status 404 returned error can't find the container with id 7d54d4b841c0f60ab9baf12e8e2c49a57ee7cda7ebc248d07deecf967a62a045 Jul 28 10:09:36.989321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.989262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e06fc3f7-b2bc-48e0-af60-7b332070e838-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:36.991502 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:36.991476 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e06fc3f7-b2bc-48e0-af60-7b332070e838-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sc4gm\" (UID: \"e06fc3f7-b2bc-48e0-af60-7b332070e838\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:37.028743 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.028706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c56d7655-dhmpt" event={"ID":"b1c03a5e-99e0-4158-968c-7d0a8a398119","Type":"ContainerStarted","Data":"7d54d4b841c0f60ab9baf12e8e2c49a57ee7cda7ebc248d07deecf967a62a045"} Jul 28 10:09:37.122075 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.121995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:37.166804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.166771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:37.178663 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.178642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:37.587392 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.587320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:37.657936 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.657866 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm"] Jul 28 10:09:37.662143 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:37.662111 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06fc3f7_b2bc_48e0_af60_7b332070e838.slice/crio-2827f27e9378505dea58e58000cc582742ccd26d25a359b6c8c4c29fd5b9a6cd WatchSource:0}: Error finding container 2827f27e9378505dea58e58000cc582742ccd26d25a359b6c8c4c29fd5b9a6cd: Status 404 returned error can't find the container with id 2827f27e9378505dea58e58000cc582742ccd26d25a359b6c8c4c29fd5b9a6cd Jul 28 10:09:37.674351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.674320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:37.790848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.788584 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:09:37.790848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.790197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:37.795496 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.792949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.799576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.797264 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 10:09:37.799576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.797513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 10:09:37.799576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.797544 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 10:09:37.799576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.797772 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 10:09:37.799576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.797957 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 10:09:37.799576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.798146 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d8djg\"" Jul 28 10:09:37.802162 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.801517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 10:09:37.802162 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.801759 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 10:09:37.803904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.803486 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 10:09:37.804932 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.804700 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.805130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.805480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7aom4fsuhhldv\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.805745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.805826 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.806057 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.806218 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 10:09:37.807492 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.807344 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 10:09:37.822246 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.822208 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:09:37.898339 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898489 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsjkd\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-kube-api-access-lsjkd\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-config-out\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-web-config\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-config\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.898804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.899321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.899321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:37.899321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:37.898881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000229 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.000386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsjkd\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-kube-api-access-lsjkd\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-config-out\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-web-config\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-config\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.000871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.001232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.001328 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.002351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.001584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.003696 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.001741 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.003696 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.002074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.003696 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.002399 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.007493 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.004231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.007493 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.005443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.007493 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.007051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.008819 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.008731 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-config\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.009608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.009410 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-web-config\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.009608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.009416 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.009608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.009578 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.009832 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.009706 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-config-out\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.010284 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.010052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.010284 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.010244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.011292 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.010831 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.011292 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.011258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.017833 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.017791 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsjkd\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-kube-api-access-lsjkd\") pod \"prometheus-k8s-0\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.041824 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.041727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"e757931e8bb98b49a5348a215c616490d9b5bdc9508477d95b1da80efab99491"} Jul 28 10:09:38.041824 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.041800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"98db71053d79468e9a7092b502b987bedb35809ae8965428554f998e97e83cad"} Jul 28 10:09:38.041824 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.041827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"59e0c7744d294763a5ac49867148d8c3da4c2fb02eb3a0a658610a0a78b18c1d"} Jul 28 10:09:38.043551 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.043515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" event={"ID":"e06fc3f7-b2bc-48e0-af60-7b332070e838","Type":"ContainerStarted","Data":"2827f27e9378505dea58e58000cc582742ccd26d25a359b6c8c4c29fd5b9a6cd"} Jul 28 10:09:38.109402 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.109360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:38.112450 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.112404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:38.209198 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.209165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:38.306038 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:38.306011 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:09:38.309475 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:09:38.309440 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064990ab_e924_49cf_ba82_e5c265ce7169.slice/crio-1b148e1f447912e4e4a106d626de71467667580f60c2dd4516433be1baef2a3b WatchSource:0}: Error finding container 1b148e1f447912e4e4a106d626de71467667580f60c2dd4516433be1baef2a3b: Status 404 returned error can't find the container with id 1b148e1f447912e4e4a106d626de71467667580f60c2dd4516433be1baef2a3b Jul 28 10:09:39.051387 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:39.051295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"1b148e1f447912e4e4a106d626de71467667580f60c2dd4516433be1baef2a3b"} Jul 28 10:09:39.840509 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:39.840478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:39.941351 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:39.941310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:41.062392 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.062359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"96a40925fae7b3eca5ef72e300e766d84d66f2504ab6f795d8af2fc32fe52b4d"} Jul 28 10:09:41.062805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.062475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"e09825bc035e622fd1f6c7f1c39982a551676b664c24a38d9b72041d9b588c92"} Jul 28 10:09:41.062805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.062512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" event={"ID":"5a906637-24ff-4357-8f5f-45b7e8c8edfc","Type":"ContainerStarted","Data":"1628c76f3f0ffef458d4aacfbfcf137ce778737c34e10ee274a15c059aac3038"} Jul 28 10:09:41.062805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.062545 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:41.063923 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.063900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" event={"ID":"e06fc3f7-b2bc-48e0-af60-7b332070e838","Type":"ContainerStarted","Data":"646ad4fdcf113ed66e844b1420205af9f2151c005efe3a2990008ae7fa83cdb9"} Jul 28 10:09:41.064071 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.064019 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:41.065521 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.065495 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="f4144d80ee4af05434414572668478183f7b0b1a9e6df14d48b4d5d68bcf5cba" exitCode=0 Jul 28 10:09:41.065633 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.065573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"f4144d80ee4af05434414572668478183f7b0b1a9e6df14d48b4d5d68bcf5cba"} Jul 28 10:09:41.067368 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.067265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c56d7655-dhmpt" event={"ID":"b1c03a5e-99e0-4158-968c-7d0a8a398119","Type":"ContainerStarted","Data":"1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de"} Jul 28 10:09:41.069029 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.069007 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" Jul 28 10:09:41.085256 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.085211 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" podStartSLOduration=2.347532452 podStartE2EDuration="7.085195594s" totalImagesPullingTime="4.737663142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:41.083517173 +0000 UTC m=+91.954718404" watchObservedRunningTime="2026-07-28 10:09:41.085195594 +0000 UTC m=+91.956396808" Jul 28 10:09:41.102336 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.102298 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c56d7655-dhmpt" podStartSLOduration=1.400335622 podStartE2EDuration="5.102287664s" totalImagesPullingTime="3.701952042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:41.101340413 +0000 UTC m=+91.972541665" watchObservedRunningTime="2026-07-28 10:09:41.102287664 +0000 UTC m=+91.973488853" Jul 28 10:09:41.119426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:41.119388 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sc4gm" podStartSLOduration=2.186021002 podStartE2EDuration="5.119376729s" totalImagesPullingTime="2.933355727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:41.118733004 +0000 UTC m=+91.989934219" watchObservedRunningTime="2026-07-28 10:09:41.119376729 +0000 UTC m=+91.990577975" Jul 28 10:09:42.078101 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:42.078072 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5759559c66-f7rvk" Jul 28 10:09:44.043988 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:44.043943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:44.144202 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:44.144169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:45.087792 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.087761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"d655e0583abf0ccb1d5f313d4d54048235b359550b2df6d6a4109664d17023c6"} Jul 28 10:09:45.088133 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.087822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"a7bd9c975303d052041d2bed435e5b34482276e554b43ef24cab26d1c7b851d3"} Jul 28 10:09:45.088133 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.087850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"d63adc3f6f88b0510991969f54f8948ce26c3d08457ab400fb8eb05e2230569a"} Jul 28 10:09:45.088133 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.087877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"22d4495708c692c1f543f4bbee1ac5cda34fecb4a2e9d3a3415c3fdc214cd418"} Jul 28 10:09:45.088133 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.087906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"d7804d232a380e64d08dd183215a4f54858fe71d9ba335f38abe5e17e529c034"} Jul 28 10:09:45.088133 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.087933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerStarted","Data":"90c71408f7f69ebff614ca352165d5f2b064d44099be035b5e72948ddcdeabc2"} Jul 28 10:09:45.117292 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:45.117232 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.235764942 podStartE2EDuration="8.117210426s" totalImagesPullingTime="5.861122894s" totalInitContainerRuntime="20.32259ms" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:45.115354807 +0000 UTC m=+95.986556056" watchObservedRunningTime="2026-07-28 10:09:45.117210426 +0000 UTC m=+95.988411640" Jul 28 10:09:46.496610 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:46.496576 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:46.592131 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:46.592098 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:46.651571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:46.651540 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:46.761680 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:46.761648 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:46.761823 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:46.761728 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:46.766186 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:46.766164 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:47.098376 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:47.098304 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:09:47.188685 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:47.188641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:47.289452 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:47.289420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:48.112830 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:48.112805 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:09:48.153858 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:48.153832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:48.275299 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:48.275270 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:48.657861 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:48.657833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:49.054899 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:49.054868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:49.155736 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:49.155710 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:49.267768 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:49.267734 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:49.365662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:49.365592 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:49.465966 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:49.465934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:49.565659 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:49.565623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:51.898908 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:51.898873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:51.955386 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:51.955347 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:52.948466 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:52.948434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dnq8m" Jul 28 10:09:58.908282 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:58.908249 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:59.007690 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:59.007646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:09:59.068536 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:09:59.068505 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:00.749179 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:00.749145 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:00.850657 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:00.850625 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:06.702020 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:06.701977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:06.755860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:06.755831 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:10.187748 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:10.187711 2564 generic.go:356] "Generic (PLEG): container finished" podID="7dc98088-96cc-451e-bf44-35c4da4d9d74" containerID="71a13cb4c15d4a6cd640aaa74114e5cb23b22d100776373c7454b1f6787f7bb0" exitCode=0 Jul 28 10:10:10.187748 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:10.187785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" event={"ID":"7dc98088-96cc-451e-bf44-35c4da4d9d74","Type":"ContainerDied","Data":"71a13cb4c15d4a6cd640aaa74114e5cb23b22d100776373c7454b1f6787f7bb0"} Jul 28 10:10:10.188227 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:10.188089 2564 scope.go:117] "RemoveContainer" containerID="71a13cb4c15d4a6cd640aaa74114e5cb23b22d100776373c7454b1f6787f7bb0" Jul 28 10:10:11.193870 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:11.193829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rwz6k" event={"ID":"7dc98088-96cc-451e-bf44-35c4da4d9d74","Type":"ContainerStarted","Data":"fe9d91d4d4a5dc0ac6805cdaa210b98022e2e8aa937bb01c3342e4deaeef4df3"} Jul 28 10:10:21.898890 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:21.898855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:22.004893 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:22.004855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:38.113282 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:38.113251 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:38.128710 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:38.128687 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:38.313684 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:38.313635 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:50.729528 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:50.729489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:51.126183 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:51.126152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:56.159436 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159397 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:10:56.159874 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159700 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="prometheus" containerID="cri-o://90c71408f7f69ebff614ca352165d5f2b064d44099be035b5e72948ddcdeabc2" gracePeriod=600 Jul 28 10:10:56.159874 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159748 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="thanos-sidecar" containerID="cri-o://22d4495708c692c1f543f4bbee1ac5cda34fecb4a2e9d3a3415c3fdc214cd418" gracePeriod=600 Jul 28 10:10:56.159874 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159754 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d655e0583abf0ccb1d5f313d4d54048235b359550b2df6d6a4109664d17023c6" gracePeriod=600 Jul 28 10:10:56.159874 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159757 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-web" containerID="cri-o://d63adc3f6f88b0510991969f54f8948ce26c3d08457ab400fb8eb05e2230569a" gracePeriod=600 Jul 28 10:10:56.159874 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159718 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy" containerID="cri-o://a7bd9c975303d052041d2bed435e5b34482276e554b43ef24cab26d1c7b851d3" gracePeriod=600 Jul 28 10:10:56.159874 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.159757 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="config-reloader" containerID="cri-o://d7804d232a380e64d08dd183215a4f54858fe71d9ba335f38abe5e17e529c034" gracePeriod=600 Jul 28 10:10:56.379920 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379882 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="d655e0583abf0ccb1d5f313d4d54048235b359550b2df6d6a4109664d17023c6" exitCode=0 Jul 28 10:10:56.379920 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379915 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="a7bd9c975303d052041d2bed435e5b34482276e554b43ef24cab26d1c7b851d3" exitCode=0 Jul 28 10:10:56.379920 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379925 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="d63adc3f6f88b0510991969f54f8948ce26c3d08457ab400fb8eb05e2230569a" exitCode=0 Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379934 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="22d4495708c692c1f543f4bbee1ac5cda34fecb4a2e9d3a3415c3fdc214cd418" exitCode=0 Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379944 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="d7804d232a380e64d08dd183215a4f54858fe71d9ba335f38abe5e17e529c034" exitCode=0 Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379956 2564 generic.go:356] "Generic (PLEG): container finished" podID="064990ab-e924-49cf-ba82-e5c265ce7169" containerID="90c71408f7f69ebff614ca352165d5f2b064d44099be035b5e72948ddcdeabc2" exitCode=0 Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.379950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"d655e0583abf0ccb1d5f313d4d54048235b359550b2df6d6a4109664d17023c6"} Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.380062 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"a7bd9c975303d052041d2bed435e5b34482276e554b43ef24cab26d1c7b851d3"} Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.380104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"d63adc3f6f88b0510991969f54f8948ce26c3d08457ab400fb8eb05e2230569a"} Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.380147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"22d4495708c692c1f543f4bbee1ac5cda34fecb4a2e9d3a3415c3fdc214cd418"} Jul 28 10:10:56.380200 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.380190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"d7804d232a380e64d08dd183215a4f54858fe71d9ba335f38abe5e17e529c034"} Jul 28 10:10:56.380464 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.380227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"90c71408f7f69ebff614ca352165d5f2b064d44099be035b5e72948ddcdeabc2"} Jul 28 10:10:56.414914 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.414859 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:56.512005 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.511969 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-grpc-tls\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512209 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512077 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-config-out\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512209 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512112 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-tls-assets\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512209 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512160 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-trusted-ca-bundle\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512227 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-db\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512256 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-metrics-client-ca\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512279 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-2\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512303 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-config\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512330 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-tls\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512389 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512366 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-web-config\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512415 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-kubelet-serving-ca-bundle\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512436 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsjkd\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-kube-api-access-lsjkd\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512461 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512513 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-1\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512537 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-kube-rbac-proxy\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512561 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512577 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-thanos-prometheus-http-client-file\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512603 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-0\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512627 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-serving-certs-ca-bundle\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.512718 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512663 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.513206 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512891 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.513206 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512960 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.513206 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.512979 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-metrics-client-ca\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.513353 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.513313 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.513533 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.513505 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:10:56.514280 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.514194 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.515385 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.515060 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-config-out" (OuterVolumeSpecName: "config-out") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:10:56.515385 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.515338 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.515576 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.515551 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:10:56.515766 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.515742 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.515889 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.515819 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:10:56.516755 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.516722 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.516914 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.516888 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.517247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.517154 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.517247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.517180 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-config" (OuterVolumeSpecName: "config") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.517247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.517223 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.517753 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.517732 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-kube-api-access-lsjkd" (OuterVolumeSpecName: "kube-api-access-lsjkd") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "kube-api-access-lsjkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:10:56.517995 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.517971 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.518783 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.518758 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.527618 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.527598 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-web-config" (OuterVolumeSpecName: "web-config") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.614024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.613998 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-metrics-client-certs\") pod \"064990ab-e924-49cf-ba82-e5c265ce7169\" (UID: \"064990ab-e924-49cf-ba82-e5c265ce7169\") " Jul 28 10:10:56.614213 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614197 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614286 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614220 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-web-config\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614286 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614235 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614286 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614249 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsjkd\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-kube-api-access-lsjkd\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614286 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614262 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614286 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614276 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614290 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-kube-rbac-proxy\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614303 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614320 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614334 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614348 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614362 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-grpc-tls\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614375 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-config-out\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614386 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/064990ab-e924-49cf-ba82-e5c265ce7169-tls-assets\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614398 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-db\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614411 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/064990ab-e924-49cf-ba82-e5c265ce7169-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.614511 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.614424 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-config\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:56.615694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.615662 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "064990ab-e924-49cf-ba82-e5c265ce7169" (UID: "064990ab-e924-49cf-ba82-e5c265ce7169"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:10:56.715192 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:56.715129 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/064990ab-e924-49cf-ba82-e5c265ce7169-secret-metrics-client-certs\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:10:57.386619 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.386583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"064990ab-e924-49cf-ba82-e5c265ce7169","Type":"ContainerDied","Data":"1b148e1f447912e4e4a106d626de71467667580f60c2dd4516433be1baef2a3b"} Jul 28 10:10:57.386619 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.386619 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.387067 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.386660 2564 scope.go:117] "RemoveContainer" containerID="d655e0583abf0ccb1d5f313d4d54048235b359550b2df6d6a4109664d17023c6" Jul 28 10:10:57.395536 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.395520 2564 scope.go:117] "RemoveContainer" containerID="a7bd9c975303d052041d2bed435e5b34482276e554b43ef24cab26d1c7b851d3" Jul 28 10:10:57.402197 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.402182 2564 scope.go:117] "RemoveContainer" containerID="d63adc3f6f88b0510991969f54f8948ce26c3d08457ab400fb8eb05e2230569a" Jul 28 10:10:57.408282 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.408266 2564 scope.go:117] "RemoveContainer" containerID="22d4495708c692c1f543f4bbee1ac5cda34fecb4a2e9d3a3415c3fdc214cd418" Jul 28 10:10:57.414395 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.414373 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:10:57.414980 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.414962 2564 scope.go:117] "RemoveContainer" containerID="d7804d232a380e64d08dd183215a4f54858fe71d9ba335f38abe5e17e529c034" Jul 28 10:10:57.420421 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.420403 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:10:57.421935 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.421917 2564 scope.go:117] "RemoveContainer" containerID="90c71408f7f69ebff614ca352165d5f2b064d44099be035b5e72948ddcdeabc2" Jul 28 10:10:57.428525 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.428509 2564 scope.go:117] "RemoveContainer" containerID="f4144d80ee4af05434414572668478183f7b0b1a9e6df14d48b4d5d68bcf5cba" Jul 28 10:10:57.446615 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446597 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:10:57.446904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446891 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-thanos" Jul 28 10:10:57.446904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446905 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-thanos" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446915 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446920 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446928 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="thanos-sidecar" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446933 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="thanos-sidecar" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446938 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="config-reloader" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446943 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="config-reloader" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446950 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-web" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446956 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-web" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446962 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="prometheus" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446967 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="prometheus" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446974 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="init-config-reloader" Jul 28 10:10:57.446986 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.446979 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="init-config-reloader" Jul 28 10:10:57.447343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.447026 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-web" Jul 28 10:10:57.447343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.447033 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="prometheus" Jul 28 10:10:57.447343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.447040 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="config-reloader" Jul 28 10:10:57.447343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.447046 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy" Jul 28 10:10:57.447343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.447053 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="kube-rbac-proxy-thanos" Jul 28 10:10:57.447343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.447059 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" containerName="thanos-sidecar" Jul 28 10:10:57.452478 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.452460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455573 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455616 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455692 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455707 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 10:10:57.455834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455694 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d8djg\"" Jul 28 10:10:57.456302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 10:10:57.456302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455924 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7aom4fsuhhldv\"" Jul 28 10:10:57.456302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.455995 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 10:10:57.456302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.456054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 10:10:57.456302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.456147 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 10:10:57.456302 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.456155 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 10:10:57.459570 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.459548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 10:10:57.461836 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.461817 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 10:10:57.472235 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.472213 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:10:57.520921 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.520896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521031 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.520927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521031 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.520948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521031 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.520980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln468\" (UniqueName: \"kubernetes.io/projected/d41a1849-395b-40b9-a6cf-45c41c590243-kube-api-access-ln468\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521031 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d41a1849-395b-40b9-a6cf-45c41c590243-config-out\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521159 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521159 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521159 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d41a1849-395b-40b9-a6cf-45c41c590243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521247 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-web-config\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521590 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-config\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.521590 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.521415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.621998 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.621976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.621998 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622129 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622129 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln468\" (UniqueName: \"kubernetes.io/projected/d41a1849-395b-40b9-a6cf-45c41c590243-kube-api-access-ln468\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622226 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d41a1849-395b-40b9-a6cf-45c41c590243-config-out\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622275 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622327 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622327 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d41a1849-395b-40b9-a6cf-45c41c590243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-web-config\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622608 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622878 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622878 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-config\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.622878 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.623027 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.623027 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.622984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.623378 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.623184 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.623967 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.623648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.623967 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.623892 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.625041 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.625009 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.625801 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.625439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d41a1849-395b-40b9-a6cf-45c41c590243-config-out\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.625801 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.625693 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.625940 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.625915 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.625997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.625966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.626290 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.626266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.626365 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.626320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d41a1849-395b-40b9-a6cf-45c41c590243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.626497 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.626452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-web-config\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.626812 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.626789 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d41a1849-395b-40b9-a6cf-45c41c590243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.627536 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.627504 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.627962 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.627938 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.628025 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.627995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-config\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.628255 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.628236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.628456 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.628436 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d41a1849-395b-40b9-a6cf-45c41c590243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.631845 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.631822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln468\" (UniqueName: \"kubernetes.io/projected/d41a1849-395b-40b9-a6cf-45c41c590243-kube-api-access-ln468\") pod \"prometheus-k8s-0\" (UID: \"d41a1849-395b-40b9-a6cf-45c41c590243\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.675747 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.675718 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="064990ab-e924-49cf-ba82-e5c265ce7169" path="/var/lib/kubelet/pods/064990ab-e924-49cf-ba82-e5c265ce7169/volumes" Jul 28 10:10:57.763747 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.763721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:10:57.905578 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:57.905555 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 10:10:57.907534 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:10:57.907510 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41a1849_395b_40b9_a6cf_45c41c590243.slice/crio-8b14d94ca0dc11e3905275aa66d4449cd60504f849b5a40892f6f36716584129 WatchSource:0}: Error finding container 8b14d94ca0dc11e3905275aa66d4449cd60504f849b5a40892f6f36716584129: Status 404 returned error can't find the container with id 8b14d94ca0dc11e3905275aa66d4449cd60504f849b5a40892f6f36716584129 Jul 28 10:10:58.391886 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:58.391849 2564 generic.go:356] "Generic (PLEG): container finished" podID="d41a1849-395b-40b9-a6cf-45c41c590243" containerID="4b8d3b09149c2399dacf35b0a4f346501cc3e41d15bf7b80f6498a845e3ac988" exitCode=0 Jul 28 10:10:58.392307 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:58.391939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerDied","Data":"4b8d3b09149c2399dacf35b0a4f346501cc3e41d15bf7b80f6498a845e3ac988"} Jul 28 10:10:58.392307 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:58.392004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"8b14d94ca0dc11e3905275aa66d4449cd60504f849b5a40892f6f36716584129"} Jul 28 10:10:59.399912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.399877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"2438f4f7863774cc585019f2407b4cfc56d4ed0642b70ed9881388699a5e4dd4"} Jul 28 10:10:59.400269 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.399967 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"b81f583e3cb2b6ac091bcc49507a56056dbaede591e7e5bb6a0e38a9d0a54258"} Jul 28 10:10:59.400269 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.399994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"77e1701f3454e5a731c06314049f609bdc436142616f585e2ad2405f57c3519e"} Jul 28 10:10:59.400269 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.400021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"3405a262913ce7cd8f8a6d7cc5ac47eaa1ef11e7e3cc35bc05a7a85dc7e62e7b"} Jul 28 10:10:59.400269 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.400045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"45628304752bfdd3c95130f35aff63eb134d49bb803cde5037aedbc3bf576720"} Jul 28 10:10:59.400269 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.400066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d41a1849-395b-40b9-a6cf-45c41c590243","Type":"ContainerStarted","Data":"812366db2ff9b94011d26f4ccf9adeaa55002e3c4d37cd7b8ca2f303671a2075"} Jul 28 10:10:59.436812 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.436767 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.418652366 podStartE2EDuration="2.436747379s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.095013ms" isStatefulPod=false podCreationTimestamp="2026-07-28 10:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:59.434654971 +0000 UTC m=+170.305856174" watchObservedRunningTime="2026-07-28 10:10:59.436747379 +0000 UTC m=+170.307948592" Jul 28 10:10:59.919487 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.919455 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:10:59.990119 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:10:59.990082 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:02.764833 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:02.764758 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:11:10.974321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:10.974287 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c56d7655-dhmpt"] Jul 28 10:11:11.080846 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:11.080807 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:11.193547 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:11.193517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:11.256032 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:11.255958 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:19.044010 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:19.043974 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:36.000218 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.000156 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74c56d7655-dhmpt" podUID="b1c03a5e-99e0-4158-968c-7d0a8a398119" containerName="console" containerID="cri-o://1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de" gracePeriod=15 Jul 28 10:11:36.236270 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.236245 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:11:36.318405 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318379 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-trusted-ca-bundle\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318415 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tldb\" (UniqueName: \"kubernetes.io/projected/b1c03a5e-99e0-4158-968c-7d0a8a398119-kube-api-access-4tldb\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318432 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-oauth-config\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318472 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-oauth-serving-cert\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318522 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-service-ca\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318571 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318555 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-serving-cert\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318829 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318718 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-config\") pod \"b1c03a5e-99e0-4158-968c-7d0a8a398119\" (UID: \"b1c03a5e-99e0-4158-968c-7d0a8a398119\") " Jul 28 10:11:36.318933 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.318904 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:11:36.319037 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.319016 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:11:36.319116 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.319088 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-config" (OuterVolumeSpecName: "console-config") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:11:36.319169 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.319101 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-service-ca" (OuterVolumeSpecName: "service-ca") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:11:36.320728 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.320703 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:11:36.320728 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.320712 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c03a5e-99e0-4158-968c-7d0a8a398119-kube-api-access-4tldb" (OuterVolumeSpecName: "kube-api-access-4tldb") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "kube-api-access-4tldb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:11:36.320846 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.320786 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b1c03a5e-99e0-4158-968c-7d0a8a398119" (UID: "b1c03a5e-99e0-4158-968c-7d0a8a398119"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:11:36.419725 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419702 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-config\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.419725 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419722 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-trusted-ca-bundle\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.419848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419732 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tldb\" (UniqueName: \"kubernetes.io/projected/b1c03a5e-99e0-4158-968c-7d0a8a398119-kube-api-access-4tldb\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.419848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419740 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-oauth-config\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.419848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419749 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-oauth-serving-cert\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.419848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419757 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c03a5e-99e0-4158-968c-7d0a8a398119-service-ca\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.419848 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.419765 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c03a5e-99e0-4158-968c-7d0a8a398119-console-serving-cert\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:11:36.536055 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.536032 2564 generic.go:356] "Generic (PLEG): container finished" podID="b1c03a5e-99e0-4158-968c-7d0a8a398119" containerID="1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de" exitCode=0 Jul 28 10:11:36.536148 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.536076 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c56d7655-dhmpt" Jul 28 10:11:36.536148 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.536121 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c56d7655-dhmpt" event={"ID":"b1c03a5e-99e0-4158-968c-7d0a8a398119","Type":"ContainerDied","Data":"1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de"} Jul 28 10:11:36.536232 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.536170 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c56d7655-dhmpt" event={"ID":"b1c03a5e-99e0-4158-968c-7d0a8a398119","Type":"ContainerDied","Data":"7d54d4b841c0f60ab9baf12e8e2c49a57ee7cda7ebc248d07deecf967a62a045"} Jul 28 10:11:36.536232 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.536192 2564 scope.go:117] "RemoveContainer" containerID="1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de" Jul 28 10:11:36.544783 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.544768 2564 scope.go:117] "RemoveContainer" containerID="1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de" Jul 28 10:11:36.545024 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:11:36.545006 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de\": container with ID starting with 1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de not found: ID does not exist" containerID="1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de" Jul 28 10:11:36.545063 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.545033 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de"} err="failed to get container status \"1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de\": rpc error: code = NotFound desc = could not find container \"1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de\": container with ID starting with 1404ddd3c0262399bdd9299b6359458e06798fc37cc523d42efe6369377436de not found: ID does not exist" Jul 28 10:11:36.558323 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.558301 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c56d7655-dhmpt"] Jul 28 10:11:36.562637 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:36.562616 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c56d7655-dhmpt"] Jul 28 10:11:37.682050 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:37.682014 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c03a5e-99e0-4158-968c-7d0a8a398119" path="/var/lib/kubelet/pods/b1c03a5e-99e0-4158-968c-7d0a8a398119/volumes" Jul 28 10:11:41.484892 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:41.484855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:41.549520 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:41.549487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:11:57.764729 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:57.764694 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:11:57.779914 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:57.779888 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:11:58.631463 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:11:58.631437 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 10:12:06.463181 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:06.463149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:06.514903 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:06.514870 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:13.511714 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:13.511679 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:18.041922 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:18.041887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:18.098627 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:18.098600 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:19.633531 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:19.633491 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:19.741191 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:19.741160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:21.918583 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:21.918553 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:22.019387 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:22.019360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:30.380861 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:30.380812 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:30.434467 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:30.434444 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:30.495076 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:30.495051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:12:43.688723 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:12:43.688622 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:13:09.497906 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:13:09.497874 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 10:14:35.396195 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:14:35.396113 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:36.738118 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:14:36.738083 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:58.530820 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:14:58.530785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:14:58.628976 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:14:58.628944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:03.983093 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:03.983054 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:04.287817 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:04.287782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:04.499693 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:04.499647 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:04.597160 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:04.597076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:04.694905 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:04.694876 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:04.865557 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:04.865476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:04.963423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:04.963392 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:05.203798 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:05.203711 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:05.370863 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:05.370830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:05.773500 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:05.773462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:05.883334 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:05.883297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:06.790555 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:06.790522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:15:06.902407 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:15:06.902373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:03.008364 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:03.008332 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:03.078994 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:03.078964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:03.213912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:03.213880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:03.771906 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:03.771872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:03.862279 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:03.862246 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:14.506804 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:14.506775 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:14.560092 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:14.560065 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:19.474107 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:19.474071 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:19.572585 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:19.572548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:19.638522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:19.638493 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:19.794423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:19.794394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:19.853776 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:19.853751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:20.518049 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:20.518006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:20.615540 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:20.615506 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:16:20.669914 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:16:20.669891 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:32.098070 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:32.097981 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:32.168221 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:32.168193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:34.892324 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:34.892288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:34.983871 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:34.983833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:35.180960 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:35.180861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:35.280738 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:35.280710 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:35.656415 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:35.656387 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:35.722249 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:35.722207 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:46.059714 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:46.059657 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:17:49.884812 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.884778 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-5kgvs"] Jul 28 10:17:49.885202 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.885144 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c03a5e-99e0-4158-968c-7d0a8a398119" containerName="console" Jul 28 10:17:49.885202 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.885162 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c03a5e-99e0-4158-968c-7d0a8a398119" containerName="console" Jul 28 10:17:49.885308 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.885228 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c03a5e-99e0-4158-968c-7d0a8a398119" containerName="console" Jul 28 10:17:49.888303 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.888285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-5kgvs" Jul 28 10:17:49.890851 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.890830 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 10:17:49.890992 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.890966 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 10:17:49.891888 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.891873 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xcbwm\"" Jul 28 10:17:49.891888 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.891881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 10:17:49.896363 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:49.896344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-5kgvs"] Jul 28 10:17:50.033656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.033627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwmq\" (UniqueName: \"kubernetes.io/projected/72e65e82-78a0-4797-af43-9bab1c83ef7c-kube-api-access-2lwmq\") pod \"s3-init-5kgvs\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.033815 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.033663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e65e82-78a0-4797-af43-9bab1c83ef7c-model-cache\") pod \"s3-init-5kgvs\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.134181 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.134153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwmq\" (UniqueName: \"kubernetes.io/projected/72e65e82-78a0-4797-af43-9bab1c83ef7c-kube-api-access-2lwmq\") pod \"s3-init-5kgvs\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.134298 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.134185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e65e82-78a0-4797-af43-9bab1c83ef7c-model-cache\") pod \"s3-init-5kgvs\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.134472 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.134458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e65e82-78a0-4797-af43-9bab1c83ef7c-model-cache\") pod \"s3-init-5kgvs\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.143959 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.143900 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwmq\" (UniqueName: \"kubernetes.io/projected/72e65e82-78a0-4797-af43-9bab1c83ef7c-kube-api-access-2lwmq\") pod \"s3-init-5kgvs\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.198352 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.198328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-5kgvs" Jul 28 10:17:50.324129 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.324108 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-5kgvs"] Jul 28 10:17:50.326535 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:17:50.326506 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72e65e82_78a0_4797_af43_9bab1c83ef7c.slice/crio-64bbb6ac09b4fc52fc606ed8fa1c9022236131aad1c6c49669cc213a9df2b093 WatchSource:0}: Error finding container 64bbb6ac09b4fc52fc606ed8fa1c9022236131aad1c6c49669cc213a9df2b093: Status 404 returned error can't find the container with id 64bbb6ac09b4fc52fc606ed8fa1c9022236131aad1c6c49669cc213a9df2b093 Jul 28 10:17:50.328398 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.328382 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 10:17:50.892217 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:50.892178 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-5kgvs" event={"ID":"72e65e82-78a0-4797-af43-9bab1c83ef7c","Type":"ContainerStarted","Data":"64bbb6ac09b4fc52fc606ed8fa1c9022236131aad1c6c49669cc213a9df2b093"} Jul 28 10:17:54.914104 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:54.914061 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-5kgvs" event={"ID":"72e65e82-78a0-4797-af43-9bab1c83ef7c","Type":"ContainerStarted","Data":"6a92a5357e765b14bb4bea4224629877ce4089158c2894fa272652f2b0cb0695"} Jul 28 10:17:55.919333 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:55.919245 2564 generic.go:356] "Generic (PLEG): container finished" podID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerID="6a92a5357e765b14bb4bea4224629877ce4089158c2894fa272652f2b0cb0695" exitCode=0 Jul 28 10:17:55.919803 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:17:55.919326 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-5kgvs" event={"ID":"72e65e82-78a0-4797-af43-9bab1c83ef7c","Type":"ContainerDied","Data":"6a92a5357e765b14bb4bea4224629877ce4089158c2894fa272652f2b0cb0695"} Jul 28 10:18:00.951391 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:18:00.951348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-5kgvs" event={"ID":"72e65e82-78a0-4797-af43-9bab1c83ef7c","Type":"ContainerStarted","Data":"0c5a79b6ba9e2791ec4ab59bed006fdf87cf221c1bce9b5829ddca6a2ced477b"} Jul 28 10:18:00.970548 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:18:00.970490 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-5kgvs" podStartSLOduration=2.384481935 podStartE2EDuration="11.970472741s" totalImagesPullingTime="8.054275664s" totalInitContainerRuntime="1.531715142s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:17:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:18:00.969662131 +0000 UTC m=+591.840863344" watchObservedRunningTime="2026-07-28 10:18:00.970472741 +0000 UTC m=+591.841673954" Jul 28 10:19:06.189580 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:06.189545 2564 generic.go:356] "Generic (PLEG): container finished" podID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerID="0c5a79b6ba9e2791ec4ab59bed006fdf87cf221c1bce9b5829ddca6a2ced477b" exitCode=0 Jul 28 10:19:06.189580 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:06.189583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-5kgvs" event={"ID":"72e65e82-78a0-4797-af43-9bab1c83ef7c","Type":"ContainerDied","Data":"0c5a79b6ba9e2791ec4ab59bed006fdf87cf221c1bce9b5829ddca6a2ced477b"} Jul 28 10:19:07.314167 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.314144 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-5kgvs" Jul 28 10:19:07.397772 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.397736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e65e82-78a0-4797-af43-9bab1c83ef7c-model-cache\") pod \"72e65e82-78a0-4797-af43-9bab1c83ef7c\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " Jul 28 10:19:07.397919 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.397866 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lwmq\" (UniqueName: \"kubernetes.io/projected/72e65e82-78a0-4797-af43-9bab1c83ef7c-kube-api-access-2lwmq\") pod \"72e65e82-78a0-4797-af43-9bab1c83ef7c\" (UID: \"72e65e82-78a0-4797-af43-9bab1c83ef7c\") " Jul 28 10:19:07.399922 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.399898 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e65e82-78a0-4797-af43-9bab1c83ef7c-kube-api-access-2lwmq" (OuterVolumeSpecName: "kube-api-access-2lwmq") pod "72e65e82-78a0-4797-af43-9bab1c83ef7c" (UID: "72e65e82-78a0-4797-af43-9bab1c83ef7c"). InnerVolumeSpecName "kube-api-access-2lwmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:19:07.416278 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.416254 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e65e82-78a0-4797-af43-9bab1c83ef7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "72e65e82-78a0-4797-af43-9bab1c83ef7c" (UID: "72e65e82-78a0-4797-af43-9bab1c83ef7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:19:07.499300 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.499243 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lwmq\" (UniqueName: \"kubernetes.io/projected/72e65e82-78a0-4797-af43-9bab1c83ef7c-kube-api-access-2lwmq\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:19:07.499300 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:07.499273 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e65e82-78a0-4797-af43-9bab1c83ef7c-model-cache\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:19:08.198266 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:08.198223 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-5kgvs" event={"ID":"72e65e82-78a0-4797-af43-9bab1c83ef7c","Type":"ContainerDied","Data":"64bbb6ac09b4fc52fc606ed8fa1c9022236131aad1c6c49669cc213a9df2b093"} Jul 28 10:19:08.198266 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:08.198255 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-5kgvs" Jul 28 10:19:08.198266 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:08.198265 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64bbb6ac09b4fc52fc606ed8fa1c9022236131aad1c6c49669cc213a9df2b093" Jul 28 10:19:08.568006 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:08.567978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:08.669768 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:08.669743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.214918 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.214881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.291154 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.291125 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6"] Jul 28 10:19:20.291450 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.291437 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerName="s3-init" Jul 28 10:19:20.291495 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.291452 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerName="s3-init" Jul 28 10:19:20.291495 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.291469 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerName="download-hf-model" Jul 28 10:19:20.291495 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.291475 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerName="download-hf-model" Jul 28 10:19:20.291588 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.291516 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e65e82-78a0-4797-af43-9bab1c83ef7c" containerName="s3-init" Jul 28 10:19:20.293980 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.293963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.297475 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.297452 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 28 10:19:20.298194 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.298172 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 10:19:20.298291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.298172 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 10:19:20.298337 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.298174 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 10:19:20.298337 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.298301 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 10:19:20.298514 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.298501 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-lvvzp\"" Jul 28 10:19:20.298557 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.298517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 28 10:19:20.310058 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.310037 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6"] Jul 28 10:19:20.394464 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.394437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32af236a-7cfe-469a-9a45-e04f23144582-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.394615 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.394478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vqkz\" (UniqueName: \"kubernetes.io/projected/32af236a-7cfe-469a-9a45-e04f23144582-kube-api-access-9vqkz\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.394615 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.394500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.394615 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.394583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.394800 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.394647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32af236a-7cfe-469a-9a45-e04f23144582-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.408682 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.408640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.495383 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.495383 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32af236a-7cfe-469a-9a45-e04f23144582-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.495573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32af236a-7cfe-469a-9a45-e04f23144582-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.495573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vqkz\" (UniqueName: \"kubernetes.io/projected/32af236a-7cfe-469a-9a45-e04f23144582-kube-api-access-9vqkz\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.495573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.496009 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32af236a-7cfe-469a-9a45-e04f23144582-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.496009 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.495979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.496154 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.496058 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.497897 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.497876 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32af236a-7cfe-469a-9a45-e04f23144582-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.513266 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.513234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vqkz\" (UniqueName: \"kubernetes.io/projected/32af236a-7cfe-469a-9a45-e04f23144582-kube-api-access-9vqkz\") pod \"isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.522993 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.522955 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.604482 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.604445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:20.648953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.648922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.680955 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.680687 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx"] Jul 28 10:19:20.683924 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.683888 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.689556 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.689499 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 28 10:19:20.689821 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.689805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 28 10:19:20.721979 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.721951 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx"] Jul 28 10:19:20.749746 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.749545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6"] Jul 28 10:19:20.752388 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:19:20.752362 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32af236a_7cfe_469a_9a45_e04f23144582.slice/crio-1f0c973c7c69ac144f93eef83f01ccee45ae6ee29e5ae5b47b641141c29b6309 WatchSource:0}: Error finding container 1f0c973c7c69ac144f93eef83f01ccee45ae6ee29e5ae5b47b641141c29b6309: Status 404 returned error can't find the container with id 1f0c973c7c69ac144f93eef83f01ccee45ae6ee29e5ae5b47b641141c29b6309 Jul 28 10:19:20.798534 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.798515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.798617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.798547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.798617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.798590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.798617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.798608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.798738 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.798626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmkxv\" (UniqueName: \"kubernetes.io/projected/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-api-access-vmkxv\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.809834 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.809805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.899570 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.899538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.899754 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.899594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.899754 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.899698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.899754 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.899735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.899936 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.899769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmkxv\" (UniqueName: \"kubernetes.io/projected/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-api-access-vmkxv\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.899936 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:19:20.899882 2564 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found Jul 28 10:19:20.900039 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:19:20.899967 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls podName:52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4 nodeName:}" failed. No retries permitted until 2026-07-28 10:19:21.399942789 +0000 UTC m=+672.271143981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-srpkx" (UID: "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4") : secret "isvc-xgboost-graph-predictor-serving-cert" not found Jul 28 10:19:20.900453 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.900415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.900453 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.900444 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.900628 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.900424 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:20.911086 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.911044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:20.913394 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:20.913369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmkxv\" (UniqueName: \"kubernetes.io/projected/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-api-access-vmkxv\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:21.021443 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.021410 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:21.089474 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.089439 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:21.190192 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.190150 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:21.246102 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.246071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerStarted","Data":"0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2"} Jul 28 10:19:21.246463 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.246139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerStarted","Data":"1f0c973c7c69ac144f93eef83f01ccee45ae6ee29e5ae5b47b641141c29b6309"} Jul 28 10:19:21.375428 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.375350 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:21.405377 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.405343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:21.407678 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.407647 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-srpkx\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:21.596755 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.596715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:21.724805 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:21.724765 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx"] Jul 28 10:19:21.726914 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:19:21.726890 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f4e69e_7acb_4a5e_bcc0_c13c9f3ffcd4.slice/crio-bbe28061969b1cc97f64704199aa999378b23d8156672cbaf9ff53af146557c6 WatchSource:0}: Error finding container bbe28061969b1cc97f64704199aa999378b23d8156672cbaf9ff53af146557c6: Status 404 returned error can't find the container with id bbe28061969b1cc97f64704199aa999378b23d8156672cbaf9ff53af146557c6 Jul 28 10:19:22.251876 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:22.251841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerStarted","Data":"6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a"} Jul 28 10:19:22.252321 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:22.251910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerStarted","Data":"bbe28061969b1cc97f64704199aa999378b23d8156672cbaf9ff53af146557c6"} Jul 28 10:19:25.268485 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:25.268452 2564 generic.go:356] "Generic (PLEG): container finished" podID="32af236a-7cfe-469a-9a45-e04f23144582" containerID="0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2" exitCode=0 Jul 28 10:19:25.268909 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:25.268496 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerDied","Data":"0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2"} Jul 28 10:19:26.279814 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:26.279648 2564 generic.go:356] "Generic (PLEG): container finished" podID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerID="6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a" exitCode=0 Jul 28 10:19:26.279814 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:26.279787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerDied","Data":"6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a"} Jul 28 10:19:40.519388 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:40.519327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:19:49.395423 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:49.395369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerStarted","Data":"d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14"} Jul 28 10:19:49.397812 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:49.397781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerStarted","Data":"7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99"} Jul 28 10:19:52.415112 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.415071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerStarted","Data":"79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be"} Jul 28 10:19:52.415573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.415153 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:52.415573 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.415189 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:52.416794 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.416752 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:19:52.417291 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.417269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerStarted","Data":"5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795"} Jul 28 10:19:52.417420 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.417405 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:52.417471 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.417445 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:52.418490 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.418469 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:19:52.442859 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.442822 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podStartSLOduration=2.969375626 podStartE2EDuration="32.442795209s" totalImagesPullingTime="25.739669215s" totalInitContainerRuntime="3.733750368s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:19:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:19:52.441866805 +0000 UTC m=+703.313068027" watchObservedRunningTime="2026-07-28 10:19:52.442795209 +0000 UTC m=+703.313996399" Jul 28 10:19:52.468857 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:52.468817 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podStartSLOduration=1.9979895760000002 podStartE2EDuration="32.468805111s" totalImagesPullingTime="26.727222002s" totalInitContainerRuntime="3.743593533s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:19:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:19:52.467988837 +0000 UTC m=+703.339190091" watchObservedRunningTime="2026-07-28 10:19:52.468805111 +0000 UTC m=+703.340006323" Jul 28 10:19:53.421730 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:53.421694 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:19:53.422125 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:53.421838 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:19:58.427616 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:58.427586 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:19:58.428167 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:58.428057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:19:58.428167 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:58.428079 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:19:58.428564 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:19:58.428537 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:20:08.429017 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:08.428932 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:20:08.429392 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:08.429007 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:20:18.428142 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:18.428101 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:20:18.428534 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:18.428507 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:20:28.428439 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:28.428392 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:20:28.428858 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:28.428517 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:20:38.428074 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:38.428028 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 28 10:20:38.428598 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:38.428506 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:20:39.764694 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:39.764646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:39.864206 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:39.864162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:40.163683 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:40.163575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:40.329313 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:40.329282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:48.428930 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:48.428891 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:20:48.429424 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:48.429405 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:20:50.317525 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:50.317486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:50.408635 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:50.408608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:50.501262 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:50.501228 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:50.578336 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:50.578245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:50.711912 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:50.711878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:50.904698 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:50.904589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:20:58.428448 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:20:58.428409 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Jul 28 10:21:08.429444 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:08.429416 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:21:30.179831 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:30.179798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:30.863099 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:30.863052 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:40.278997 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.278911 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:40.350614 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.350587 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx"] Jul 28 10:21:40.350852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.350829 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" containerID="cri-o://7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99" gracePeriod=30 Jul 28 10:21:40.350925 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.350864 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kube-rbac-proxy" containerID="cri-o://79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be" gracePeriod=30 Jul 28 10:21:40.378030 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.378000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:40.454397 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.454368 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:40.459080 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.459057 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6"] Jul 28 10:21:40.459300 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.459276 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" containerID="cri-o://d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14" gracePeriod=30 Jul 28 10:21:40.459382 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.459327 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kube-rbac-proxy" containerID="cri-o://5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795" gracePeriod=30 Jul 28 10:21:40.554142 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.554068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:40.653367 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.653323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:40.837399 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.837313 2564 generic.go:356] "Generic (PLEG): container finished" podID="32af236a-7cfe-469a-9a45-e04f23144582" containerID="5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795" exitCode=2 Jul 28 10:21:40.837545 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.837392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerDied","Data":"5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795"} Jul 28 10:21:40.839401 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.839378 2564 generic.go:356] "Generic (PLEG): container finished" podID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerID="79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be" exitCode=2 Jul 28 10:21:40.839520 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.839452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerDied","Data":"79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be"} Jul 28 10:21:40.999806 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:40.999772 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:41.307216 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:41.307187 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:43.422710 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.422642 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.22:8643/healthz\": dial tcp 10.133.0.22:8643: connect: connection refused" Jul 28 10:21:43.423076 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.422644 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Jul 28 10:21:43.788382 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.788358 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:21:43.851869 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.851837 2564 generic.go:356] "Generic (PLEG): container finished" podID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerID="7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99" exitCode=0 Jul 28 10:21:43.852002 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.851900 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" Jul 28 10:21:43.852002 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.851923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerDied","Data":"7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99"} Jul 28 10:21:43.852002 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.851982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx" event={"ID":"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4","Type":"ContainerDied","Data":"bbe28061969b1cc97f64704199aa999378b23d8156672cbaf9ff53af146557c6"} Jul 28 10:21:43.852150 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.852010 2564 scope.go:117] "RemoveContainer" containerID="79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be" Jul 28 10:21:43.860337 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.860322 2564 scope.go:117] "RemoveContainer" containerID="7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99" Jul 28 10:21:43.867394 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.867379 2564 scope.go:117] "RemoveContainer" containerID="6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a" Jul 28 10:21:43.873453 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873430 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-cabundle-cert\") pod \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " Jul 28 10:21:43.873538 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873479 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kserve-provision-location\") pod \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " Jul 28 10:21:43.873538 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873500 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-rbac-proxy-sar-config\") pod \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " Jul 28 10:21:43.873619 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873542 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls\") pod \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " Jul 28 10:21:43.873619 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873561 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmkxv\" (UniqueName: \"kubernetes.io/projected/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-api-access-vmkxv\") pod \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\" (UID: \"52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4\") " Jul 28 10:21:43.873814 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873790 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" (UID: "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:21:43.873899 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873856 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" (UID: "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:21:43.873899 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873887 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" (UID: "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:21:43.873998 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873976 2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-cabundle-cert\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:43.873998 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873990 2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kserve-provision-location\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:43.874120 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.873998 2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:43.874450 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.874428 2564 scope.go:117] "RemoveContainer" containerID="79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be" Jul 28 10:21:43.874734 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:21:43.874716 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be\": container with ID starting with 79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be not found: ID does not exist" containerID="79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be" Jul 28 10:21:43.874802 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.874740 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be"} err="failed to get container status \"79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be\": rpc error: code = NotFound desc = could not find container \"79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be\": container with ID starting with 79f66733ed9aeb2b6362726adf7c421a180dfd16b7147bed2f6f590dd3e811be not found: ID does not exist" Jul 28 10:21:43.874802 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.874758 2564 scope.go:117] "RemoveContainer" containerID="7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99" Jul 28 10:21:43.875033 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:21:43.875006 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99\": container with ID starting with 7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99 not found: ID does not exist" containerID="7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99" Jul 28 10:21:43.875072 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.875036 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99"} err="failed to get container status \"7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99\": rpc error: code = NotFound desc = could not find container \"7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99\": container with ID starting with 7c25a78a1c75ad69d12b111e627889a8cf472f4ee1ce725c0a248d7cfd7c0e99 not found: ID does not exist" Jul 28 10:21:43.875072 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.875048 2564 scope.go:117] "RemoveContainer" containerID="6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a" Jul 28 10:21:43.875274 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:21:43.875259 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a\": container with ID starting with 6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a not found: ID does not exist" containerID="6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a" Jul 28 10:21:43.875319 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.875277 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a"} err="failed to get container status \"6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a\": rpc error: code = NotFound desc = could not find container \"6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a\": container with ID starting with 6a72b084a78a56c85d1949cfe63bfb13a3b0919859ac34152cefdef0b916a37a not found: ID does not exist" Jul 28 10:21:43.875767 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.875747 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-api-access-vmkxv" (OuterVolumeSpecName: "kube-api-access-vmkxv") pod "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" (UID: "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4"). InnerVolumeSpecName "kube-api-access-vmkxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:21:43.875846 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.875797 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" (UID: "52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:21:43.975214 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.975148 2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-proxy-tls\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:43.975214 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:43.975175 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmkxv\" (UniqueName: \"kubernetes.io/projected/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4-kube-api-access-vmkxv\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:44.187676 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.187632 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx"] Jul 28 10:21:44.189315 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.189292 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-srpkx"] Jul 28 10:21:44.703315 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.703290 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:21:44.781841 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.781815 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vqkz\" (UniqueName: \"kubernetes.io/projected/32af236a-7cfe-469a-9a45-e04f23144582-kube-api-access-9vqkz\") pod \"32af236a-7cfe-469a-9a45-e04f23144582\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " Jul 28 10:21:44.781953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.781864 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-cabundle-cert\") pod \"32af236a-7cfe-469a-9a45-e04f23144582\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " Jul 28 10:21:44.781953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.781919 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32af236a-7cfe-469a-9a45-e04f23144582-kserve-provision-location\") pod \"32af236a-7cfe-469a-9a45-e04f23144582\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " Jul 28 10:21:44.782074 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.781968 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32af236a-7cfe-469a-9a45-e04f23144582-proxy-tls\") pod \"32af236a-7cfe-469a-9a45-e04f23144582\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " Jul 28 10:21:44.782074 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.781997 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-kube-rbac-proxy-sar-config\") pod \"32af236a-7cfe-469a-9a45-e04f23144582\" (UID: \"32af236a-7cfe-469a-9a45-e04f23144582\") " Jul 28 10:21:44.782309 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.782282 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32af236a-7cfe-469a-9a45-e04f23144582-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "32af236a-7cfe-469a-9a45-e04f23144582" (UID: "32af236a-7cfe-469a-9a45-e04f23144582"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:21:44.782413 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.782252 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "32af236a-7cfe-469a-9a45-e04f23144582" (UID: "32af236a-7cfe-469a-9a45-e04f23144582"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:21:44.782464 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.782404 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "32af236a-7cfe-469a-9a45-e04f23144582" (UID: "32af236a-7cfe-469a-9a45-e04f23144582"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 10:21:44.783859 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.783839 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32af236a-7cfe-469a-9a45-e04f23144582-kube-api-access-9vqkz" (OuterVolumeSpecName: "kube-api-access-9vqkz") pod "32af236a-7cfe-469a-9a45-e04f23144582" (UID: "32af236a-7cfe-469a-9a45-e04f23144582"). InnerVolumeSpecName "kube-api-access-9vqkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:21:44.783920 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.783858 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32af236a-7cfe-469a-9a45-e04f23144582-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "32af236a-7cfe-469a-9a45-e04f23144582" (UID: "32af236a-7cfe-469a-9a45-e04f23144582"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 10:21:44.858132 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.858073 2564 generic.go:356] "Generic (PLEG): container finished" podID="32af236a-7cfe-469a-9a45-e04f23144582" containerID="d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14" exitCode=0 Jul 28 10:21:44.858207 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.858138 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" Jul 28 10:21:44.858207 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.858161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerDied","Data":"d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14"} Jul 28 10:21:44.858294 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.858237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6" event={"ID":"32af236a-7cfe-469a-9a45-e04f23144582","Type":"ContainerDied","Data":"1f0c973c7c69ac144f93eef83f01ccee45ae6ee29e5ae5b47b641141c29b6309"} Jul 28 10:21:44.858294 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.858271 2564 scope.go:117] "RemoveContainer" containerID="5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795" Jul 28 10:21:44.866099 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.866083 2564 scope.go:117] "RemoveContainer" containerID="d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14" Jul 28 10:21:44.873095 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.873078 2564 scope.go:117] "RemoveContainer" containerID="0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2" Jul 28 10:21:44.880051 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880029 2564 scope.go:117] "RemoveContainer" containerID="5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795" Jul 28 10:21:44.880317 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:21:44.880300 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795\": container with ID starting with 5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795 not found: ID does not exist" containerID="5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795" Jul 28 10:21:44.880374 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880326 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795"} err="failed to get container status \"5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795\": rpc error: code = NotFound desc = could not find container \"5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795\": container with ID starting with 5b92950037ffc7648f2520f0e43aed59ddfed8b343356ef051cc18c94fd9c795 not found: ID does not exist" Jul 28 10:21:44.880374 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880343 2564 scope.go:117] "RemoveContainer" containerID="d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14" Jul 28 10:21:44.880515 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880500 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6"] Jul 28 10:21:44.880564 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:21:44.880551 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14\": container with ID starting with d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14 not found: ID does not exist" containerID="d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14" Jul 28 10:21:44.880606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880569 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14"} err="failed to get container status \"d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14\": rpc error: code = NotFound desc = could not find container \"d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14\": container with ID starting with d92ccb6dbcbc4321b8e765bb3eb27eaf54759bef0a282f89de62a5d0722dac14 not found: ID does not exist" Jul 28 10:21:44.880606 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880584 2564 scope.go:117] "RemoveContainer" containerID="0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2" Jul 28 10:21:44.880830 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:21:44.880816 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2\": container with ID starting with 0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2 not found: ID does not exist" containerID="0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2" Jul 28 10:21:44.880872 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.880834 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2"} err="failed to get container status \"0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2\": rpc error: code = NotFound desc = could not find container \"0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2\": container with ID starting with 0c7032a9ddacf16ce8f1a8cf89b976323ddc37d95bd2d9310d26e62f0fc675c2 not found: ID does not exist" Jul 28 10:21:44.883522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.883308 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vqkz\" (UniqueName: \"kubernetes.io/projected/32af236a-7cfe-469a-9a45-e04f23144582-kube-api-access-9vqkz\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:44.883522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.883336 2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-cabundle-cert\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:44.883522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.883351 2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32af236a-7cfe-469a-9a45-e04f23144582-kserve-provision-location\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:44.883522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.883364 2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32af236a-7cfe-469a-9a45-e04f23144582-proxy-tls\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:44.883522 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.883378 2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32af236a-7cfe-469a-9a45-e04f23144582-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:21:44.884994 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:44.884976 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-85cb8c5574-2ccq6"] Jul 28 10:21:45.674949 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:45.674914 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32af236a-7cfe-469a-9a45-e04f23144582" path="/var/lib/kubelet/pods/32af236a-7cfe-469a-9a45-e04f23144582/volumes" Jul 28 10:21:45.675394 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:45.675380 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" path="/var/lib/kubelet/pods/52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4/volumes" Jul 28 10:21:50.519083 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:50.519049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:21:51.123504 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:21:51.123470 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:40.472215 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:22:40.472176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:40.781263 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:22:40.781225 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:22:42.768216 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:22:42.768173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:23:12.068025 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:23:12.067937 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:23:12.123218 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:23:12.123179 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:26:51.995821 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:26:51.995783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:28:22.489208 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:28:22.489174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:29:21.716462 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:29:21.716382 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:05.170151 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:05.170118 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:05.306473 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:05.306443 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:05.394449 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:05.394415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:05.472428 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:05.472358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:05.536692 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:05.536653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:05.654426 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:05.654402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:55.024959 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:55.024878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:55.143909 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:55.143872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:55.226146 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:55.226117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:55.302764 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:55.302692 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:55.531062 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:55.531031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:30:55.727820 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:30:55.727743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:05.398216 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:05.398185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:05.613136 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:05.613103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:15.472778 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:15.472701 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:15.598416 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:15.598388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:15.672312 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:15.672285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:15.748759 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:15.748684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:15.958729 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:15.958699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:31:16.367055 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:31:16.367020 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:05.221169 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:05.221093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:06.434309 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:06.434273 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.337343 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.337312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.447860 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.447776 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.521921 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.521888 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.594286 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.594252 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.701734 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.701636 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.796135 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.796105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.897001 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.896963 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:32:15.950945 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:32:15.950920 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:33:16.339904 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:33:16.339867 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:33:16.441705 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:33:16.441656 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:34:54.093058 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:34:54.093001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:38.883442 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:35:38.883406 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:35:38.984238 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:35:38.984207 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:30.456687 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:40:30.456623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:40:31.600549 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:40:31.600517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.056925 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.056841 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.203086 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.203052 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.298899 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.298861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.399487 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.399409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.499600 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.499567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.602058 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.602030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.700766 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.700688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:30.815224 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:30.815196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:40.685575 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:40.685486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:40.828320 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:40.828262 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:40.929036 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:40.929003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:41.030071 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:41.030022 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:41.129892 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:41.129868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:41:41.761034 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:41:41.761001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:42:30.284938 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:42:30.284898 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:42:30.437406 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:42:30.437364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:42:40.902889 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:42:40.902853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:42:41.026868 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:42:41.026828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:43:32.150008 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:43:32.149976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:44:28.187687 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:44:28.187584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:50:37.601898 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:50:37.601822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:50:55.585469 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:50:55.585434 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:50:55.780653 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:50:55.780617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:50:55.894110 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:50:55.894028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:52:20.105033 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:52:20.104996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:11.589716 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:11.589683 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:49.413993 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:49.413953 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:49.577049 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:49.577017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:49.654629 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:49.654597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:50.148842 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.148808 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hdzn/must-gather-7q7pc"] Jul 28 10:58:50.149164 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149147 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kube-rbac-proxy" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149167 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kube-rbac-proxy" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149180 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kube-rbac-proxy" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149188 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kube-rbac-proxy" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149202 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="storage-initializer" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149211 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="storage-initializer" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149220 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149229 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149243 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" Jul 28 10:58:50.149253 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149250 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" Jul 28 10:58:50.149701 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149276 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="storage-initializer" Jul 28 10:58:50.149701 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149286 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="storage-initializer" Jul 28 10:58:50.149701 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149354 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kube-rbac-proxy" Jul 28 10:58:50.149701 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149368 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kube-rbac-proxy" Jul 28 10:58:50.149701 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149379 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="32af236a-7cfe-469a-9a45-e04f23144582" containerName="kserve-container" Jul 28 10:58:50.149701 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.149397 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="52f4e69e-7acb-4a5e-bcc0-c13c9f3ffcd4" containerName="kserve-container" Jul 28 10:58:50.152454 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.152432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.154641 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.154618 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hdzn\"/\"default-dockercfg-cms8z\"" Jul 28 10:58:50.154785 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.154766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hdzn\"/\"kube-root-ca.crt\"" Jul 28 10:58:50.154871 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.154857 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hdzn\"/\"openshift-service-ca.crt\"" Jul 28 10:58:50.160552 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.160523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hdzn/must-gather-7q7pc"] Jul 28 10:58:50.164255 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.164218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:50.261026 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.260996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:58:50.271138 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.271116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnq8\" (UniqueName: \"kubernetes.io/projected/766c71da-5fca-4752-ac17-026d4c1096a4-kube-api-access-6bnq8\") pod \"must-gather-7q7pc\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.271227 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.271143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/766c71da-5fca-4752-ac17-026d4c1096a4-must-gather-output\") pod \"must-gather-7q7pc\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.372339 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.372316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnq8\" (UniqueName: \"kubernetes.io/projected/766c71da-5fca-4752-ac17-026d4c1096a4-kube-api-access-6bnq8\") pod \"must-gather-7q7pc\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.372440 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.372346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/766c71da-5fca-4752-ac17-026d4c1096a4-must-gather-output\") pod \"must-gather-7q7pc\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.372653 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.372638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/766c71da-5fca-4752-ac17-026d4c1096a4-must-gather-output\") pod \"must-gather-7q7pc\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.381281 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.381256 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnq8\" (UniqueName: \"kubernetes.io/projected/766c71da-5fca-4752-ac17-026d4c1096a4-kube-api-access-6bnq8\") pod \"must-gather-7q7pc\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.462212 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.462161 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:58:50.585828 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.585802 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hdzn/must-gather-7q7pc"] Jul 28 10:58:50.588074 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:58:50.588047 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod766c71da_5fca_4752_ac17_026d4c1096a4.slice/crio-fd26f2422a559a127cffc80ea6de6b4175937abc7ad76ade089ac24bc005d4ac WatchSource:0}: Error finding container fd26f2422a559a127cffc80ea6de6b4175937abc7ad76ade089ac24bc005d4ac: Status 404 returned error can't find the container with id fd26f2422a559a127cffc80ea6de6b4175937abc7ad76ade089ac24bc005d4ac Jul 28 10:58:50.589816 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:50.589795 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 10:58:51.093530 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:51.093495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" event={"ID":"766c71da-5fca-4752-ac17-026d4c1096a4","Type":"ContainerStarted","Data":"fd26f2422a559a127cffc80ea6de6b4175937abc7ad76ade089ac24bc005d4ac"} Jul 28 10:58:57.120922 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:57.120883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" event={"ID":"766c71da-5fca-4752-ac17-026d4c1096a4","Type":"ContainerStarted","Data":"1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220"} Jul 28 10:58:57.120922 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:57.120928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" event={"ID":"766c71da-5fca-4752-ac17-026d4c1096a4","Type":"ContainerStarted","Data":"305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719"} Jul 28 10:58:57.140309 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:58:57.140257 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" podStartSLOduration=1.1337620720000001 podStartE2EDuration="7.140243125s" totalImagesPullingTime="6.006481053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:58:57.139180607 +0000 UTC m=+3048.010381822" watchObservedRunningTime="2026-07-28 10:58:57.140243125 +0000 UTC m=+3048.011444336" Jul 28 10:59:18.218219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.218186 2564 generic.go:356] "Generic (PLEG): container finished" podID="766c71da-5fca-4752-ac17-026d4c1096a4" containerID="305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719" exitCode=0 Jul 28 10:59:18.218617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.218249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" event={"ID":"766c71da-5fca-4752-ac17-026d4c1096a4","Type":"ContainerDied","Data":"305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719"} Jul 28 10:59:18.218617 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.218539 2564 scope.go:117] "RemoveContainer" containerID="305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719" Jul 28 10:59:18.267349 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.267319 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2hdzn_must-gather-7q7pc_766c71da-5fca-4752-ac17-026d4c1096a4/gather/0.log" Jul 28 10:59:18.700914 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.700880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:18.839777 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.839743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:18.942680 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:18.942641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:21.714348 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:21.714315 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zz62r_a0b2ca42-51a0-4b63-bb5b-5615d5ab0f26/global-pull-secret-syncer/0.log" Jul 28 10:59:21.764852 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:21.764827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" Jul 28 10:59:21.855810 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:21.855783 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-25.ec2.internal_a7799387ccba9495df83effa34fca314/haproxy/0.log" Jul 28 10:59:23.683013 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.682981 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2hdzn/must-gather-7q7pc"] Jul 28 10:59:23.683448 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.683136 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="copy" containerID="cri-o://1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220" gracePeriod=2 Jul 28 10:59:23.688273 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.688245 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2hdzn/must-gather-7q7pc"] Jul 28 10:59:23.910267 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.910246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2hdzn_must-gather-7q7pc_766c71da-5fca-4752-ac17-026d4c1096a4/copy/0.log" Jul 28 10:59:23.912864 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.912848 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:59:23.914770 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:59:23.914746 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7q7pc\" is forbidden: User \"system:node:ip-10-0-130-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2hdzn\": no relationship found between node 'ip-10-0-130-25.ec2.internal' and this object" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:59:23.948175 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.948122 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/766c71da-5fca-4752-ac17-026d4c1096a4-must-gather-output\") pod \"766c71da-5fca-4752-ac17-026d4c1096a4\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " Jul 28 10:59:23.948175 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.948169 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bnq8\" (UniqueName: \"kubernetes.io/projected/766c71da-5fca-4752-ac17-026d4c1096a4-kube-api-access-6bnq8\") pod \"766c71da-5fca-4752-ac17-026d4c1096a4\" (UID: \"766c71da-5fca-4752-ac17-026d4c1096a4\") " Jul 28 10:59:23.949628 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.949605 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766c71da-5fca-4752-ac17-026d4c1096a4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "766c71da-5fca-4752-ac17-026d4c1096a4" (UID: "766c71da-5fca-4752-ac17-026d4c1096a4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 10:59:23.950259 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:23.950240 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766c71da-5fca-4752-ac17-026d4c1096a4-kube-api-access-6bnq8" (OuterVolumeSpecName: "kube-api-access-6bnq8") pod "766c71da-5fca-4752-ac17-026d4c1096a4" (UID: "766c71da-5fca-4752-ac17-026d4c1096a4"). InnerVolumeSpecName "kube-api-access-6bnq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 10:59:24.049733 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.049711 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/766c71da-5fca-4752-ac17-026d4c1096a4-must-gather-output\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:59:24.049733 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.049732 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bnq8\" (UniqueName: \"kubernetes.io/projected/766c71da-5fca-4752-ac17-026d4c1096a4-kube-api-access-6bnq8\") on node \"ip-10-0-130-25.ec2.internal\" DevicePath \"\"" Jul 28 10:59:24.241789 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.241735 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2hdzn_must-gather-7q7pc_766c71da-5fca-4752-ac17-026d4c1096a4/copy/0.log" Jul 28 10:59:24.242083 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.242058 2564 generic.go:356] "Generic (PLEG): container finished" podID="766c71da-5fca-4752-ac17-026d4c1096a4" containerID="1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220" exitCode=143 Jul 28 10:59:24.242146 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.242107 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:59:24.242198 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.242110 2564 scope.go:117] "RemoveContainer" containerID="1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220" Jul 28 10:59:24.244711 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:59:24.244687 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7q7pc\" is forbidden: User \"system:node:ip-10-0-130-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2hdzn\": no relationship found between node 'ip-10-0-130-25.ec2.internal' and this object" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:59:24.251168 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.251096 2564 scope.go:117] "RemoveContainer" containerID="305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719" Jul 28 10:59:24.253648 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:59:24.253624 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7q7pc\" is forbidden: User \"system:node:ip-10-0-130-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2hdzn\": no relationship found between node 'ip-10-0-130-25.ec2.internal' and this object" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" pod="openshift-must-gather-2hdzn/must-gather-7q7pc" Jul 28 10:59:24.263044 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.263027 2564 scope.go:117] "RemoveContainer" containerID="1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220" Jul 28 10:59:24.263288 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:59:24.263270 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220\": container with ID starting with 1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220 not found: ID does not exist" containerID="1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220" Jul 28 10:59:24.263330 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.263298 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220"} err="failed to get container status \"1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220\": rpc error: code = NotFound desc = could not find container \"1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220\": container with ID starting with 1a4ae8fdaec1d3857b6fa895c55d588985987e48ffa102e8a0cd45e9e0614220 not found: ID does not exist" Jul 28 10:59:24.263330 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.263315 2564 scope.go:117] "RemoveContainer" containerID="305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719" Jul 28 10:59:24.263528 ip-10-0-130-25 kubenswrapper[2564]: E0728 10:59:24.263508 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719\": container with ID starting with 305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719 not found: ID does not exist" containerID="305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719" Jul 28 10:59:24.263582 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.263535 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719"} err="failed to get container status \"305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719\": rpc error: code = NotFound desc = could not find container \"305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719\": container with ID starting with 305136dcdef3663158ed017e4ccd1fdb53cee54481e801c9efab001b661fd719 not found: ID does not exist" Jul 28 10:59:24.549953 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.549916 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:24.610898 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:24.610873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:25.674585 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:25.674554 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" path="/var/lib/kubelet/pods/766c71da-5fca-4752-ac17-026d4c1096a4/volumes" Jul 28 10:59:25.989021 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:25.988991 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-sc4gm_e06fc3f7-b2bc-48e0-af60-7b332070e838/monitoring-plugin/0.log" Jul 28 10:59:26.022679 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.022646 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2ldd9_70b13b45-f814-43d8-82ff-047f0215f2f2/node-exporter/0.log" Jul 28 10:59:26.051130 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.051111 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2ldd9_70b13b45-f814-43d8-82ff-047f0215f2f2/kube-rbac-proxy/0.log" Jul 28 10:59:26.099064 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.099043 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2ldd9_70b13b45-f814-43d8-82ff-047f0215f2f2/init-textfile/0.log" Jul 28 10:59:26.310645 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.310625 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-jksc6_58e91296-2670-4ef1-812d-7bc03b30f9f5/kube-rbac-proxy-main/0.log" Jul 28 10:59:26.336400 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.336383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-jksc6_58e91296-2670-4ef1-812d-7bc03b30f9f5/kube-rbac-proxy-self/0.log" Jul 28 10:59:26.365574 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.365557 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-jksc6_58e91296-2670-4ef1-812d-7bc03b30f9f5/openshift-state-metrics/0.log" Jul 28 10:59:26.406090 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.406076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/prometheus/0.log" Jul 28 10:59:26.431562 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.431544 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/config-reloader/0.log" Jul 28 10:59:26.462501 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.462484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/thanos-sidecar/0.log" Jul 28 10:59:26.487673 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.487655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/kube-rbac-proxy-web/0.log" Jul 28 10:59:26.518888 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.518867 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/kube-rbac-proxy/0.log" Jul 28 10:59:26.543564 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.543517 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/kube-rbac-proxy-thanos/0.log" Jul 28 10:59:26.570092 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.570041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d41a1849-395b-40b9-a6cf-45c41c590243/init-config-reloader/0.log" Jul 28 10:59:26.604268 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.604249 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-s7fcl_08da5972-f9e9-4b69-a48c-65a3996f2b13/prometheus-operator/0.log" Jul 28 10:59:26.625809 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.625792 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-s7fcl_08da5972-f9e9-4b69-a48c-65a3996f2b13/kube-rbac-proxy/0.log" Jul 28 10:59:26.793360 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.793340 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5759559c66-f7rvk_5a906637-24ff-4357-8f5f-45b7e8c8edfc/thanos-query/0.log" Jul 28 10:59:26.820866 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.820788 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5759559c66-f7rvk_5a906637-24ff-4357-8f5f-45b7e8c8edfc/kube-rbac-proxy-web/0.log" Jul 28 10:59:26.850905 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.850887 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5759559c66-f7rvk_5a906637-24ff-4357-8f5f-45b7e8c8edfc/kube-rbac-proxy/0.log" Jul 28 10:59:26.879316 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.879298 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5759559c66-f7rvk_5a906637-24ff-4357-8f5f-45b7e8c8edfc/prom-label-proxy/0.log" Jul 28 10:59:26.906683 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.906650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5759559c66-f7rvk_5a906637-24ff-4357-8f5f-45b7e8c8edfc/kube-rbac-proxy-rules/0.log" Jul 28 10:59:26.934773 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:26.934755 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5759559c66-f7rvk_5a906637-24ff-4357-8f5f-45b7e8c8edfc/kube-rbac-proxy-metrics/0.log" Jul 28 10:59:29.379799 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.379767 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44"] Jul 28 10:59:29.380185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.380065 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="gather" Jul 28 10:59:29.380185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.380077 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="gather" Jul 28 10:59:29.380185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.380095 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="copy" Jul 28 10:59:29.380185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.380101 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="copy" Jul 28 10:59:29.380185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.380151 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="copy" Jul 28 10:59:29.380185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.380165 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="766c71da-5fca-4752-ac17-026d4c1096a4" containerName="gather" Jul 28 10:59:29.385295 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.385275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.387586 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.387567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvln5\"/\"openshift-service-ca.crt\"" Jul 28 10:59:29.387688 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.387630 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tvln5\"/\"default-dockercfg-6kpps\"" Jul 28 10:59:29.388424 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.388409 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvln5\"/\"kube-root-ca.crt\"" Jul 28 10:59:29.392895 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.392876 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44"] Jul 28 10:59:29.488658 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.488631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-lib-modules\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.488821 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.488662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-proc\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.488821 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.488719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-sys\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.488911 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.488821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ljds\" (UniqueName: \"kubernetes.io/projected/450b64ed-bb75-422e-8272-7c332a0a9d63-kube-api-access-9ljds\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.488911 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.488850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-podres\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590066 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ljds\" (UniqueName: \"kubernetes.io/projected/450b64ed-bb75-422e-8272-7c332a0a9d63-kube-api-access-9ljds\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-podres\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-lib-modules\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-proc\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-sys\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590219 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-sys\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590419 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-proc\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590419 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590253 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-podres\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.590419 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.590257 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/450b64ed-bb75-422e-8272-7c332a0a9d63-lib-modules\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.599365 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.599340 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ljds\" (UniqueName: \"kubernetes.io/projected/450b64ed-bb75-422e-8272-7c332a0a9d63-kube-api-access-9ljds\") pod \"perf-node-gather-daemonset-xsn44\" (UID: \"450b64ed-bb75-422e-8272-7c332a0a9d63\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.695211 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.695152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:29.823185 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:29.823156 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44"] Jul 28 10:59:29.827218 ip-10-0-130-25 kubenswrapper[2564]: W0728 10:59:29.827188 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod450b64ed_bb75_422e_8272_7c332a0a9d63.slice/crio-d5ce5cbde0bcc47d2ec67dc24a66f7ac74feb3f12deb20e495434488bda0c22f WatchSource:0}: Error finding container d5ce5cbde0bcc47d2ec67dc24a66f7ac74feb3f12deb20e495434488bda0c22f: Status 404 returned error can't find the container with id d5ce5cbde0bcc47d2ec67dc24a66f7ac74feb3f12deb20e495434488bda0c22f Jul 28 10:59:30.267844 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.267808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" event={"ID":"450b64ed-bb75-422e-8272-7c332a0a9d63","Type":"ContainerStarted","Data":"09141718e2a32809edb78222417c89cf422007b5df8d7224f97853fcb3cc8a88"} Jul 28 10:59:30.267989 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.267866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" event={"ID":"450b64ed-bb75-422e-8272-7c332a0a9d63","Type":"ContainerStarted","Data":"d5ce5cbde0bcc47d2ec67dc24a66f7ac74feb3f12deb20e495434488bda0c22f"} Jul 28 10:59:30.267989 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.267896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:30.283731 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.283688 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" podStartSLOduration=1.283657892 podStartE2EDuration="1.283657892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:59:30.282564926 +0000 UTC m=+3081.153766140" watchObservedRunningTime="2026-07-28 10:59:30.283657892 +0000 UTC m=+3081.154859103" Jul 28 10:59:30.634823 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.634749 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2xdd_3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d/dns/0.log" Jul 28 10:59:30.657662 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.657642 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2xdd_3dfa7a5e-00f5-4e0b-acc7-3494e9a18f3d/kube-rbac-proxy/0.log" Jul 28 10:59:30.711748 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:30.711727 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gvzkw_c7b3e677-1de7-4eb1-9be9-6d1633d4d63b/dns-node-resolver/0.log" Jul 28 10:59:31.300314 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:31.300285 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tjgzh_e5b9839d-062b-4dff-aaab-f3d18085fe1f/node-ca/0.log" Jul 28 10:59:32.099903 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:32.099871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b8d776f9-wfnxj_f2606335-2452-486c-9446-f6e11a09c116/router/0.log" Jul 28 10:59:32.447470 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:32.447398 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5qg6s_fba6bf81-d9ff-41d8-a5a8-6c84ec6f4f25/serve-healthcheck-canary/0.log" Jul 28 10:59:32.912578 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:32.912550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-rwz6k_7dc98088-96cc-451e-bf44-35c4da4d9d74/insights-operator/0.log" Jul 28 10:59:32.912977 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:32.912959 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-rwz6k_7dc98088-96cc-451e-bf44-35c4da4d9d74/insights-operator/1.log" Jul 28 10:59:33.139539 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:33.139514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swz2d_0a74dd63-e2e6-4c30-9a09-9c91791e7658/kube-rbac-proxy/0.log" Jul 28 10:59:33.165438 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:33.165368 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swz2d_0a74dd63-e2e6-4c30-9a09-9c91791e7658/exporter/0.log" Jul 28 10:59:33.194064 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:33.194047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swz2d_0a74dd63-e2e6-4c30-9a09-9c91791e7658/extractor/0.log" Jul 28 10:59:35.906901 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:35.906871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-5kgvs_72e65e82-78a0-4797-af43-9bab1c83ef7c/s3-init/0.log" Jul 28 10:59:35.927594 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:35.927567 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-5kgvs_72e65e82-78a0-4797-af43-9bab1c83ef7c/download-hf-model/0.log" Jul 28 10:59:36.281773 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:36.281750 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-xsn44" Jul 28 10:59:40.751637 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:40.751605 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-ms8j5_f7884fcc-6c40-4605-9016-2e0084583854/migrator/0.log" Jul 28 10:59:40.774942 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:40.774922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-ms8j5_f7884fcc-6c40-4605-9016-2e0084583854/graceful-termination/0.log" Jul 28 10:59:42.023903 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.023867 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d9xc_75355376-580f-4b6c-a2d5-12c4938c5442/konnectivity-agent/0.log" limit=1024 Jul 28 10:59:42.641791 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.641759 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/kube-multus-additional-cni-plugins/0.log" Jul 28 10:59:42.673050 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.673028 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/egress-router-binary-copy/0.log" Jul 28 10:59:42.699295 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.699275 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/cni-plugins/0.log" Jul 28 10:59:42.725397 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.725372 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/bond-cni-plugin/0.log" Jul 28 10:59:42.757975 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.757953 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/routeoverride-cni/0.log" Jul 28 10:59:42.787631 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.787614 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/whereabouts-cni-bincopy/0.log" Jul 28 10:59:42.813630 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.813608 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z96mn_58bb0eef-bfa4-48f2-822e-feec47bdff90/whereabouts-cni/0.log" Jul 28 10:59:42.849882 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.849862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bhkmj_71338c5e-4d44-435c-86c7-90d3a2565f3f/kube-multus/0.log" Jul 28 10:59:42.959252 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.959196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bswb7_4f22e723-9f46-4b50-8a3f-e8d624539b30/network-metrics-daemon/0.log" Jul 28 10:59:42.982452 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:42.982433 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bswb7_4f22e723-9f46-4b50-8a3f-e8d624539b30/kube-rbac-proxy/0.log" Jul 28 10:59:43.819960 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.819933 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/ovn-controller/0.log" Jul 28 10:59:43.842024 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.841996 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/ovn-acl-logging/0.log" Jul 28 10:59:43.877733 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.877709 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/kube-rbac-proxy-node/0.log" Jul 28 10:59:43.902954 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.902929 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 10:59:43.926656 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.926636 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/northd/0.log" Jul 28 10:59:43.950878 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.950861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/nbdb/0.log" Jul 28 10:59:43.976027 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:43.976011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/sbdb/0.log" Jul 28 10:59:44.019582 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:44.019563 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bbtd_ef2dbf6c-8573-431b-9797-18c7b5c6000c/ovnkube-controller/0.log" Jul 28 10:59:45.613030 ip-10-0-130-25 kubenswrapper[2564]: I0728 10:59:45.612959 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dnq8m_6893d4b7-a33c-4886-bf2f-5ad28663106c/network-check-target-container/0.log"