Jul 28 12:35:05.800533 ip-10-0-129-244 systemd[1]: Starting Kubernetes Kubelet... Jul 28 12:35:06.151800 ip-10-0-129-244 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:35:06.151800 ip-10-0-129-244 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 12:35:06.151800 ip-10-0-129-244 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:35:06.151800 ip-10-0-129-244 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 12:35:06.151800 ip-10-0-129-244 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:35:06.153495 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.153408 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 12:35:06.157680 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157661 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:35:06.157680 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157676 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:35:06.157680 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157682 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:35:06.157680 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157686 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157691 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157695 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157699 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157702 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157706 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157710 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157714 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157718 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157722 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157725 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157729 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157733 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157737 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157741 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157745 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157749 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157754 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157759 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157762 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:35:06.157926 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157766 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157770 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157776 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157784 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157790 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157795 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157800 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157804 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157809 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157813 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157818 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157822 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157826 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157831 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157836 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157840 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157845 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157849 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157853 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:35:06.158724 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157858 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157862 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157867 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157871 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157875 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157879 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157884 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157888 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157892 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157897 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157901 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157905 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157909 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157914 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157920 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157924 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157928 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157932 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157936 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:35:06.159195 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157940 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157944 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157948 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157952 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157957 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157961 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157966 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157972 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157977 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157981 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157987 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157991 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157995 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.157999 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158003 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158008 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158012 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158016 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158020 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158024 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:35:06.160000 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158028 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158032 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158037 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158041 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158044 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158049 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158053 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158057 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158061 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158065 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158069 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158073 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158080 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158085 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158090 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158094 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158099 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.158103 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159927 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159938 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:35:06.160911 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159945 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159949 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159954 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159960 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159966 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159971 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159976 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159980 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159988 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159994 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.159998 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160002 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160007 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160011 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160015 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160019 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160024 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160028 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160033 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:35:06.161788 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160037 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160042 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160046 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160050 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160055 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160059 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160063 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160069 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160075 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160080 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160087 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160091 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160097 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160103 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160108 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160112 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160116 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160127 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:35:06.162644 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160131 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160136 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160141 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160145 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160149 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160153 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160157 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160163 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160167 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160172 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160176 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160180 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160184 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160188 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160192 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160196 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160200 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160204 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160224 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160229 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:35:06.163360 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160233 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160237 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160241 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160245 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160249 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160254 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160258 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160262 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160266 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160271 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160275 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160280 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160285 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160290 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160294 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160298 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160302 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160306 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160310 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160315 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:35:06.163962 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160319 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160323 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160327 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160332 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160337 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160341 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160345 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160349 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160353 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160358 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160362 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160366 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160370 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160374 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160378 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160382 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160386 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160390 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160394 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.160399 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:35:06.164663 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161004 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161013 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161018 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161025 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161031 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161035 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161040 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161044 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161048 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161053 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161058 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161062 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161066 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161070 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161074 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161079 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161083 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161087 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161091 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:35:06.165168 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161095 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161099 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161103 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161107 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161111 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161115 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161119 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161124 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161128 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161132 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161136 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161140 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161144 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161148 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161152 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161156 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161165 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161171 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161177 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:35:06.165756 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161182 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161186 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161191 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161195 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161200 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161204 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161226 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161230 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161234 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161238 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161243 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161247 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161251 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161257 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161261 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161265 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161269 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161273 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161277 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:35:06.166245 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161282 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161286 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161290 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161294 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161298 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161302 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161307 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161311 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161316 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161320 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161326 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161330 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161335 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161340 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161344 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161348 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161355 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161363 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161369 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:35:06.166727 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161375 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161380 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161385 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161390 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161394 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161399 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161404 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161408 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161412 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161417 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161421 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161425 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161429 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161433 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161438 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161442 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161446 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161450 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161456 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161460 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:35:06.167269 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161464 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161468 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.161473 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161577 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161594 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161604 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161610 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161617 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161622 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161629 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161635 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161641 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161646 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161653 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161659 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161664 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161668 2560 flags.go:64] FLAG: --cgroup-root="" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161673 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161678 2560 flags.go:64] FLAG: --client-ca-file="" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161683 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161688 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161694 2560 flags.go:64] FLAG: --cluster-domain="" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161699 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161704 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 12:35:06.167754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161709 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161715 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161722 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161726 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161731 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161737 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161744 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161749 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161754 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161759 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161764 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161772 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161777 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161782 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161786 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161791 2560 flags.go:64] FLAG: --enable-server="true" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161796 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161812 2560 flags.go:64] FLAG: --event-burst="100" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161817 2560 flags.go:64] FLAG: --event-qps="50" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161822 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161826 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161831 2560 flags.go:64] FLAG: --eviction-hard="" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161851 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161856 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161860 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 12:35:06.168350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161865 2560 flags.go:64] FLAG: --eviction-soft="" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161870 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161875 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161879 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161884 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161889 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161893 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161898 2560 flags.go:64] FLAG: --feature-gates="" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161904 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161909 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161914 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161920 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161924 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161932 2560 flags.go:64] FLAG: --help="false" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161937 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161942 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161947 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161952 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161958 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161964 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161968 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161973 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161977 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 12:35:06.169024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161982 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161988 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161994 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.161999 2560 flags.go:64] FLAG: --kube-reserved="" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162004 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162009 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162014 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162018 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162023 2560 flags.go:64] FLAG: --lock-file="" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162027 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162032 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162038 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162046 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162051 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162056 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162060 2560 flags.go:64] FLAG: --logging-format="text" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162065 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162070 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162075 2560 flags.go:64] FLAG: --manifest-url="" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162080 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162087 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162092 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162099 2560 flags.go:64] FLAG: --max-pods="110" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162104 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162109 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 12:35:06.169630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162114 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162119 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162124 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162128 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162133 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162145 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162149 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162154 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162159 2560 flags.go:64] FLAG: --pod-cidr="" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162165 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162173 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162178 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162183 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162188 2560 flags.go:64] FLAG: --port="10250" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162192 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162197 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03bb282ed0f014d70" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162203 2560 flags.go:64] FLAG: --qos-reserved="" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162224 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162230 2560 flags.go:64] FLAG: --register-node="true" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162234 2560 flags.go:64] FLAG: --register-with-taints="" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162240 2560 flags.go:64] FLAG: --registry-burst="10" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162245 2560 flags.go:64] FLAG: --registry-qps="5" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162249 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162254 2560 flags.go:64] FLAG: --reserved-memory="" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162259 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 12:35:06.170312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162265 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162269 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162274 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162280 2560 flags.go:64] FLAG: --runonce="false" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162284 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162293 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162298 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162303 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162307 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162312 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162317 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162322 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162327 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162332 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162337 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162342 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162347 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162352 2560 flags.go:64] FLAG: --system-cgroups="" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162357 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162366 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162371 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162376 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162382 2560 flags.go:64] FLAG: --tls-min-version="" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162386 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162391 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 12:35:06.170956 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162396 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162400 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162406 2560 flags.go:64] FLAG: --v="2" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162412 2560 flags.go:64] FLAG: --version="false" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162419 2560 flags.go:64] FLAG: --vmodule="" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162425 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.162430 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162604 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162610 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162615 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162620 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162624 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162630 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162635 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162639 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162643 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162646 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162651 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162655 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162659 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162663 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162667 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:35:06.171591 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162671 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162676 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162681 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162686 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162690 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162694 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162699 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162703 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162707 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162713 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162721 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162727 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162732 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162736 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162741 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162746 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162751 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162756 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162760 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:35:06.172140 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162765 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162770 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162775 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162780 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162784 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162789 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162793 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162797 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162801 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162805 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162809 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162813 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162818 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162822 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162826 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162830 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162834 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162840 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162844 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:35:06.172691 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162849 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162853 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162857 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162863 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162867 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162871 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162875 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162879 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162884 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162888 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162892 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162896 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162900 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162904 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162909 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162913 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162917 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162921 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162925 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162929 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:35:06.173155 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162933 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162937 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162942 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162946 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162950 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162955 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162959 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162963 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162967 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162971 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162975 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162980 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162984 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162988 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162993 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.162998 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163005 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163010 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163014 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:35:06.173677 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163019 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163024 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163028 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163034 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163040 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163044 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.163049 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.163058 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170033 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170047 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170059 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170064 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170119 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170124 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:35:06.174141 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170127 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170130 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170133 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170136 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170139 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170141 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170145 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170147 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170150 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170153 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170158 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170161 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170163 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170166 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170169 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170171 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170174 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170176 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170179 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170181 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:35:06.174520 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170184 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170186 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170189 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170192 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170195 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170198 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170200 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170203 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170206 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170226 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170229 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170232 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170234 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170237 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170240 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170243 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170245 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170248 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170250 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170253 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:35:06.175017 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170255 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170258 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170260 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170264 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170266 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170269 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170272 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170274 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170277 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170280 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170282 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170285 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170287 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170289 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170292 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170295 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170297 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170300 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170303 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170306 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:35:06.175534 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170308 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170311 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170313 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170316 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170318 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170323 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170326 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170329 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170332 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170335 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170338 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170342 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170345 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170348 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170351 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170354 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170357 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170360 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170363 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:35:06.176024 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170366 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170369 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170371 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170374 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170377 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170380 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170383 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170385 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170388 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170390 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170394 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170398 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170400 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170403 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170406 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170408 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170411 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:35:06.176731 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170413 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170419 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170535 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170539 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170542 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170545 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170547 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170550 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170552 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170555 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170557 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170560 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170563 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170566 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170568 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:35:06.177452 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170571 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170573 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170576 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170578 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170581 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170584 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170586 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170588 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170591 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170593 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170596 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170598 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170601 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170603 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170606 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170608 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170611 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170613 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170615 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170618 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:35:06.177868 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170621 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170623 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170626 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170628 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170631 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170633 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170636 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170638 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170641 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170643 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170646 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170649 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170651 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170654 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170656 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170659 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170662 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170664 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170667 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170669 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:35:06.178380 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170673 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170676 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170679 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170682 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170684 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170687 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170689 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170692 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170694 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170697 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170699 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170702 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170704 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170707 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170709 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170712 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170714 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170717 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170719 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:35:06.178881 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170722 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170724 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170726 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170729 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170731 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170736 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170739 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170742 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170745 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170748 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170751 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170753 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170756 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170758 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170761 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170765 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170768 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170772 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170774 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:35:06.179364 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170777 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170780 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170782 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170785 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170787 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170790 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170792 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:06.170795 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170800 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.170894 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.172885 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.174172 2560 server.go:1019] "Starting client certificate rotation" Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.174246 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.174291 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 12:35:06.179845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.178245 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 12:35:06.180200 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.179389 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 12:35:06.188816 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.188794 2560 log.go:25] "Validated CRI v1 runtime API" Jul 28 12:35:06.190881 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.190868 2560 log.go:25] "Validated CRI v1 image API" Jul 28 12:35:06.191696 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.191682 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 12:35:06.193896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.193876 2560 fs.go:135] Filesystem UUIDs: map[1cd23572-f653-4c05-b846-98bbf0e2a263:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90608c68-5d77-4d86-b6b8-1405a2c1e9f0:/dev/nvme0n1p4] Jul 28 12:35:06.194001 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.193896 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 12:35:06.199430 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.199323 2560 manager.go:216] Machine: {Timestamp:2026-07-28 12:35:06.197544365 +0000 UTC m=+0.284625899 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106030 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dec0a0e33c5be511c2ee84e484a13 SystemUUID:ec2dec0a-0e33-c5be-511c-2ee84e484a13 BootID:9380536f-080c-49dd-a22f-f61d6ea04846 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:48:b2:57:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:48:b2:57:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:59:0a:a7:7b:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 12:35:06.199430 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.199423 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 12:35:06.199554 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.199538 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 12:35:06.202357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.202334 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 12:35:06.202488 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.202362 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 12:35:06.203027 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.203017 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 12:35:06.203071 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.203029 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 12:35:06.203071 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.203038 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 12:35:06.203433 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.203419 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 12:35:06.203666 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.203655 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 12:35:06.204913 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.204903 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 12:35:06.208664 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208652 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 28 12:35:06.208780 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208770 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 12:35:06.208814 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208802 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 28 12:35:06.208814 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208813 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 12:35:06.208875 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208828 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 12:35:06.208875 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208837 2560 kubelet.go:398] "Adding apiserver pod source" Jul 28 12:35:06.208875 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.208846 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 12:35:06.209342 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.209328 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 12:35:06.209407 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.209348 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 12:35:06.211509 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.211479 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 12:35:06.214272 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.214252 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 12:35:06.214347 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.214286 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 12:35:06.216003 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.215990 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216009 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216015 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216021 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216029 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216035 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216043 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216048 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 12:35:06.216055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216055 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 12:35:06.216291 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216061 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 12:35:06.216291 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216075 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 12:35:06.216291 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216080 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 12:35:06.216748 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216730 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 12:35:06.216748 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.216747 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 12:35:06.219844 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.219831 2560 server.go:1268] "Started kubelet" Jul 28 12:35:06.219931 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.219901 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 12:35:06.220032 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.219915 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 12:35:06.220032 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.219987 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 12:35:06.220759 ip-10-0-129-244 systemd[1]: Started Kubernetes Kubelet. Jul 28 12:35:06.220989 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.220971 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 12:35:06.221658 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.221641 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 12:35:06.221877 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.221726 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 12:35:06.221877 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.221786 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 28 12:35:06.222244 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.222117 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 12:35:06.224822 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.224804 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 12:35:06.227700 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.227681 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 12:35:06.227700 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.227699 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 12:35:06.227830 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.227788 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.228264 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228247 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 12:35:06.228264 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228249 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 12:35:06.228424 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228278 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 12:35:06.228424 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228411 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 28 12:35:06.228513 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228428 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 28 12:35:06.228513 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228469 2560 factory.go:55] Registering systemd factory Jul 28 12:35:06.228513 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228485 2560 factory.go:223] Registration of the systemd container factory successfully Jul 28 12:35:06.228840 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228717 2560 factory.go:153] Registering CRI-O factory Jul 28 12:35:06.228840 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228734 2560 factory.go:223] Registration of the crio container factory successfully Jul 28 12:35:06.228840 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228778 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 12:35:06.228840 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228796 2560 factory.go:103] Registering Raw factory Jul 28 12:35:06.228840 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.228811 2560 manager.go:1196] Started watching for new ooms in manager Jul 28 12:35:06.229252 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.229226 2560 manager.go:349] Starting recovery of all containers Jul 28 12:35:06.230362 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.228661 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-244.ec2.internal.18c6743cab4d31e8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-244.ec2.internal,UID:ip-10-0-129-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-244.ec2.internal,},FirstTimestamp:2026-07-28 12:35:06.219803112 +0000 UTC m=+0.306884696,LastTimestamp:2026-07-28 12:35:06.219803112 +0000 UTC m=+0.306884696,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-244.ec2.internal,}" Jul 28 12:35:06.233147 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.233118 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 12:35:06.233284 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.233261 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 12:35:06.233816 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.233778 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpmf7" Jul 28 12:35:06.240400 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.240380 2560 manager.go:354] Recovery completed Jul 28 12:35:06.240692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.240672 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpmf7" Jul 28 12:35:06.245656 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.245642 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.247685 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.247666 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.247757 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.247695 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.247757 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.247705 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.248195 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248180 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 12:35:06.248195 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248190 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.248340 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248193 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 12:35:06.248340 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248235 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 28 12:35:06.248847 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248833 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.248888 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248858 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.248888 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.248867 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.250191 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.250121 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-244.ec2.internal.18c6743cacf69824 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-244.ec2.internal,UID:ip-10-0-129-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-244.ec2.internal,},FirstTimestamp:2026-07-28 12:35:06.247682084 +0000 UTC m=+0.334763621,LastTimestamp:2026-07-28 12:35:06.247682084 +0000 UTC m=+0.334763621,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-244.ec2.internal,}" Jul 28 12:35:06.250704 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.250690 2560 policy_none.go:49] "None policy: Start" Jul 28 12:35:06.250704 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.250706 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 12:35:06.250825 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.250716 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 12:35:06.252707 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.252694 2560 policy_none.go:47] "Start" Jul 28 12:35:06.286900 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.286765 2560 manager.go:337] "Starting Device Plugin manager" Jul 28 12:35:06.287012 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.286924 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 12:35:06.287012 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.286936 2560 server.go:87] "Starting device plugin registration server" Jul 28 12:35:06.287187 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.287173 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 12:35:06.287273 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.287188 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 12:35:06.287323 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.287299 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 12:35:06.287370 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.287364 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 12:35:06.287370 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.287370 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 12:35:06.287918 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.287895 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 12:35:06.288003 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.287942 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.332073 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.332045 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 12:35:06.339542 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.333113 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 12:35:06.339542 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.333148 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 12:35:06.339542 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.333171 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 12:35:06.339542 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.333220 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 12:35:06.339542 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.335833 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:35:06.388157 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.388133 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.389479 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.389464 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.389548 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.389492 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.389548 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.389503 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.389548 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.389527 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.395751 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.395737 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.395806 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.395760 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-244.ec2.internal\": node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.407238 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.407144 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.433853 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.433804 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal"] Jul 28 12:35:06.433993 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.433894 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.434851 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.434828 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.434958 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.434858 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.434958 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.434869 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.437171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.437158 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.437293 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.437278 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.437341 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.437309 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.438001 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.437982 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.438078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.438015 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.438078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.438025 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.438078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.437988 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.438190 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.438084 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.438190 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.438097 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.440371 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.440356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.440415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.440392 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:35:06.441111 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.441096 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:35:06.441186 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.441124 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:35:06.441186 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.441139 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:35:06.465896 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.465873 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-244.ec2.internal\" not found" node="ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.470351 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.470335 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-244.ec2.internal\" not found" node="ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.507293 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.507255 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.608366 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.608336 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.629745 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.629719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32f03dc1c413b8f793bc759fdc9a9c55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal\" (UID: \"32f03dc1c413b8f793bc759fdc9a9c55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.629830 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.629760 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32f03dc1c413b8f793bc759fdc9a9c55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal\" (UID: \"32f03dc1c413b8f793bc759fdc9a9c55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.629830 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.629778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43a980200e7c460c93c1cfd19f9e4b64-config\") pod \"kube-apiserver-proxy-ip-10-0-129-244.ec2.internal\" (UID: \"43a980200e7c460c93c1cfd19f9e4b64\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.709241 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.709191 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.730150 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.730114 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32f03dc1c413b8f793bc759fdc9a9c55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal\" (UID: \"32f03dc1c413b8f793bc759fdc9a9c55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.730150 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.730155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32f03dc1c413b8f793bc759fdc9a9c55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal\" (UID: \"32f03dc1c413b8f793bc759fdc9a9c55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.730298 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.730176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43a980200e7c460c93c1cfd19f9e4b64-config\") pod \"kube-apiserver-proxy-ip-10-0-129-244.ec2.internal\" (UID: \"43a980200e7c460c93c1cfd19f9e4b64\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.730298 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.730209 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43a980200e7c460c93c1cfd19f9e4b64-config\") pod \"kube-apiserver-proxy-ip-10-0-129-244.ec2.internal\" (UID: \"43a980200e7c460c93c1cfd19f9e4b64\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.730298 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.730225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32f03dc1c413b8f793bc759fdc9a9c55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal\" (UID: \"32f03dc1c413b8f793bc759fdc9a9c55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.730298 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.730262 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32f03dc1c413b8f793bc759fdc9a9c55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal\" (UID: \"32f03dc1c413b8f793bc759fdc9a9c55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.770333 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.770298 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.774046 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:06.774023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" Jul 28 12:35:06.810379 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.810263 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:06.916184 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:06.916088 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.018331 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.018280 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.124999 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.124962 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.173378 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.173275 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 12:35:07.173861 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.173458 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 12:35:07.225276 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.225245 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.246442 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.246395 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 12:30:06 +0000 UTC" deadline="2028-02-12 17:08:15.0694028 +0000 UTC" Jul 28 12:35:07.246442 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.246435 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13540h33m7.822972083s" Jul 28 12:35:07.264704 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.264681 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:35:07.325911 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.325888 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.408886 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.408857 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:35:07.426663 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.426594 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.438552 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:07.438505 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a980200e7c460c93c1cfd19f9e4b64.slice/crio-232e44023013a77e55220608d61687fabb12d7ef4b3726e5ba50e78c22302abb WatchSource:0}: Error finding container 232e44023013a77e55220608d61687fabb12d7ef4b3726e5ba50e78c22302abb: Status 404 returned error can't find the container with id 232e44023013a77e55220608d61687fabb12d7ef4b3726e5ba50e78c22302abb Jul 28 12:35:07.447085 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.447067 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:35:07.452851 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:07.452826 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f03dc1c413b8f793bc759fdc9a9c55.slice/crio-3cf06b64180d71d524ce3e4eba547440927094dc5b55b28508a2f2ffaebe5696 WatchSource:0}: Error finding container 3cf06b64180d71d524ce3e4eba547440927094dc5b55b28508a2f2ffaebe5696: Status 404 returned error can't find the container with id 3cf06b64180d71d524ce3e4eba547440927094dc5b55b28508a2f2ffaebe5696 Jul 28 12:35:07.528282 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.528243 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.634832 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.634796 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.735038 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:07.734945 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-244.ec2.internal\" not found" Jul 28 12:35:07.762223 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.762187 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:35:07.828949 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.828905 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" Jul 28 12:35:07.847303 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.847277 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 12:35:07.848249 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.848235 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" Jul 28 12:35:07.860517 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:07.860500 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 12:35:08.211929 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.211839 2560 apiserver.go:52] "Watching apiserver" Jul 28 12:35:08.218472 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.218446 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 12:35:08.219646 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.219609 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-x8f5j","openshift-network-operator/iptables-alerter-s72w9","openshift-ovn-kubernetes/ovnkube-node-pjrpn","kube-system/konnectivity-agent-6p6gt","kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gbtcz","openshift-image-registry/node-ca-r96dr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal","openshift-multus/multus-rpgqh","openshift-multus/network-metrics-daemon-jzh5z","openshift-network-diagnostics/network-check-target-ltz6v","kube-system/global-pull-secret-syncer-prj57","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2","openshift-dns/node-resolver-vzxth"] Jul 28 12:35:08.222554 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.222530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.222674 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.222613 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:08.225201 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.224670 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.227139 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.226892 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.227139 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.226914 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pfwfj\"" Jul 28 12:35:08.227139 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.227084 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 12:35:08.227371 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.227342 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.228082 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.227867 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 12:35:08.229943 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.229056 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.230920 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.230898 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7b9w6\"" Jul 28 12:35:08.231021 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.230898 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.231235 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.231219 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 12:35:08.231809 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.231527 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 12:35:08.231809 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.231561 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 12:35:08.231809 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.231526 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.232136 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.232025 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 12:35:08.232645 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.232377 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.234446 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.234428 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gpzk4\"" Jul 28 12:35:08.234806 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.234637 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.234806 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.234708 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.234806 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.234734 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.236598 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.236577 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 12:35:08.237066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.236692 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.237066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.236827 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jk5jd\"" Jul 28 12:35:08.237066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.236910 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.237300 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.237123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.238122 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238239 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-log-socket\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238239 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-cni-netd\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238239 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238239 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-env-overrides\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238465 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a63d41de-ea8f-4134-be3f-05e536246a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238465 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.238465 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a19de1b1-4d5d-42e1-81b8-2eeea422af77-iptables-alerter-script\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.238465 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a19de1b1-4d5d-42e1-81b8-2eeea422af77-host-slash\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.238465 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-systemd-units\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp45x\" (UniqueName: \"kubernetes.io/projected/a19de1b1-4d5d-42e1-81b8-2eeea422af77-kube-api-access-qp45x\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-ovn\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238575 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-node-log\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-ovnkube-config\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-ovnkube-script-lib\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvp9h\" (UniqueName: \"kubernetes.io/projected/a63d41de-ea8f-4134-be3f-05e536246a8b-kube-api-access-gvp9h\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.238725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-slash\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-systemd\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-var-lib-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbdp\" (UniqueName: \"kubernetes.io/projected/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-kube-api-access-stbdp\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-kubelet\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-etc-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-cni-bin\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.239021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-run-netns\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.239078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.238997 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.239543 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.239163 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 12:35:08.239543 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.239191 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xxws\"" Jul 28 12:35:08.239543 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.239328 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.239779 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.239762 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 12:35:08.240019 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.240001 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 12:35:08.240248 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.240222 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.242504 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.242252 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 12:35:08.242504 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.242449 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:08.242659 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.242518 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:08.242849 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.242828 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jtwkl\"" Jul 28 12:35:08.246495 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.245603 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.246871 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.246847 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 12:35:08.248363 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.247560 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.248363 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.247623 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.248363 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.248043 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hm8wr\"" Jul 28 12:35:08.248363 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.248211 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.248627 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.248422 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 12:35:08.250216 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.249902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 12:35:08.250216 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.249999 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:35:08.250216 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.249910 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hsxjm\"" Jul 28 12:35:08.250870 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.250593 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.250870 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.250696 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:08.253411 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.253391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.255363 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.255246 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 12:35:08.255500 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.255482 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-klt45\"" Jul 28 12:35:08.255574 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.255520 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 12:35:08.273524 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.273498 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5wrkm" Jul 28 12:35:08.281497 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.281466 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5wrkm" Jul 28 12:35:08.329277 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.329251 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 12:35:08.339074 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339015 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" event={"ID":"32f03dc1c413b8f793bc759fdc9a9c55","Type":"ContainerStarted","Data":"3cf06b64180d71d524ce3e4eba547440927094dc5b55b28508a2f2ffaebe5696"} Jul 28 12:35:08.339249 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f3ef614b-8c91-4bfa-8968-40b13eded54d-konnectivity-ca\") pod \"konnectivity-agent-6p6gt\" (UID: \"f3ef614b-8c91-4bfa-8968-40b13eded54d\") " pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.339356 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-system-cni-dir\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.339356 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-os-release\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.339356 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjf4d\" (UniqueName: \"kubernetes.io/projected/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-kube-api-access-zjf4d\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.339356 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-registration-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.339356 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-slash\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-var-lib-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbdp\" (UniqueName: \"kubernetes.io/projected/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-kube-api-access-stbdp\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-cni-bin\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-cni-netd\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a63d41de-ea8f-4134-be3f-05e536246a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ace93791-38ec-4326-98b3-10ea850ef171-serviceca\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-system-cni-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-env-overrides\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339600 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-kubelet-config\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.339624 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-cni-binary-copy\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-cni-bin\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-hostroot\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-socket-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339780 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339807 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-daemon-config\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-sys-fs\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339874 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-slash\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp45x\" (UniqueName: \"kubernetes.io/projected/a19de1b1-4d5d-42e1-81b8-2eeea422af77-kube-api-access-qp45x\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvp9h\" (UniqueName: \"kubernetes.io/projected/a63d41de-ea8f-4134-be3f-05e536246a8b-kube-api-access-gvp9h\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-cni-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.339978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-cnibin\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-netns\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-conf-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340036 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 12:35:08.340151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-sys\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-lib-modules\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340136 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340246 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-var-lib-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-run-netns\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6k9\" (UniqueName: \"kubernetes.io/projected/f83edffb-8dbc-40b4-8dfd-fde591190296-kube-api-access-sw6k9\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340308 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-cni-bin\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340436 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-env-overrides\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngn6k\" (UniqueName: \"kubernetes.io/projected/ace93791-38ec-4326-98b3-10ea850ef171-kube-api-access-ngn6k\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-os-release\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.340518 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340523 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-cni-netd\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340557 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-run-netns\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-modprobe-d\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.340703 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:08.840662515 +0000 UTC m=+2.927744048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:08.341048 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-var-lib-kubelet\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-node-log\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-ovnkube-script-lib\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f83edffb-8dbc-40b4-8dfd-fde591190296-tmp-dir\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksll2\" (UniqueName: \"kubernetes.io/projected/68d5c145-a34e-4fa6-84f1-b9ad45205542-kube-api-access-ksll2\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.340988 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" event={"ID":"43a980200e7c460c93c1cfd19f9e4b64","Type":"ContainerStarted","Data":"232e44023013a77e55220608d61687fabb12d7ef4b3726e5ba50e78c22302abb"} Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-kubelet\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vjwm\" (UniqueName: \"kubernetes.io/projected/019fafb4-d748-46e3-878d-60859ef2f759-kube-api-access-7vjwm\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-host\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341106 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0751881b-31a6-4d51-a0c1-97ee66b1774c-tmp\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341105 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-node-log\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-etc-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w95b6\" (UniqueName: \"kubernetes.io/projected/0751881b-31a6-4d51-a0c1-97ee66b1774c-kube-api-access-w95b6\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-multus-certs\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-etc-kubernetes\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.342017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341357 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-systemd\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f3ef614b-8c91-4bfa-8968-40b13eded54d-agent-certs\") pod \"konnectivity-agent-6p6gt\" (UID: \"f3ef614b-8c91-4bfa-8968-40b13eded54d\") " pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-cnibin\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-k8s-cni-cncf-io\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysconfig\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysctl-d\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-ovn\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-ovnkube-script-lib\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-socket-dir-parent\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341673 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-kubernetes\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysctl-conf\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341716 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-etc-openvswitch\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-tuned\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-systemd\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-kubelet\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.342887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-systemd\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341868 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-kubelet\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341764 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-run-ovn\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341904 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.341983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace93791-38ec-4326-98b3-10ea850ef171-host\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-cni-multus\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342072 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-log-socket\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342150 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-log-socket\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f83edffb-8dbc-40b4-8dfd-fde591190296-hosts-file\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a19de1b1-4d5d-42e1-81b8-2eeea422af77-iptables-alerter-script\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a19de1b1-4d5d-42e1-81b8-2eeea422af77-host-slash\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-systemd-units\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-device-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342379 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-run\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.343763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-ovnkube-config\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.344654 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-dbus\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.344654 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342886 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a19de1b1-4d5d-42e1-81b8-2eeea422af77-iptables-alerter-script\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.344654 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342949 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a19de1b1-4d5d-42e1-81b8-2eeea422af77-host-slash\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.344654 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342982 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a63d41de-ea8f-4134-be3f-05e536246a8b-ovnkube-config\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.344654 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.342991 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a63d41de-ea8f-4134-be3f-05e536246a8b-systemd-units\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.344899 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.344703 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a63d41de-ea8f-4134-be3f-05e536246a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.352639 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.352576 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvp9h\" (UniqueName: \"kubernetes.io/projected/a63d41de-ea8f-4134-be3f-05e536246a8b-kube-api-access-gvp9h\") pod \"ovnkube-node-pjrpn\" (UID: \"a63d41de-ea8f-4134-be3f-05e536246a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.353158 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.353131 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp45x\" (UniqueName: \"kubernetes.io/projected/a19de1b1-4d5d-42e1-81b8-2eeea422af77-kube-api-access-qp45x\") pod \"iptables-alerter-s72w9\" (UID: \"a19de1b1-4d5d-42e1-81b8-2eeea422af77\") " pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.354074 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.354051 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbdp\" (UniqueName: \"kubernetes.io/projected/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-kube-api-access-stbdp\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.443517 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksll2\" (UniqueName: \"kubernetes.io/projected/68d5c145-a34e-4fa6-84f1-b9ad45205542-kube-api-access-ksll2\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.443517 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-kubelet\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.443752 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vjwm\" (UniqueName: \"kubernetes.io/projected/019fafb4-d748-46e3-878d-60859ef2f759-kube-api-access-7vjwm\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.443752 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-kubelet\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.443752 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-host\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.443917 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0751881b-31a6-4d51-a0c1-97ee66b1774c-tmp\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.443917 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.443917 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w95b6\" (UniqueName: \"kubernetes.io/projected/0751881b-31a6-4d51-a0c1-97ee66b1774c-kube-api-access-w95b6\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.443917 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443899 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-host\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443922 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.443970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-multus-certs\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-etc-kubernetes\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-systemd\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444044 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-multus-certs\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f3ef614b-8c91-4bfa-8968-40b13eded54d-agent-certs\") pod \"konnectivity-agent-6p6gt\" (UID: \"f3ef614b-8c91-4bfa-8968-40b13eded54d\") " pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-cnibin\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444090 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-etc-kubernetes\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444155 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-cnibin\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-k8s-cni-cncf-io\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444167 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-systemd\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysconfig\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysctl-d\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444229 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-k8s-cni-cncf-io\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444258 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-socket-dir-parent\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444299 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysconfig\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-kubernetes\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysctl-conf\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-tuned\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace93791-38ec-4326-98b3-10ea850ef171-host\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-cni-multus\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f83edffb-8dbc-40b4-8dfd-fde591190296-hosts-file\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444446 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysctl-d\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-device-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-run\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444515 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-cni-multus\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-dbus\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.444910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f3ef614b-8c91-4bfa-8968-40b13eded54d-konnectivity-ca\") pod \"konnectivity-agent-6p6gt\" (UID: \"f3ef614b-8c91-4bfa-8968-40b13eded54d\") " pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-system-cni-dir\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-os-release\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjf4d\" (UniqueName: \"kubernetes.io/projected/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-kube-api-access-zjf4d\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-registration-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444679 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-run\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ace93791-38ec-4326-98b3-10ea850ef171-serviceca\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-system-cni-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-kubelet-config\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-cni-binary-copy\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-cni-bin\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444882 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-system-cni-dir\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444898 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f83edffb-8dbc-40b4-8dfd-fde591190296-hosts-file\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-hostroot\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-socket-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.445817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444987 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-device-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-daemon-config\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-sys-fs\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-cni-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445139 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-socket-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-cnibin\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445176 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ace93791-38ec-4326-98b3-10ea850ef171-serviceca\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445338 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-cni-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445395 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-kubernetes\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445450 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-socket-dir-parent\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445580 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-sysctl-conf\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.444559 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace93791-38ec-4326-98b3-10ea850ef171-host\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445648 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-dbus\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445662 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445726 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-sys-fs\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445753 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-daemon-config\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445766 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-var-lib-cni-bin\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.446754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-cnibin\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-kubelet-config\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445888 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-hostroot\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-netns\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-conf-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.445976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-sys\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-lib-modules\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6k9\" (UniqueName: \"kubernetes.io/projected/f83edffb-8dbc-40b4-8dfd-fde591190296-kube-api-access-sw6k9\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngn6k\" (UniqueName: \"kubernetes.io/projected/ace93791-38ec-4326-98b3-10ea850ef171-kube-api-access-ngn6k\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-os-release\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446166 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f3ef614b-8c91-4bfa-8968-40b13eded54d-konnectivity-ca\") pod \"konnectivity-agent-6p6gt\" (UID: \"f3ef614b-8c91-4bfa-8968-40b13eded54d\") " pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-modprobe-d\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-var-lib-kubelet\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f83edffb-8dbc-40b4-8dfd-fde591190296-tmp-dir\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446235 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-registration-dir\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.447559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446249 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-cni-binary-copy\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446384 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/019fafb4-d748-46e3-878d-60859ef2f759-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446393 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-modprobe-d\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446450 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-var-lib-kubelet\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-lib-modules\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446493 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-host-run-netns\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446529 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-multus-conf-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446548 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f83edffb-8dbc-40b4-8dfd-fde591190296-tmp-dir\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446547 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0751881b-31a6-4d51-a0c1-97ee66b1774c-sys\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446609 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446648 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-os-release\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446705 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68d5c145-a34e-4fa6-84f1-b9ad45205542-os-release\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446715 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-system-cni-dir\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.446744 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.446895 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0751881b-31a6-4d51-a0c1-97ee66b1774c-etc-tuned\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.446950 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:08.94692944 +0000 UTC m=+3.034010962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.447082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f3ef614b-8c91-4bfa-8968-40b13eded54d-agent-certs\") pod \"konnectivity-agent-6p6gt\" (UID: \"f3ef614b-8c91-4bfa-8968-40b13eded54d\") " pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.447290 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68d5c145-a34e-4fa6-84f1-b9ad45205542-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.448452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.448433 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0751881b-31a6-4d51-a0c1-97ee66b1774c-tmp\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.450160 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.450127 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:08.450160 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.450152 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:08.450388 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.450168 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:08.450388 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.450241 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:08.950223013 +0000 UTC m=+3.037304553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:08.454807 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.454778 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w95b6\" (UniqueName: \"kubernetes.io/projected/0751881b-31a6-4d51-a0c1-97ee66b1774c-kube-api-access-w95b6\") pod \"tuned-gbtcz\" (UID: \"0751881b-31a6-4d51-a0c1-97ee66b1774c\") " pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.455739 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.455710 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6k9\" (UniqueName: \"kubernetes.io/projected/f83edffb-8dbc-40b4-8dfd-fde591190296-kube-api-access-sw6k9\") pod \"node-resolver-vzxth\" (UID: \"f83edffb-8dbc-40b4-8dfd-fde591190296\") " pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.455862 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.455777 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksll2\" (UniqueName: \"kubernetes.io/projected/68d5c145-a34e-4fa6-84f1-b9ad45205542-kube-api-access-ksll2\") pod \"multus-additional-cni-plugins-x8f5j\" (UID: \"68d5c145-a34e-4fa6-84f1-b9ad45205542\") " pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.456858 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.456828 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vjwm\" (UniqueName: \"kubernetes.io/projected/019fafb4-d748-46e3-878d-60859ef2f759-kube-api-access-7vjwm\") pod \"aws-ebs-csi-driver-node-m2fl2\" (UID: \"019fafb4-d748-46e3-878d-60859ef2f759\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.457434 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.457416 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjf4d\" (UniqueName: \"kubernetes.io/projected/777b0c3a-9df3-4f8d-8d93-6ee00437ede8-kube-api-access-zjf4d\") pod \"multus-rpgqh\" (UID: \"777b0c3a-9df3-4f8d-8d93-6ee00437ede8\") " pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.458594 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.458570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngn6k\" (UniqueName: \"kubernetes.io/projected/ace93791-38ec-4326-98b3-10ea850ef171-kube-api-access-ngn6k\") pod \"node-ca-r96dr\" (UID: \"ace93791-38ec-4326-98b3-10ea850ef171\") " pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.532190 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.532105 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:35:08.540034 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.540003 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s72w9" Jul 28 12:35:08.549302 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.549275 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:08.560418 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.560383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vzxth" Jul 28 12:35:08.568396 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.568372 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r96dr" Jul 28 12:35:08.575439 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.575414 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" Jul 28 12:35:08.591498 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.591463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rpgqh" Jul 28 12:35:08.600612 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.600578 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" Jul 28 12:35:08.608763 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.608738 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" Jul 28 12:35:08.615863 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.615837 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:08.850745 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.850647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:08.850888 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.850807 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:08.850888 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.850876 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:09.850858841 +0000 UTC m=+3.937940364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:08.951323 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.951286 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:08.951521 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:08.951362 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:08.951521 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.951497 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:08.951610 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.951583 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:09.951562819 +0000 UTC m=+4.038644345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:08.951610 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.951501 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:08.951713 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.951620 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:08.951713 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.951636 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:08.951713 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:08.951703 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:09.951683146 +0000 UTC m=+4.038764680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:09.285580 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:09.285501 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:30:08 +0000 UTC" deadline="2028-04-03 23:36:34.21006544 +0000 UTC" Jul 28 12:35:09.285580 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:09.285533 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14771h1m24.924535518s" Jul 28 12:35:09.334109 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:09.334075 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:09.334316 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.334214 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:09.549983 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:09.549950 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0751881b_31a6_4d51_a0c1_97ee66b1774c.slice/crio-430e187ec200a96fdd096fd8519ae0f721d622d5f4055033fe98fc44b6aa56bf WatchSource:0}: Error finding container 430e187ec200a96fdd096fd8519ae0f721d622d5f4055033fe98fc44b6aa56bf: Status 404 returned error can't find the container with id 430e187ec200a96fdd096fd8519ae0f721d622d5f4055033fe98fc44b6aa56bf Jul 28 12:35:09.551032 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:09.551001 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019fafb4_d748_46e3_878d_60859ef2f759.slice/crio-2db31003a911b9b9662f93c87654af3dd71b9b5af0bb1b9e55af6917deec9962 WatchSource:0}: Error finding container 2db31003a911b9b9662f93c87654af3dd71b9b5af0bb1b9e55af6917deec9962: Status 404 returned error can't find the container with id 2db31003a911b9b9662f93c87654af3dd71b9b5af0bb1b9e55af6917deec9962 Jul 28 12:35:09.558106 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:09.557738 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d5c145_a34e_4fa6_84f1_b9ad45205542.slice/crio-d8fd6a8cd18f9956a3e506ab6b6ca674f1c8013da998f1b62bd725c9dd542fa1 WatchSource:0}: Error finding container d8fd6a8cd18f9956a3e506ab6b6ca674f1c8013da998f1b62bd725c9dd542fa1: Status 404 returned error can't find the container with id d8fd6a8cd18f9956a3e506ab6b6ca674f1c8013da998f1b62bd725c9dd542fa1 Jul 28 12:35:09.560732 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:09.560703 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19de1b1_4d5d_42e1_81b8_2eeea422af77.slice/crio-9007dca1767f492547a93d39c136ed601e79c226e20a3d16d207344b718a5574 WatchSource:0}: Error finding container 9007dca1767f492547a93d39c136ed601e79c226e20a3d16d207344b718a5574: Status 404 returned error can't find the container with id 9007dca1767f492547a93d39c136ed601e79c226e20a3d16d207344b718a5574 Jul 28 12:35:09.560975 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:09.560956 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777b0c3a_9df3_4f8d_8d93_6ee00437ede8.slice/crio-e915276a1c0c87e26d23510100b6dc7d52643065ad474502669dcc2465b99380 WatchSource:0}: Error finding container e915276a1c0c87e26d23510100b6dc7d52643065ad474502669dcc2465b99380: Status 404 returned error can't find the container with id e915276a1c0c87e26d23510100b6dc7d52643065ad474502669dcc2465b99380 Jul 28 12:35:09.858906 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:09.858702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:09.859057 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.858857 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:09.859057 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.859020 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:11.859003737 +0000 UTC m=+5.946085260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:09.960525 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:09.960490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:09.960674 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:09.960561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:09.960674 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.960668 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:09.960774 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.960678 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:09.960774 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.960697 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:09.960774 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.960710 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:09.960774 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.960740 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:11.960719692 +0000 UTC m=+6.047801218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:09.960774 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:09.960757 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:11.960749322 +0000 UTC m=+6.047830845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:10.286805 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.286707 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:30:08 +0000 UTC" deadline="2028-03-31 13:35:56.089768107 +0000 UTC" Jul 28 12:35:10.286805 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.286772 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14689h0m45.803001287s" Jul 28 12:35:10.337389 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.336635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:10.337389 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:10.336774 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:10.337389 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.336855 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:10.337389 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:10.336942 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:10.358476 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.358387 2560 generic.go:356] "Generic (PLEG): container finished" podID="32f03dc1c413b8f793bc759fdc9a9c55" containerID="08760182a2e13179bffbf34d6e61a7360e5b1be20c89e533530b191ea179d22b" exitCode=0 Jul 28 12:35:10.358654 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.358573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" event={"ID":"32f03dc1c413b8f793bc759fdc9a9c55","Type":"ContainerDied","Data":"08760182a2e13179bffbf34d6e61a7360e5b1be20c89e533530b191ea179d22b"} Jul 28 12:35:10.367335 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.367310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" event={"ID":"43a980200e7c460c93c1cfd19f9e4b64","Type":"ContainerStarted","Data":"a05ff331ebfaeac4489e212c9a546a2f86723ea725a39b53b3403d67a2fc7790"} Jul 28 12:35:10.369766 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.369740 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vzxth" event={"ID":"f83edffb-8dbc-40b4-8dfd-fde591190296","Type":"ContainerStarted","Data":"17dedc78220eeb513c34f16c3745e8cb75fdb01ca01b220d3c5219c6d41c5aa8"} Jul 28 12:35:10.393891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.393855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rpgqh" event={"ID":"777b0c3a-9df3-4f8d-8d93-6ee00437ede8","Type":"ContainerStarted","Data":"e915276a1c0c87e26d23510100b6dc7d52643065ad474502669dcc2465b99380"} Jul 28 12:35:10.400445 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.400410 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s72w9" event={"ID":"a19de1b1-4d5d-42e1-81b8-2eeea422af77","Type":"ContainerStarted","Data":"9007dca1767f492547a93d39c136ed601e79c226e20a3d16d207344b718a5574"} Jul 28 12:35:10.418907 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.418870 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6p6gt" event={"ID":"f3ef614b-8c91-4bfa-8968-40b13eded54d","Type":"ContainerStarted","Data":"b590cc97f33e7cd620e90851882edf33cc1ad3cdd065d2ef195c29601b74a838"} Jul 28 12:35:10.424812 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.424778 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r96dr" event={"ID":"ace93791-38ec-4326-98b3-10ea850ef171","Type":"ContainerStarted","Data":"d57a5604f756d1fc3b2873444747434c5fae667f59e151bc36d14c59a4fed4ac"} Jul 28 12:35:10.436348 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.436266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerStarted","Data":"d8fd6a8cd18f9956a3e506ab6b6ca674f1c8013da998f1b62bd725c9dd542fa1"} Jul 28 12:35:10.445018 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.444900 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"367aaee9823a2a8318d320b623abbbe3680f06c5119d5d347cf3e6f2640aefc2"} Jul 28 12:35:10.449871 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.449803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" event={"ID":"019fafb4-d748-46e3-878d-60859ef2f759","Type":"ContainerStarted","Data":"2db31003a911b9b9662f93c87654af3dd71b9b5af0bb1b9e55af6917deec9962"} Jul 28 12:35:10.458918 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:10.458889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" event={"ID":"0751881b-31a6-4d51-a0c1-97ee66b1774c","Type":"ContainerStarted","Data":"430e187ec200a96fdd096fd8519ae0f721d622d5f4055033fe98fc44b6aa56bf"} Jul 28 12:35:11.333937 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:11.333902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:11.334486 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.334063 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:11.505593 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:11.505350 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" event={"ID":"32f03dc1c413b8f793bc759fdc9a9c55","Type":"ContainerStarted","Data":"9ea46d56ca7591f01a8a10fd84adb534567a5d5b16777c9ad9bafda6f71e44f8"} Jul 28 12:35:11.521837 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:11.521574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-244.ec2.internal" podStartSLOduration=3.5215494229999997 podStartE2EDuration="3.521549423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:10.391536946 +0000 UTC m=+4.478618494" watchObservedRunningTime="2026-07-28 12:35:11.521549423 +0000 UTC m=+5.608630971" Jul 28 12:35:11.877942 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:11.877903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:11.878145 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.878069 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:11.878145 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.878143 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:15.878119206 +0000 UTC m=+9.965200735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:11.978590 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:11.978560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:11.978590 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:11.978606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:11.978865 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.978760 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:11.978865 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.978779 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:11.978865 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.978792 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:11.978865 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.978852 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:15.978832589 +0000 UTC m=+10.065914127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:11.979177 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.979159 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:11.979237 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:11.979206 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:15.979195172 +0000 UTC m=+10.066276694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:12.336148 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:12.336061 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:12.336643 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:12.336206 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:12.336643 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:12.336305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:12.336643 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:12.336404 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:13.333498 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:13.333459 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:13.333685 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:13.333618 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:14.334944 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:14.334486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:14.334944 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:14.334635 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:14.334944 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:14.334499 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:14.334944 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:14.334938 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:15.334342 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:15.334311 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:15.334516 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:15.334438 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:15.917290 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:15.917251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:15.917742 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:15.917400 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:15.917742 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:15.917463 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:23.917444022 +0000 UTC m=+18.004525549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:16.017824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:16.017892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.018018 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.018035 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.018050 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.018016 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.018107 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:24.018088275 +0000 UTC m=+18.105169816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:16.018275 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.018136 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:24.018124103 +0000 UTC m=+18.105205629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:16.335053 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:16.334958 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:16.335258 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.335091 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:16.335258 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:16.335140 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:16.335392 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:16.335266 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:17.334300 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:17.334158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:17.334752 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:17.334316 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:18.334005 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:18.333970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:18.334190 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:18.333969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:18.334190 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:18.334120 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:18.334387 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:18.334350 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:19.333945 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:19.333911 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:19.334115 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:19.334026 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:20.334339 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:20.334305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:20.334730 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:20.334314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:20.334730 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:20.334423 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:20.334730 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:20.334473 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:21.334269 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:21.334223 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:21.334464 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:21.334405 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:22.334550 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:22.334515 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:22.335047 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:22.334656 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:22.335047 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:22.334713 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:22.335047 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:22.334827 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:23.333793 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:23.333757 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:23.334048 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:23.333890 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:23.979890 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:23.979850 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:23.980439 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:23.979980 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:23.980439 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:23.980047 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.980028173 +0000 UTC m=+34.067109699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:24.081000 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:24.080961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:24.081192 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:24.081048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:24.081192 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.081143 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:24.081326 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.081198 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:40.081183799 +0000 UTC m=+34.168265320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:24.081326 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.081146 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:24.081326 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.081291 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:24.081326 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.081320 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:24.081514 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.081379 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:40.081362583 +0000 UTC m=+34.168444123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:24.334130 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:24.333989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:24.334130 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:24.334023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:24.334370 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.334146 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:24.334370 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:24.334291 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:25.333831 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:25.333794 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:25.334301 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:25.333922 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:26.335295 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:26.335259 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:26.335871 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:26.335315 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:26.335995 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:26.335891 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:26.335995 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:26.335972 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:27.333979 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:27.333945 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:27.334184 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:27.334081 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:28.336794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.336219 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:28.336794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.336252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:28.336794 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:28.336367 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:28.336794 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:28.336470 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:28.539861 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.539393 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" event={"ID":"0751881b-31a6-4d51-a0c1-97ee66b1774c","Type":"ContainerStarted","Data":"bcce23cead313a81658b15fa2731860cafaeff84fa48d4b5935d803df0bc4082"} Jul 28 12:35:28.540853 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.540826 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vzxth" event={"ID":"f83edffb-8dbc-40b4-8dfd-fde591190296","Type":"ContainerStarted","Data":"b21b0c9614495a322c21549694fdf964fdfb70f10e1aaea31d476d16af07b7a0"} Jul 28 12:35:28.542159 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.542138 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rpgqh" event={"ID":"777b0c3a-9df3-4f8d-8d93-6ee00437ede8","Type":"ContainerStarted","Data":"849d199d11c6a482104b4e53425fa10ec725d8a6c434e83a1091c05fd8aaf175"} Jul 28 12:35:28.544109 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.544004 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6p6gt" event={"ID":"f3ef614b-8c91-4bfa-8968-40b13eded54d","Type":"ContainerStarted","Data":"f4b2d769717e83659f6f7bd372c5d725e8f1be09da2d22ae5358c5661904854d"} Jul 28 12:35:28.545258 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.545235 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r96dr" event={"ID":"ace93791-38ec-4326-98b3-10ea850ef171","Type":"ContainerStarted","Data":"33072d1a8da4904873aeaf09282c61e1a1774d80150fd19b1529aae8f3af6ba3"} Jul 28 12:35:28.546813 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.546741 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d5c145-a34e-4fa6-84f1-b9ad45205542" containerID="310cd2fd0c5255bf29b57dd6a23b1f609f51f82fe9e9c34fb4820a9f94ba2548" exitCode=0 Jul 28 12:35:28.546813 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.546802 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerDied","Data":"310cd2fd0c5255bf29b57dd6a23b1f609f51f82fe9e9c34fb4820a9f94ba2548"} Jul 28 12:35:28.549066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.548975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"7bbe84a5471aff3b726104fe840c94c657da16c493a1497a3f2edee93175a200"} Jul 28 12:35:28.549066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.549026 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"a3ba4e6976852fe584d95a8d17b5397a6d9f91c6e03c11b648cb0c959dbfd9dd"} Jul 28 12:35:28.550373 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.550346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" event={"ID":"019fafb4-d748-46e3-878d-60859ef2f759","Type":"ContainerStarted","Data":"154077261e0e78c4126e1051ff0822f62db68c3007bd91b3b4be61a5740cfb3a"} Jul 28 12:35:28.558771 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.558727 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-244.ec2.internal" podStartSLOduration=20.558710231 podStartE2EDuration="20.558710231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:11.522304171 +0000 UTC m=+5.609385712" watchObservedRunningTime="2026-07-28 12:35:28.558710231 +0000 UTC m=+22.645791786" Jul 28 12:35:28.559314 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.559289 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gbtcz" podStartSLOduration=2.8545855700000002 podStartE2EDuration="21.55928227s" totalImagesPullingTime="18.7046967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:28.55867147 +0000 UTC m=+22.645753015" watchObservedRunningTime="2026-07-28 12:35:28.55928227 +0000 UTC m=+22.646363815" Jul 28 12:35:28.590660 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.590606 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vzxth" podStartSLOduration=3.894586799 podStartE2EDuration="22.590585156s" totalImagesPullingTime="18.695998357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:28.574636846 +0000 UTC m=+22.661718390" watchObservedRunningTime="2026-07-28 12:35:28.590585156 +0000 UTC m=+22.677666700" Jul 28 12:35:28.591081 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.591043 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6p6gt" podStartSLOduration=2.898928412 podStartE2EDuration="21.591030733s" totalImagesPullingTime="18.692102321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:28.590364371 +0000 UTC m=+22.677445949" watchObservedRunningTime="2026-07-28 12:35:28.591030733 +0000 UTC m=+22.678112281" Jul 28 12:35:28.605869 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.605825 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r96dr" podStartSLOduration=11.611793375 podStartE2EDuration="22.605806358s" totalImagesPullingTime="10.994012983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:28.605222315 +0000 UTC m=+22.692303851" watchObservedRunningTime="2026-07-28 12:35:28.605806358 +0000 UTC m=+22.692887900" Jul 28 12:35:28.648639 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.648468 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rpgqh" podStartSLOduration=3.871156744 podStartE2EDuration="22.648451772s" totalImagesPullingTime="18.777295028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:28.647337671 +0000 UTC m=+22.734419214" watchObservedRunningTime="2026-07-28 12:35:28.648451772 +0000 UTC m=+22.735533317" Jul 28 12:35:28.814550 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.814510 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:28.902857 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:28.902829 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:29.275443 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.275403 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:29.276274 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.276252 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:29.333405 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.333370 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:29.333577 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:29.333494 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:29.556860 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.556766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"9d15858fb9a19eb95600fdc0f39fc99eff27170a1850fa12011ff92e78b8baf7"} Jul 28 12:35:29.557826 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.556863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"db782bdf2236271801187ef41f129aedb6f96acca5f3d53c34c4478a3b453db2"} Jul 28 12:35:29.557826 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.556978 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"fcfc0ad27c33a5627401567e688d92449c06e7109342e8d002fa4ffff4786781"} Jul 28 12:35:29.557826 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.557028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"d91e7f3cf7c1eb85fd2d34d1be2a3f89d8021a4bb4a616fdad7d2b434e00a9f7"} Jul 28 12:35:29.557826 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.557537 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:29.558043 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.558014 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6p6gt" Jul 28 12:35:29.645071 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.645036 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:29.884224 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:29.884171 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 12:35:30.304266 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.304135 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T12:35:29.884190167Z","UUID":"81f14653-964e-437f-b85c-2d728b23c5a5","Handler":null,"Name":"","Endpoint":""} Jul 28 12:35:30.305896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.305865 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 12:35:30.306026 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.305909 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 12:35:30.333935 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.333878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:30.334106 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.333912 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:30.334106 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:30.334047 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:30.334247 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:30.334125 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:30.562263 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.562171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" event={"ID":"019fafb4-d748-46e3-878d-60859ef2f759","Type":"ContainerStarted","Data":"cb49eb3c8edfaead82b30f8fad3660ae48029c22555b98e594a7fd74a4abfccd"} Jul 28 12:35:30.564284 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.564256 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s72w9" event={"ID":"a19de1b1-4d5d-42e1-81b8-2eeea422af77","Type":"ContainerStarted","Data":"38bce3526370b7dad360e3ae092f55392ada06b5a45a1b74ed979763ff14057a"} Jul 28 12:35:30.579573 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.579384 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s72w9" podStartSLOduration=5.88677483 podStartE2EDuration="24.579365922s" totalImagesPullingTime="18.692591092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:30.579281757 +0000 UTC m=+24.666363300" watchObservedRunningTime="2026-07-28 12:35:30.579365922 +0000 UTC m=+24.666447470" Jul 28 12:35:30.733771 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.733742 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:30.833190 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:30.833104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:31.283489 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:31.283453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:31.334311 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:31.334279 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:31.334502 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:31.334413 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:31.387487 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:31.387451 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:31.570779 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:31.570743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"c4390037ba1938ba254ee1b3a911698460d327fb6273d73cb1e66042d4e2407b"} Jul 28 12:35:32.333710 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:32.333672 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:32.333919 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:32.333671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:32.333919 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:32.333812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:32.333919 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:32.333901 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:32.888425 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:32.888205 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:32.992986 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:32.992961 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:33.225676 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.225555 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:33.324261 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.324123 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:33.334098 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.334071 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:33.334258 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:33.334173 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:33.577114 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.577035 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d5c145-a34e-4fa6-84f1-b9ad45205542" containerID="e89a0bf5cbbe263fa21a84afe63eb810f8ac86a217c8e7b1e6943ec2d79d55fc" exitCode=0 Jul 28 12:35:33.577270 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.577134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerDied","Data":"e89a0bf5cbbe263fa21a84afe63eb810f8ac86a217c8e7b1e6943ec2d79d55fc"} Jul 28 12:35:33.581064 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.581030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" event={"ID":"a63d41de-ea8f-4134-be3f-05e536246a8b","Type":"ContainerStarted","Data":"098b84a409b72518e41d358ae9541a935014ccd537528643bfeb61935931b969"} Jul 28 12:35:33.581277 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.581253 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:33.583267 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.583244 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" event={"ID":"019fafb4-d748-46e3-878d-60859ef2f759","Type":"ContainerStarted","Data":"150abd37e5c4650ac5f0a04781b0a14a5e75afe441365e99e5f91e8d5e21797d"} Jul 28 12:35:33.597444 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.597294 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:33.671752 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.671697 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2fl2" podStartSLOduration=3.83645935 podStartE2EDuration="26.671681711s" totalImagesPullingTime="22.835222361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:33.671295445 +0000 UTC m=+27.758376989" watchObservedRunningTime="2026-07-28 12:35:33.671681711 +0000 UTC m=+27.758763254" Jul 28 12:35:33.671931 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:33.671912 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" podStartSLOduration=8.922007873 podStartE2EDuration="27.671906529s" totalImagesPullingTime="18.749898656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:33.646404384 +0000 UTC m=+27.733485940" watchObservedRunningTime="2026-07-28 12:35:33.671906529 +0000 UTC m=+27.758988078" Jul 28 12:35:34.177327 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.177291 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:34.277035 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.277004 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:34.334139 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.334105 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:34.334371 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:34.334269 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:34.334371 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.334329 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:34.334465 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:34.334436 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:34.585843 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.585813 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:34.586053 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.585893 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:34.600650 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:34.600627 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:35:35.334349 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.334319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:35.334733 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:35.334421 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:35.357582 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.357547 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-prj57"] Jul 28 12:35:35.360711 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.360684 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jzh5z"] Jul 28 12:35:35.360866 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.360808 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:35.360956 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:35.360934 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:35.361306 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.361272 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ltz6v"] Jul 28 12:35:35.361407 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.361359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:35.361460 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:35.361436 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:35.589839 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.589804 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d5c145-a34e-4fa6-84f1-b9ad45205542" containerID="77e2e3ad56e72e714216d5e4baf2e48f037ca146fc143a353e97807624ec698c" exitCode=0 Jul 28 12:35:35.590024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.589879 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:35.590024 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:35.589894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerDied","Data":"77e2e3ad56e72e714216d5e4baf2e48f037ca146fc143a353e97807624ec698c"} Jul 28 12:35:35.590136 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:35.590086 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:37.334109 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:37.334072 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:37.334109 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:37.334098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:37.334496 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:37.334112 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:37.334496 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:37.334183 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:37.334496 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:37.334262 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:37.334496 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:37.334368 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:38.599501 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:38.599326 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d5c145-a34e-4fa6-84f1-b9ad45205542" containerID="e3b617d8c9a165a8ebed363d0f4cadc7f45380c1ec93e733dd5eab5739be6309" exitCode=0 Jul 28 12:35:38.599501 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:38.599407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerDied","Data":"e3b617d8c9a165a8ebed363d0f4cadc7f45380c1ec93e733dd5eab5739be6309"} Jul 28 12:35:39.333875 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:39.333848 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:39.334031 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:39.333847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:39.334031 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:39.333959 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzh5z" podUID="1d41a0a1-9fcf-4c97-9390-6d7b3189ea49" Jul 28 12:35:39.334031 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:39.333850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:39.334195 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:39.334015 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-prj57" podUID="dcfa1c56-ff1b-43e4-9d62-8e8e51b31507" Jul 28 12:35:39.334195 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:39.334097 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ltz6v" podUID="8efe9764-90be-4fc8-a84f-e4d583acf315" Jul 28 12:35:39.996846 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:39.996809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:39.997372 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:39.996946 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:39.997372 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:39.997015 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs podName:1d41a0a1-9fcf-4c97-9390-6d7b3189ea49 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:11.996994095 +0000 UTC m=+66.084075621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs") pod "network-metrics-daemon-jzh5z" (UID: "1d41a0a1-9fcf-4c97-9390-6d7b3189ea49") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:40.097609 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:40.097572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:40.097776 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:40.097639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:40.097776 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:40.097733 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:40.097960 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:40.097797 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:40.097960 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:40.097817 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:40.097960 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:40.097829 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2dc5t for pod openshift-network-diagnostics/network-check-target-ltz6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:40.097960 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:40.097803 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret podName:dcfa1c56-ff1b-43e4-9d62-8e8e51b31507 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:12.09778345 +0000 UTC m=+66.184864976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret") pod "global-pull-secret-syncer-prj57" (UID: "dcfa1c56-ff1b-43e4-9d62-8e8e51b31507") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:40.097960 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:40.097882 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t podName:8efe9764-90be-4fc8-a84f-e4d583acf315 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:12.097867879 +0000 UTC m=+66.184949404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dc5t" (UniqueName: "kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t") pod "network-check-target-ltz6v" (UID: "8efe9764-90be-4fc8-a84f-e4d583acf315") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:41.104603 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.104522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.215961 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.215926 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-244.ec2.internal" event="NodeReady" Jul 28 12:35:41.216127 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.216071 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 12:35:41.277883 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.277847 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s9qfk"] Jul 28 12:35:41.281896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.281870 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-shcxk"] Jul 28 12:35:41.282057 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.282020 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.284291 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.284267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 12:35:41.284398 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.284293 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 12:35:41.284398 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.284300 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k2njb\"" Jul 28 12:35:41.284617 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.284600 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 12:35:41.285844 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.285822 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.288055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.288034 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 12:35:41.288188 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.288104 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 12:35:41.288278 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.288257 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6l7wd\"" Jul 28 12:35:41.293117 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.293056 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9qfk"] Jul 28 12:35:41.297433 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.297412 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-shcxk"] Jul 28 12:35:41.334122 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.334091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:35:41.334306 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.334194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:35:41.334306 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.334265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:35:41.336512 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.336490 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 12:35:41.336949 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.336762 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 12:35:41.336949 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.336768 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 12:35:41.336949 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.336849 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kxg2r\"" Jul 28 12:35:41.337254 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.337095 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z4tgw\"" Jul 28 12:35:41.337254 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.337193 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 12:35:41.406545 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.406519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjhkh\" (UniqueName: \"kubernetes.io/projected/111d9174-0d98-44a5-9c45-f680f4ac3905-kube-api-access-gjhkh\") pod \"ingress-canary-s9qfk\" (UID: \"111d9174-0d98-44a5-9c45-f680f4ac3905\") " pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.406712 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.406555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.406712 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.406574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8352141-ea47-45dd-a409-3719c896c28f-tmp-dir\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.406712 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.406595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8352141-ea47-45dd-a409-3719c896c28f-config-volume\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.406712 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.406621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/111d9174-0d98-44a5-9c45-f680f4ac3905-cert\") pod \"ingress-canary-s9qfk\" (UID: \"111d9174-0d98-44a5-9c45-f680f4ac3905\") " pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.406712 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.406695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ngj9\" (UniqueName: \"kubernetes.io/projected/e8352141-ea47-45dd-a409-3719c896c28f-kube-api-access-8ngj9\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.435753 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.435705 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.507727 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.507692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ngj9\" (UniqueName: \"kubernetes.io/projected/e8352141-ea47-45dd-a409-3719c896c28f-kube-api-access-8ngj9\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.507974 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.507951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjhkh\" (UniqueName: \"kubernetes.io/projected/111d9174-0d98-44a5-9c45-f680f4ac3905-kube-api-access-gjhkh\") pod \"ingress-canary-s9qfk\" (UID: \"111d9174-0d98-44a5-9c45-f680f4ac3905\") " pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.508082 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.508022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.508082 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.508051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8352141-ea47-45dd-a409-3719c896c28f-tmp-dir\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.508188 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.508083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8352141-ea47-45dd-a409-3719c896c28f-config-volume\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.508188 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.508106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/111d9174-0d98-44a5-9c45-f680f4ac3905-cert\") pod \"ingress-canary-s9qfk\" (UID: \"111d9174-0d98-44a5-9c45-f680f4ac3905\") " pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.508188 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:41.508137 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:41.508381 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:41.508197 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls podName:e8352141-ea47-45dd-a409-3719c896c28f nodeName:}" failed. No retries permitted until 2026-07-28 12:35:42.008177856 +0000 UTC m=+36.095259405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls") pod "dns-default-shcxk" (UID: "e8352141-ea47-45dd-a409-3719c896c28f") : secret "dns-default-metrics-tls" not found Jul 28 12:35:41.508502 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.508478 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8352141-ea47-45dd-a409-3719c896c28f-tmp-dir\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.508784 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.508760 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8352141-ea47-45dd-a409-3719c896c28f-config-volume\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.513352 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.513332 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/111d9174-0d98-44a5-9c45-f680f4ac3905-cert\") pod \"ingress-canary-s9qfk\" (UID: \"111d9174-0d98-44a5-9c45-f680f4ac3905\") " pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.520488 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.520459 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.521953 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.521925 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ngj9\" (UniqueName: \"kubernetes.io/projected/e8352141-ea47-45dd-a409-3719c896c28f-kube-api-access-8ngj9\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:41.522992 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.522975 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjhkh\" (UniqueName: \"kubernetes.io/projected/111d9174-0d98-44a5-9c45-f680f4ac3905-kube-api-access-gjhkh\") pod \"ingress-canary-s9qfk\" (UID: \"111d9174-0d98-44a5-9c45-f680f4ac3905\") " pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.595961 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.595928 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9qfk" Jul 28 12:35:41.755709 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.755438 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9qfk"] Jul 28 12:35:41.912421 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.912311 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.976734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:41.976700 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:42.012816 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:42.012782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:42.012999 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:42.012957 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:42.013068 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:42.013032 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls podName:e8352141-ea47-45dd-a409-3719c896c28f nodeName:}" failed. No retries permitted until 2026-07-28 12:35:43.013009568 +0000 UTC m=+37.100091102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls") pod "dns-default-shcxk" (UID: "e8352141-ea47-45dd-a409-3719c896c28f") : secret "dns-default-metrics-tls" not found Jul 28 12:35:43.020695 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:43.020655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:43.021279 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:43.020788 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:43.021279 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:43.020858 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls podName:e8352141-ea47-45dd-a409-3719c896c28f nodeName:}" failed. No retries permitted until 2026-07-28 12:35:45.020837591 +0000 UTC m=+39.107919112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls") pod "dns-default-shcxk" (UID: "e8352141-ea47-45dd-a409-3719c896c28f") : secret "dns-default-metrics-tls" not found Jul 28 12:35:43.219366 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:43.219328 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111d9174_0d98_44a5_9c45_f680f4ac3905.slice/crio-81a2d266e103031607809341cf2608a8c44d1a225040e7244f5c30a80bfed11d WatchSource:0}: Error finding container 81a2d266e103031607809341cf2608a8c44d1a225040e7244f5c30a80bfed11d: Status 404 returned error can't find the container with id 81a2d266e103031607809341cf2608a8c44d1a225040e7244f5c30a80bfed11d Jul 28 12:35:43.615387 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:43.615301 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d5c145-a34e-4fa6-84f1-b9ad45205542" containerID="b8946729bbffaf0faadb251801be441661ca98844b767a43a756c02ebb947bcf" exitCode=0 Jul 28 12:35:43.615526 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:43.615378 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerDied","Data":"b8946729bbffaf0faadb251801be441661ca98844b767a43a756c02ebb947bcf"} Jul 28 12:35:43.616511 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:43.616489 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9qfk" event={"ID":"111d9174-0d98-44a5-9c45-f680f4ac3905","Type":"ContainerStarted","Data":"81a2d266e103031607809341cf2608a8c44d1a225040e7244f5c30a80bfed11d"} Jul 28 12:35:44.622270 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:44.622233 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d5c145-a34e-4fa6-84f1-b9ad45205542" containerID="582cdc45c5ed65dd64489436a08e00b849e59de3bda524b00ddc63a5fa2996fe" exitCode=0 Jul 28 12:35:44.622734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:44.622297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerDied","Data":"582cdc45c5ed65dd64489436a08e00b849e59de3bda524b00ddc63a5fa2996fe"} Jul 28 12:35:45.039878 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.039661 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:45.040060 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:45.039836 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:45.040060 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:45.040027 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls podName:e8352141-ea47-45dd-a409-3719c896c28f nodeName:}" failed. No retries permitted until 2026-07-28 12:35:49.040006134 +0000 UTC m=+43.127087659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls") pod "dns-default-shcxk" (UID: "e8352141-ea47-45dd-a409-3719c896c28f") : secret "dns-default-metrics-tls" not found Jul 28 12:35:45.261604 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.261574 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.628963 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.628875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" event={"ID":"68d5c145-a34e-4fa6-84f1-b9ad45205542","Type":"ContainerStarted","Data":"b9b4fbdf361f465ee8d21611e227f6f814229ebc886428ae34a6ee129b5cfc94"} Jul 28 12:35:45.653824 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.653621 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x8f5j" podStartSLOduration=8.423842315 podStartE2EDuration="39.653600425s" totalImagesPullingTime="31.22975811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:45.652260689 +0000 UTC m=+39.739342229" watchObservedRunningTime="2026-07-28 12:35:45.653600425 +0000 UTC m=+39.740681968" Jul 28 12:35:45.697857 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.697820 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.775064 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.775032 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.875170 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:45.875133 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:46.633182 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:46.633088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9qfk" event={"ID":"111d9174-0d98-44a5-9c45-f680f4ac3905","Type":"ContainerStarted","Data":"7a894b7fc714b6cac0b32d47179d68f4d12d778967687e6e75fdf9b12427212c"} Jul 28 12:35:46.651452 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:46.651405 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s9qfk" podStartSLOduration=2.514641413 podStartE2EDuration="5.651389213s" totalImagesPullingTime="3.1367478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:46.650373772 +0000 UTC m=+40.737455324" watchObservedRunningTime="2026-07-28 12:35:46.651389213 +0000 UTC m=+40.738470733" Jul 28 12:35:47.248060 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.248026 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f886z"] Jul 28 12:35:47.276326 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.276294 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f886z"] Jul 28 12:35:47.276468 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.276387 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:47.280625 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.280601 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 12:35:47.280625 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.280614 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 12:35:47.280778 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.280654 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k5lqm\"" Jul 28 12:35:47.331016 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.330984 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff"] Jul 28 12:35:47.356124 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.356084 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff"] Jul 28 12:35:47.356287 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.356196 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" Jul 28 12:35:47.360375 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.360346 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pg2rb\"" Jul 28 12:35:47.444541 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.444505 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-t5qbr"] Jul 28 12:35:47.460880 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.460845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:47.460880 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.460879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g652x\" (UniqueName: \"kubernetes.io/projected/c77f525f-fa1a-42f4-96df-1a79c81b5c5f-kube-api-access-g652x\") pod \"network-check-source-7d88cb55d8-kjsff\" (UID: \"c77f525f-fa1a-42f4-96df-1a79c81b5c5f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" Jul 28 12:35:47.461047 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.460932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/adc29358-31a2-4f0f-b099-6ef5e959f176-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:47.464004 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.463983 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm"] Jul 28 12:35:47.464107 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.464092 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.470081 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.469784 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 12:35:47.470081 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.469828 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 12:35:47.470081 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.469795 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 12:35:47.470909 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.470833 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8f7cg\"" Jul 28 12:35:47.471058 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.471037 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 12:35:47.478887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.478865 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 12:35:47.482101 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.482082 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm"] Jul 28 12:35:47.482197 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.482113 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-t5qbr"] Jul 28 12:35:47.482197 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.482190 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:47.484485 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.484464 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-59n6d\"" Jul 28 12:35:47.484485 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.484474 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 12:35:47.484617 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.484501 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 12:35:47.484617 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.484529 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:35:47.535135 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.535058 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bb57f66b5-fbcs2"] Jul 28 12:35:47.560187 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.560162 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb57f66b5-fbcs2"] Jul 28 12:35:47.560327 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.560277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.561369 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561346 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbc7905-79fa-42fb-a11c-6d569c83d68a-tmp\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.561460 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbc7905-79fa-42fb-a11c-6d569c83d68a-service-ca-bundle\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.561460 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561444 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fbc7905-79fa-42fb-a11c-6d569c83d68a-serving-cert\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.561549 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpstq\" (UniqueName: \"kubernetes.io/projected/6fbc7905-79fa-42fb-a11c-6d569c83d68a-kube-api-access-zpstq\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.561549 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:47.561549 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g652x\" (UniqueName: \"kubernetes.io/projected/c77f525f-fa1a-42f4-96df-1a79c81b5c5f-kube-api-access-g652x\") pod \"network-check-source-7d88cb55d8-kjsff\" (UID: \"c77f525f-fa1a-42f4-96df-1a79c81b5c5f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" Jul 28 12:35:47.561657 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561579 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6fbc7905-79fa-42fb-a11c-6d569c83d68a-snapshots\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.561657 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/adc29358-31a2-4f0f-b099-6ef5e959f176-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:47.561657 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.561604 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 12:35:47.561657 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.561619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbc7905-79fa-42fb-a11c-6d569c83d68a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.561657 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.561657 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert podName:adc29358-31a2-4f0f-b099-6ef5e959f176 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:48.061634677 +0000 UTC m=+42.148716199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f886z" (UID: "adc29358-31a2-4f0f-b099-6ef5e959f176") : secret "networking-console-plugin-cert" not found Jul 28 12:35:47.562297 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.562277 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 12:35:47.562395 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.562294 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/adc29358-31a2-4f0f-b099-6ef5e959f176-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:47.562395 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.562344 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 12:35:47.562727 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.562712 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w2rc8\"" Jul 28 12:35:47.562839 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.562823 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 12:35:47.570323 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.570304 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 12:35:47.581117 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.581093 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g652x\" (UniqueName: \"kubernetes.io/projected/c77f525f-fa1a-42f4-96df-1a79c81b5c5f-kube-api-access-g652x\") pod \"network-check-source-7d88cb55d8-kjsff\" (UID: \"c77f525f-fa1a-42f4-96df-1a79c81b5c5f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" Jul 28 12:35:47.662304 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-ca-trust-extracted\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-installation-pull-secrets\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbc7905-79fa-42fb-a11c-6d569c83d68a-service-ca-bundle\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fbc7905-79fa-42fb-a11c-6d569c83d68a-serving-cert\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpstq\" (UniqueName: \"kubernetes.io/projected/6fbc7905-79fa-42fb-a11c-6d569c83d68a-kube-api-access-zpstq\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqjpc\" (UniqueName: \"kubernetes.io/projected/2ab91886-f8da-4e94-be39-c59b4a55ae55-kube-api-access-sqjpc\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwdpm\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-kube-api-access-gwdpm\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-bound-sa-token\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-certificates\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6fbc7905-79fa-42fb-a11c-6d569c83d68a-snapshots\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.662682 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.663077 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbc7905-79fa-42fb-a11c-6d569c83d68a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.663077 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-image-registry-private-configuration\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.663077 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-trusted-ca\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.663077 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbc7905-79fa-42fb-a11c-6d569c83d68a-tmp\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.663077 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.662852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:47.663077 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.663022 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbc7905-79fa-42fb-a11c-6d569c83d68a-service-ca-bundle\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.663310 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.663291 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6fbc7905-79fa-42fb-a11c-6d569c83d68a-snapshots\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.663351 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.663317 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbc7905-79fa-42fb-a11c-6d569c83d68a-tmp\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.663599 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.663580 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbc7905-79fa-42fb-a11c-6d569c83d68a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.664606 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.664590 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" Jul 28 12:35:47.664776 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.664759 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fbc7905-79fa-42fb-a11c-6d569c83d68a-serving-cert\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.681846 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.681807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:47.688243 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.688222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpstq\" (UniqueName: \"kubernetes.io/projected/6fbc7905-79fa-42fb-a11c-6d569c83d68a-kube-api-access-zpstq\") pod \"insights-operator-5885fdb759-t5qbr\" (UID: \"6fbc7905-79fa-42fb-a11c-6d569c83d68a\") " pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.763507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-image-registry-private-configuration\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763511 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-trusted-ca\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-ca-trust-extracted\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-installation-pull-secrets\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763607 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqjpc\" (UniqueName: \"kubernetes.io/projected/2ab91886-f8da-4e94-be39-c59b4a55ae55-kube-api-access-sqjpc\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwdpm\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-kube-api-access-gwdpm\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-bound-sa-token\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-certificates\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.763734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.763712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.764122 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.764099 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:47.764171 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.764160 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls podName:2ab91886-f8da-4e94-be39-c59b4a55ae55 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:48.264142853 +0000 UTC m=+42.351224374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls") pod "cluster-samples-operator-6748489656-nsdvm" (UID: "2ab91886-f8da-4e94-be39-c59b4a55ae55") : secret "samples-operator-tls" not found Jul 28 12:35:47.764832 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.764440 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:47.764832 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.764462 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb57f66b5-fbcs2: secret "image-registry-tls" not found Jul 28 12:35:47.764832 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:47.764515 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls podName:e41d595a-e0ec-4a79-8636-5ebb312ac9ed nodeName:}" failed. No retries permitted until 2026-07-28 12:35:48.264497363 +0000 UTC m=+42.351578901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls") pod "image-registry-5bb57f66b5-fbcs2" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed") : secret "image-registry-tls" not found Jul 28 12:35:47.764832 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.764827 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-ca-trust-extracted\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.765170 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.765143 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-certificates\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.765304 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.765283 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-trusted-ca\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.766553 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.766529 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-installation-pull-secrets\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.766767 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.766746 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-image-registry-private-configuration\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.770712 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.770361 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:47.777891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.777866 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-bound-sa-token\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.778369 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.778352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" Jul 28 12:35:47.779109 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.779087 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwdpm\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-kube-api-access-gwdpm\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:47.779232 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.779184 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqjpc\" (UniqueName: \"kubernetes.io/projected/2ab91886-f8da-4e94-be39-c59b4a55ae55-kube-api-access-sqjpc\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:47.832053 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.832027 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff"] Jul 28 12:35:47.835414 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:47.835383 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77f525f_fa1a_42f4_96df_1a79c81b5c5f.slice/crio-1a2347f6914d0cab7d1ca880077e6b6c1f2ade354272e28916555c827dcaaf1e WatchSource:0}: Error finding container 1a2347f6914d0cab7d1ca880077e6b6c1f2ade354272e28916555c827dcaaf1e: Status 404 returned error can't find the container with id 1a2347f6914d0cab7d1ca880077e6b6c1f2ade354272e28916555c827dcaaf1e Jul 28 12:35:47.940497 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:47.940460 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-t5qbr"] Jul 28 12:35:47.943781 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:35:47.943749 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbc7905_79fa_42fb_a11c_6d569c83d68a.slice/crio-819afda470b88c7367c808a993c8c964a8a2e2e0da47f9d64823681451a13453 WatchSource:0}: Error finding container 819afda470b88c7367c808a993c8c964a8a2e2e0da47f9d64823681451a13453: Status 404 returned error can't find the container with id 819afda470b88c7367c808a993c8c964a8a2e2e0da47f9d64823681451a13453 Jul 28 12:35:48.065598 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:48.065507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:48.065745 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.065655 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 12:35:48.065745 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.065730 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert podName:adc29358-31a2-4f0f-b099-6ef5e959f176 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:49.065704245 +0000 UTC m=+43.152785766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f886z" (UID: "adc29358-31a2-4f0f-b099-6ef5e959f176") : secret "networking-console-plugin-cert" not found Jul 28 12:35:48.266900 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:48.266857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:48.267066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:48.266915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:48.267066 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.267014 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:48.267159 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.267069 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls podName:2ab91886-f8da-4e94-be39-c59b4a55ae55 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:49.267056224 +0000 UTC m=+43.354137744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls") pod "cluster-samples-operator-6748489656-nsdvm" (UID: "2ab91886-f8da-4e94-be39-c59b4a55ae55") : secret "samples-operator-tls" not found Jul 28 12:35:48.267159 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.267018 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:48.267159 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.267110 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb57f66b5-fbcs2: secret "image-registry-tls" not found Jul 28 12:35:48.267159 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:48.267153 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls podName:e41d595a-e0ec-4a79-8636-5ebb312ac9ed nodeName:}" failed. No retries permitted until 2026-07-28 12:35:49.267139946 +0000 UTC m=+43.354221480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls") pod "image-registry-5bb57f66b5-fbcs2" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed") : secret "image-registry-tls" not found Jul 28 12:35:48.639814 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:48.639776 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" event={"ID":"6fbc7905-79fa-42fb-a11c-6d569c83d68a","Type":"ContainerStarted","Data":"819afda470b88c7367c808a993c8c964a8a2e2e0da47f9d64823681451a13453"} Jul 28 12:35:48.640942 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:48.640912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" event={"ID":"c77f525f-fa1a-42f4-96df-1a79c81b5c5f","Type":"ContainerStarted","Data":"1a2347f6914d0cab7d1ca880077e6b6c1f2ade354272e28916555c827dcaaf1e"} Jul 28 12:35:49.074508 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:49.074465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:49.074964 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:49.074526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:49.074964 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.074631 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 12:35:49.074964 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.074694 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert podName:adc29358-31a2-4f0f-b099-6ef5e959f176 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:51.074679599 +0000 UTC m=+45.161761125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f886z" (UID: "adc29358-31a2-4f0f-b099-6ef5e959f176") : secret "networking-console-plugin-cert" not found Jul 28 12:35:49.074964 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.074632 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:49.074964 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.074733 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls podName:e8352141-ea47-45dd-a409-3719c896c28f nodeName:}" failed. No retries permitted until 2026-07-28 12:35:57.074721659 +0000 UTC m=+51.161803182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls") pod "dns-default-shcxk" (UID: "e8352141-ea47-45dd-a409-3719c896c28f") : secret "dns-default-metrics-tls" not found Jul 28 12:35:49.276153 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:49.276112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:49.276350 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:49.276279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:49.276350 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.276287 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:49.276456 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.276355 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls podName:2ab91886-f8da-4e94-be39-c59b4a55ae55 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:51.276335682 +0000 UTC m=+45.363417218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls") pod "cluster-samples-operator-6748489656-nsdvm" (UID: "2ab91886-f8da-4e94-be39-c59b4a55ae55") : secret "samples-operator-tls" not found Jul 28 12:35:49.276456 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.276411 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:49.276456 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.276425 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb57f66b5-fbcs2: secret "image-registry-tls" not found Jul 28 12:35:49.276555 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:49.276479 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls podName:e41d595a-e0ec-4a79-8636-5ebb312ac9ed nodeName:}" failed. No retries permitted until 2026-07-28 12:35:51.276463147 +0000 UTC m=+45.363544697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls") pod "image-registry-5bb57f66b5-fbcs2" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed") : secret "image-registry-tls" not found Jul 28 12:35:49.834323 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:49.834250 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:49.891391 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:49.891317 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.798902 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:50.798867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.861395 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:50.861361 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:51.093701 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.093618 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:51.093928 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.093745 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 12:35:51.093928 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.093820 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert podName:adc29358-31a2-4f0f-b099-6ef5e959f176 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:55.093797965 +0000 UTC m=+49.180879486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f886z" (UID: "adc29358-31a2-4f0f-b099-6ef5e959f176") : secret "networking-console-plugin-cert" not found Jul 28 12:35:51.241650 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.241612 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:51.296261 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.296227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:51.296470 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.296307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:51.296470 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.296389 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:51.296470 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.296405 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb57f66b5-fbcs2: secret "image-registry-tls" not found Jul 28 12:35:51.296470 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.296405 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:51.296470 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.296468 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls podName:e41d595a-e0ec-4a79-8636-5ebb312ac9ed nodeName:}" failed. No retries permitted until 2026-07-28 12:35:55.296449371 +0000 UTC m=+49.383530899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls") pod "image-registry-5bb57f66b5-fbcs2" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed") : secret "image-registry-tls" not found Jul 28 12:35:51.296743 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:51.296485 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls podName:2ab91886-f8da-4e94-be39-c59b4a55ae55 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:55.296476077 +0000 UTC m=+49.383557601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls") pod "cluster-samples-operator-6748489656-nsdvm" (UID: "2ab91886-f8da-4e94-be39-c59b4a55ae55") : secret "samples-operator-tls" not found Jul 28 12:35:51.345438 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.345363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:51.650926 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.650848 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" event={"ID":"6fbc7905-79fa-42fb-a11c-6d569c83d68a","Type":"ContainerStarted","Data":"b3e88368c0e763e95403a2bafdc741d3176e40898d85ab4e831f053ca802099d"} Jul 28 12:35:51.682260 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:51.682195 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" podStartSLOduration=1.163822851 podStartE2EDuration="4.682179985s" totalImagesPullingTime="3.518357134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:51.68173153 +0000 UTC m=+45.768813073" watchObservedRunningTime="2026-07-28 12:35:51.682179985 +0000 UTC m=+45.769261528" Jul 28 12:35:52.140492 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.140459 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.227251 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.227202 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.580631 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.580551 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xb7cm"] Jul 28 12:35:52.596985 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.596957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.599415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.599384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nrjs7\"" Jul 28 12:35:52.599601 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.599575 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 12:35:52.600200 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.600185 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 12:35:52.606922 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.606902 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xb7cm"] Jul 28 12:35:52.632900 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.632867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.654668 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.654630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" event={"ID":"c77f525f-fa1a-42f4-96df-1a79c81b5c5f","Type":"ContainerStarted","Data":"c8e9178cf0f7f61689ffca346407a4ddfba5b837ea1b6db4247ed393473c548f"} Jul 28 12:35:52.697523 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.697476 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kjsff" podStartSLOduration=1.729013289 podStartE2EDuration="5.697460277s" totalImagesPullingTime="3.968446988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:52.695837189 +0000 UTC m=+46.782918728" watchObservedRunningTime="2026-07-28 12:35:52.697460277 +0000 UTC m=+46.784541820" Jul 28 12:35:52.708640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.708617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0016e495-949b-4bb0-a310-318d4e5c1ca3-data-volume\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.708711 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.708675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.708747 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.708724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0016e495-949b-4bb0-a310-318d4e5c1ca3-crio-socket\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.708784 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.708765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2kqs\" (UniqueName: \"kubernetes.io/projected/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-api-access-v2kqs\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.708829 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.708816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.751969 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.751940 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.809324 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.809285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.809490 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.809338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0016e495-949b-4bb0-a310-318d4e5c1ca3-crio-socket\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.809490 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:52.809415 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:52.809490 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.809488 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0016e495-949b-4bb0-a310-318d4e5c1ca3-crio-socket\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.809716 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:52.809501 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.309481102 +0000 UTC m=+47.396562643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : configmap "kube-rbac-proxy" not found Jul 28 12:35:52.809716 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.809521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kqs\" (UniqueName: \"kubernetes.io/projected/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-api-access-v2kqs\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.809716 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.809678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.809973 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:52.809754 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:52.809973 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.809795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0016e495-949b-4bb0-a310-318d4e5c1ca3-data-volume\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.809973 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:52.809806 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.309790203 +0000 UTC m=+47.396871745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:52.810126 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.810109 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0016e495-949b-4bb0-a310-318d4e5c1ca3-data-volume\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:52.822151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:52.822118 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2kqs\" (UniqueName: \"kubernetes.io/projected/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-api-access-v2kqs\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:53.155968 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:53.155935 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:53.236560 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:53.236526 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:53.313396 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:53.313353 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:53.313558 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:53.313462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:53.313558 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:53.313497 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:53.313558 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:53.313536 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:53.313659 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:53.313576 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:54.313560082 +0000 UTC m=+48.400641603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:53.313659 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:53.313597 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:54.313585235 +0000 UTC m=+48.400666758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : configmap "kube-rbac-proxy" not found Jul 28 12:35:53.922909 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:53.922873 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:53.998805 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:53.998772 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:54.125519 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:54.125480 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:54.320770 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:54.320732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:54.321160 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:54.320793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:54.321160 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:54.320852 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:54.321160 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:54.320909 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:54.321160 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:54.320918 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:56.320902956 +0000 UTC m=+50.407984481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : configmap "kube-rbac-proxy" not found Jul 28 12:35:54.321160 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:54.320947 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:56.320936301 +0000 UTC m=+50.408017822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:54.756307 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:54.756279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vzxth_f83edffb-8dbc-40b4-8dfd-fde591190296/dns-node-resolver/0.log" Jul 28 12:35:54.756519 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:54.756496 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:54.853716 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:54.853671 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:55.127668 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:55.127581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:35:55.127843 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.127755 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 12:35:55.127909 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.127851 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert podName:adc29358-31a2-4f0f-b099-6ef5e959f176 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:03.127828074 +0000 UTC m=+57.214909598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f886z" (UID: "adc29358-31a2-4f0f-b099-6ef5e959f176") : secret "networking-console-plugin-cert" not found Jul 28 12:35:55.329752 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:55.329707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:35:55.330125 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:55.329791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:35:55.330125 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.329871 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:55.330125 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.329931 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:55.330125 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.329951 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb57f66b5-fbcs2: secret "image-registry-tls" not found Jul 28 12:35:55.330125 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.329937 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls podName:2ab91886-f8da-4e94-be39-c59b4a55ae55 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:03.329920237 +0000 UTC m=+57.417001774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls") pod "cluster-samples-operator-6748489656-nsdvm" (UID: "2ab91886-f8da-4e94-be39-c59b4a55ae55") : secret "samples-operator-tls" not found Jul 28 12:35:55.330125 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:55.329999 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls podName:e41d595a-e0ec-4a79-8636-5ebb312ac9ed nodeName:}" failed. No retries permitted until 2026-07-28 12:36:03.329987214 +0000 UTC m=+57.417068739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls") pod "image-registry-5bb57f66b5-fbcs2" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed") : secret "image-registry-tls" not found Jul 28 12:35:55.749451 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:55.749420 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r96dr_ace93791-38ec-4326-98b3-10ea850ef171/node-ca/0.log" Jul 28 12:35:55.807093 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:55.807037 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.338685 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:56.338652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:56.339051 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:56.338706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:35:56.339051 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:56.338768 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:56.339051 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:56.338832 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:00.338817267 +0000 UTC m=+54.425898790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : configmap "kube-rbac-proxy" not found Jul 28 12:35:56.339051 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:56.338833 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:56.339051 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:56.338874 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:00.338862457 +0000 UTC m=+54.425943977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:56.512936 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:56.512904 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.551644 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:56.551609 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9qfk_111d9174-0d98-44a5-9c45-f680f4ac3905/serve-healthcheck-canary/0.log" Jul 28 12:35:57.145099 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:57.145055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:35:57.145271 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:57.145232 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:57.145334 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:35:57.145293 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls podName:e8352141-ea47-45dd-a409-3719c896c28f nodeName:}" failed. No retries permitted until 2026-07-28 12:36:13.145276244 +0000 UTC m=+67.232357777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls") pod "dns-default-shcxk" (UID: "e8352141-ea47-45dd-a409-3719c896c28f") : secret "dns-default-metrics-tls" not found Jul 28 12:35:57.150141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:57.150112 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.688141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:58.688104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.892545 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:58.892511 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.996133 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:58.996099 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:59.062466 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:59.062436 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:59.343879 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:35:59.343782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:00.372042 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:00.372005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:00.372578 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:00.372070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:00.372578 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:00.372136 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:36:00.372578 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:00.372203 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:08.372186656 +0000 UTC m=+62.459268180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : configmap "kube-rbac-proxy" not found Jul 28 12:36:00.372578 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:00.372254 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:36:00.372578 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:00.372321 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:08.372303064 +0000 UTC m=+62.459384610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : secret "insights-runtime-extractor-tls" not found Jul 28 12:36:00.499621 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:00.499585 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:00.570834 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:00.570799 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:00.644329 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:00.644249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:01.040797 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:01.040760 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:01.141929 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:01.141900 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:01.335473 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:01.335396 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.136949 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:02.136917 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.432630 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:02.432557 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.539940 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:02.539907 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.639856 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:02.639821 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.932417 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:02.932384 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:03.194288 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.194259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:36:03.194644 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:03.194406 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 12:36:03.194644 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:03.194474 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert podName:adc29358-31a2-4f0f-b099-6ef5e959f176 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:19.194457028 +0000 UTC m=+73.281538553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f886z" (UID: "adc29358-31a2-4f0f-b099-6ef5e959f176") : secret "networking-console-plugin-cert" not found Jul 28 12:36:03.330945 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.330916 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:03.395993 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.395952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:36:03.396156 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.396019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:36:03.398490 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.398465 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"image-registry-5bb57f66b5-fbcs2\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:36:03.398600 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.398555 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab91886-f8da-4e94-be39-c59b4a55ae55-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nsdvm\" (UID: \"2ab91886-f8da-4e94-be39-c59b4a55ae55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:36:03.469171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.469091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:36:03.482156 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.482122 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:03.599093 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.599071 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb57f66b5-fbcs2"] Jul 28 12:36:03.601029 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:03.601000 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41d595a_e0ec_4a79_8636_5ebb312ac9ed.slice/crio-2f97267aceffbe264f8a545c5d6428616a6488b399a6be59f46952e84c06708d WatchSource:0}: Error finding container 2f97267aceffbe264f8a545c5d6428616a6488b399a6be59f46952e84c06708d: Status 404 returned error can't find the container with id 2f97267aceffbe264f8a545c5d6428616a6488b399a6be59f46952e84c06708d Jul 28 12:36:03.681537 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.681498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" event={"ID":"e41d595a-e0ec-4a79-8636-5ebb312ac9ed","Type":"ContainerStarted","Data":"a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf"} Jul 28 12:36:03.681713 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.681558 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" event={"ID":"e41d595a-e0ec-4a79-8636-5ebb312ac9ed","Type":"ContainerStarted","Data":"2f97267aceffbe264f8a545c5d6428616a6488b399a6be59f46952e84c06708d"} Jul 28 12:36:03.681713 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.681611 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:36:03.689842 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.689804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" Jul 28 12:36:03.702300 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.702251 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" podStartSLOduration=16.702204215 podStartE2EDuration="16.702204215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:03.701670579 +0000 UTC m=+57.788752137" watchObservedRunningTime="2026-07-28 12:36:03.702204215 +0000 UTC m=+57.789285758" Jul 28 12:36:03.734327 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.734195 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:03.819138 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:03.819106 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm"] Jul 28 12:36:04.134710 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:04.134629 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:04.341256 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:04.341222 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:04.439059 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:04.438964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:04.685268 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:04.685226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" event={"ID":"2ab91886-f8da-4e94-be39-c59b4a55ae55","Type":"ContainerStarted","Data":"92d528de8eea51d16f7dd06eef9b09eb9e8fdeadccaac8ba475b763d31da7f11"} Jul 28 12:36:04.945056 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:04.945024 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:05.045771 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:05.045737 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:05.537116 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:05.537075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:05.691484 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:05.691452 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" event={"ID":"2ab91886-f8da-4e94-be39-c59b4a55ae55","Type":"ContainerStarted","Data":"cb62139c2d6914b45c411a0a8c6dea780b855df0b10347ada7626f154a5e04b1"} Jul 28 12:36:05.691591 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:05.691518 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" event={"ID":"2ab91886-f8da-4e94-be39-c59b4a55ae55","Type":"ContainerStarted","Data":"7d78ca90845f76bdf2a05d2c8f799cfa18c8f278d958a30b0b315be40231573f"} Jul 28 12:36:05.828354 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:05.828278 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:05.936474 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:05.936442 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:06.332409 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:06.332375 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:06.609054 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:06.608981 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjrpn" Jul 28 12:36:06.637178 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:06.637117 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nsdvm" podStartSLOduration=17.927523082 podStartE2EDuration="19.637101495s" totalImagesPullingTime="1.709578413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:05.736457728 +0000 UTC m=+59.823539271" watchObservedRunningTime="2026-07-28 12:36:06.637101495 +0000 UTC m=+60.724183015" Jul 28 12:36:06.942023 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:06.941990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:07.350781 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:07.350706 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:07.864321 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:07.864289 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:08.201798 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:08.201761 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:08.434819 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:08.434776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:08.434991 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:08.434849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:08.434991 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:08.434977 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:36:08.435066 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:08.435030 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls podName:0016e495-949b-4bb0-a310-318d4e5c1ca3 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:24.435017469 +0000 UTC m=+78.522098990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xb7cm" (UID: "0016e495-949b-4bb0-a310-318d4e5c1ca3") : secret "insights-runtime-extractor-tls" not found Jul 28 12:36:08.435382 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:08.435360 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0016e495-949b-4bb0-a310-318d4e5c1ca3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:08.595149 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:08.595051 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:08.958534 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:08.958504 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:09.227753 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:09.227633 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:09.411575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:09.411542 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:11.913291 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:11.913260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:11.996548 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:11.996519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:12.060894 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.060855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:36:12.063414 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.063399 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 12:36:12.073755 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.073728 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d41a0a1-9fcf-4c97-9390-6d7b3189ea49-metrics-certs\") pod \"network-metrics-daemon-jzh5z\" (UID: \"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49\") " pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:36:12.161882 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.161835 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:36:12.162051 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.161986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:36:12.164321 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.164261 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dc5t\" (UniqueName: \"kubernetes.io/projected/8efe9764-90be-4fc8-a84f-e4d583acf315-kube-api-access-2dc5t\") pod \"network-check-target-ltz6v\" (UID: \"8efe9764-90be-4fc8-a84f-e4d583acf315\") " pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:36:12.164467 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.164448 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 12:36:12.174426 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.174398 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcfa1c56-ff1b-43e4-9d62-8e8e51b31507-original-pull-secret\") pod \"global-pull-secret-syncer-prj57\" (UID: \"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507\") " pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:36:12.247099 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.247066 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z4tgw\"" Jul 28 12:36:12.252793 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.252775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-prj57" Jul 28 12:36:12.254860 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.254839 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:36:12.260697 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.260672 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kxg2r\"" Jul 28 12:36:12.268356 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.268331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzh5z" Jul 28 12:36:12.400590 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.400559 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ltz6v"] Jul 28 12:36:12.404377 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:12.404351 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efe9764_90be_4fc8_a84f_e4d583acf315.slice/crio-46c30f6541e4303eb41d8de1a319b3a1b5574b74e8e33013bb8d18d10fa529e7 WatchSource:0}: Error finding container 46c30f6541e4303eb41d8de1a319b3a1b5574b74e8e33013bb8d18d10fa529e7: Status 404 returned error can't find the container with id 46c30f6541e4303eb41d8de1a319b3a1b5574b74e8e33013bb8d18d10fa529e7 Jul 28 12:36:12.426140 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.426117 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-prj57"] Jul 28 12:36:12.440386 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.440360 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jzh5z"] Jul 28 12:36:12.442931 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:12.442909 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d41a0a1_9fcf_4c97_9390_6d7b3189ea49.slice/crio-b17d890ff68df46c4188ab09de4f637ed2d76182da5ff2cab3022712b4399852 WatchSource:0}: Error finding container b17d890ff68df46c4188ab09de4f637ed2d76182da5ff2cab3022712b4399852: Status 404 returned error can't find the container with id b17d890ff68df46c4188ab09de4f637ed2d76182da5ff2cab3022712b4399852 Jul 28 12:36:12.711638 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.711610 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ltz6v" event={"ID":"8efe9764-90be-4fc8-a84f-e4d583acf315","Type":"ContainerStarted","Data":"f81bb7fe8f78aa23c65cc017a5c4f9c495a7e8b2af2aae4f4dddd6ec52debbe4"} Jul 28 12:36:12.711807 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.711658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ltz6v" event={"ID":"8efe9764-90be-4fc8-a84f-e4d583acf315","Type":"ContainerStarted","Data":"46c30f6541e4303eb41d8de1a319b3a1b5574b74e8e33013bb8d18d10fa529e7"} Jul 28 12:36:12.711807 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.711728 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:36:12.712879 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.712856 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-prj57" event={"ID":"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507","Type":"ContainerStarted","Data":"48ee83c02a6ac4378d6741ecfefa13e01a93838ff49717058da86d62a9518938"} Jul 28 12:36:12.713774 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.713752 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jzh5z" event={"ID":"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49","Type":"ContainerStarted","Data":"b17d890ff68df46c4188ab09de4f637ed2d76182da5ff2cab3022712b4399852"} Jul 28 12:36:12.729470 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:12.729422 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ltz6v" podStartSLOduration=65.729406292 podStartE2EDuration="1m5.729406292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:12.729104995 +0000 UTC m=+66.816186539" watchObservedRunningTime="2026-07-28 12:36:12.729406292 +0000 UTC m=+66.816487835" Jul 28 12:36:13.171168 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.170990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:36:13.173849 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.173789 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8352141-ea47-45dd-a409-3719c896c28f-metrics-tls\") pod \"dns-default-shcxk\" (UID: \"e8352141-ea47-45dd-a409-3719c896c28f\") " pod="openshift-dns/dns-default-shcxk" Jul 28 12:36:13.211148 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.211110 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb57f66b5-fbcs2"] Jul 28 12:36:13.231559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.231303 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f"] Jul 28 12:36:13.235006 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.234976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.238746 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.238134 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 12:36:13.238746 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.238518 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 12:36:13.238938 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.238768 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 12:36:13.238938 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.238811 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 12:36:13.238938 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.238830 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 12:36:13.239081 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.238958 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 12:36:13.239224 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.239189 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 12:36:13.264505 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.264476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f"] Jul 28 12:36:13.271827 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.271799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2389a103-d97a-4635-a429-5f79bd172fd8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.271966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.271863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-hub\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.271966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.271910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.271966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.271959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-ca\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.272130 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.271986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjddv\" (UniqueName: \"kubernetes.io/projected/2389a103-d97a-4635-a429-5f79bd172fd8-kube-api-access-zjddv\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.272130 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.272058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.304991 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.304953 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:13.373013 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.372963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.373188 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.373015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2389a103-d97a-4635-a429-5f79bd172fd8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.373188 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.373077 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-hub\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.373385 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.373356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.373508 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.373406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-ca\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.373508 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.373440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjddv\" (UniqueName: \"kubernetes.io/projected/2389a103-d97a-4635-a429-5f79bd172fd8-kube-api-access-zjddv\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.373891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.373867 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2389a103-d97a-4635-a429-5f79bd172fd8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.376045 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.376019 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-ca\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.376420 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.376394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.376547 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.376524 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.376675 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.376656 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2389a103-d97a-4635-a429-5f79bd172fd8-hub\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.395242 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.395196 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjddv\" (UniqueName: \"kubernetes.io/projected/2389a103-d97a-4635-a429-5f79bd172fd8-kube-api-access-zjddv\") pod \"cluster-proxy-proxy-agent-75bf85c5bc-mqn7f\" (UID: \"2389a103-d97a-4635-a429-5f79bd172fd8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.406187 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.406155 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6l7wd\"" Jul 28 12:36:13.413751 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.413713 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shcxk" Jul 28 12:36:13.474332 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.474298 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:13.557019 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.556984 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" Jul 28 12:36:13.909933 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.909901 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-shcxk"] Jul 28 12:36:13.914467 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:13.914437 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8352141_ea47_45dd_a409_3719c896c28f.slice/crio-f446933b385bcc2a653ea24cb6996820733e77a42de5e2355f4ca5578f51d57e WatchSource:0}: Error finding container f446933b385bcc2a653ea24cb6996820733e77a42de5e2355f4ca5578f51d57e: Status 404 returned error can't find the container with id f446933b385bcc2a653ea24cb6996820733e77a42de5e2355f4ca5578f51d57e Jul 28 12:36:13.915091 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.915003 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:13.950473 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:13.950441 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f"] Jul 28 12:36:14.082326 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.082199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.088558 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:14.088460 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2389a103_d97a_4635_a429_5f79bd172fd8.slice/crio-c597e1242b087e8d9e13f240c709573e4b7eceae3e679ad8e093be3478a90813 WatchSource:0}: Error finding container c597e1242b087e8d9e13f240c709573e4b7eceae3e679ad8e093be3478a90813: Status 404 returned error can't find the container with id c597e1242b087e8d9e13f240c709573e4b7eceae3e679ad8e093be3478a90813 Jul 28 12:36:14.228939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.228909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.352513 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.352482 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.577306 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.577260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.678641 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.678500 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.726239 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.725930 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jzh5z" event={"ID":"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49","Type":"ContainerStarted","Data":"4ee59231959874ab48661c3eb184f1bd54c0a45ac310cf65377427b7c5d39377"} Jul 28 12:36:14.726239 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.725993 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jzh5z" event={"ID":"1d41a0a1-9fcf-4c97-9390-6d7b3189ea49","Type":"ContainerStarted","Data":"5be065439a52e8fff99aec6acb628f2f5c085ee7dda03e4add746ef85a21787d"} Jul 28 12:36:14.728151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.728082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shcxk" event={"ID":"e8352141-ea47-45dd-a409-3719c896c28f","Type":"ContainerStarted","Data":"f446933b385bcc2a653ea24cb6996820733e77a42de5e2355f4ca5578f51d57e"} Jul 28 12:36:14.730435 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.730382 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" event={"ID":"2389a103-d97a-4635-a429-5f79bd172fd8","Type":"ContainerStarted","Data":"c597e1242b087e8d9e13f240c709573e4b7eceae3e679ad8e093be3478a90813"} Jul 28 12:36:14.904993 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:14.904919 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.005623 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.005585 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.186764 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.186713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.291520 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.291435 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.608937 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.608842 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.778717 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.778681 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.860161 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.860089 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.973900 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:15.973866 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:16.804491 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:16.804457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:16.902631 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:16.902596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:17.314421 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:17.314386 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:17.416500 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:17.416470 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.226537 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.226491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:36:19.228896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.228865 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adc29358-31a2-4f0f-b099-6ef5e959f176-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f886z\" (UID: \"adc29358-31a2-4f0f-b099-6ef5e959f176\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:36:19.387054 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.387025 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k5lqm\"" Jul 28 12:36:19.395148 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.395121 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" Jul 28 12:36:19.522012 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.521952 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jzh5z" podStartSLOduration=71.853517338 podStartE2EDuration="1m13.521935909s" totalImagesPullingTime="1.668418571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:14.752636248 +0000 UTC m=+68.839717795" watchObservedRunningTime="2026-07-28 12:36:19.521935909 +0000 UTC m=+73.609017451" Jul 28 12:36:19.522846 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.522828 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f886z"] Jul 28 12:36:19.527392 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:19.527366 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc29358_31a2_4f0f_b099_6ef5e959f176.slice/crio-8da23ee681cfbad8d2e15ff50e09d6b91d9b0cdec55ec4dcba449d4e252218c7 WatchSource:0}: Error finding container 8da23ee681cfbad8d2e15ff50e09d6b91d9b0cdec55ec4dcba449d4e252218c7: Status 404 returned error can't find the container with id 8da23ee681cfbad8d2e15ff50e09d6b91d9b0cdec55ec4dcba449d4e252218c7 Jul 28 12:36:19.751858 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.751751 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" event={"ID":"2389a103-d97a-4635-a429-5f79bd172fd8","Type":"ContainerStarted","Data":"7c9cb48457834159e6af9d8cfdbe06f30e0760d90f02c291e8d2d02edf5287f5"} Jul 28 12:36:19.751858 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.751802 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" event={"ID":"2389a103-d97a-4635-a429-5f79bd172fd8","Type":"ContainerStarted","Data":"db16e619879c8af777537b00384383f4b3f122c0198e2df22d5cb9c8be85c60e"} Jul 28 12:36:19.751858 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.751822 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" event={"ID":"2389a103-d97a-4635-a429-5f79bd172fd8","Type":"ContainerStarted","Data":"dd94073284771d61111c734781ec5dc0178848532b36e2e8d1e4dae44ebd0a5d"} Jul 28 12:36:19.752905 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.752881 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" event={"ID":"adc29358-31a2-4f0f-b099-6ef5e959f176","Type":"ContainerStarted","Data":"8da23ee681cfbad8d2e15ff50e09d6b91d9b0cdec55ec4dcba449d4e252218c7"} Jul 28 12:36:19.754323 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.754303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-prj57" event={"ID":"dcfa1c56-ff1b-43e4-9d62-8e8e51b31507","Type":"ContainerStarted","Data":"26959cdb38d4dfb2adb87acf9e14fbee9402eb5432fcef29b27791d3b2a9f1fe"} Jul 28 12:36:19.756192 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.756174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shcxk" event={"ID":"e8352141-ea47-45dd-a409-3719c896c28f","Type":"ContainerStarted","Data":"5d695648911409eb47a41d6e19ee7e176c78ed1f1c1964bc2662d68a2273a25a"} Jul 28 12:36:19.756283 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.756231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shcxk" event={"ID":"e8352141-ea47-45dd-a409-3719c896c28f","Type":"ContainerStarted","Data":"c1d74158b85fed7f1f166c862e51d13b78d47b60382df54dc9a268b9c6801167"} Jul 28 12:36:19.756333 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.756309 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-shcxk" Jul 28 12:36:19.774866 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.774821 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bf85c5bc-mqn7f" podStartSLOduration=1.87340711 podStartE2EDuration="6.774806897s" totalImagesPullingTime="4.901399787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:19.773727065 +0000 UTC m=+73.860808608" watchObservedRunningTime="2026-07-28 12:36:19.774806897 +0000 UTC m=+73.861888439" Jul 28 12:36:19.789430 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:19.789386 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-shcxk" podStartSLOduration=33.943412999 podStartE2EDuration="38.789371846s" totalImagesPullingTime="4.845958847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:19.789336239 +0000 UTC m=+73.876417782" watchObservedRunningTime="2026-07-28 12:36:19.789371846 +0000 UTC m=+73.876453386" Jul 28 12:36:20.761016 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:20.760975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" event={"ID":"adc29358-31a2-4f0f-b099-6ef5e959f176","Type":"ContainerStarted","Data":"0ef9a078fe9bf750158e36b88157f96b6487293a7125f9cdd876d9069c41de74"} Jul 28 12:36:20.779184 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:20.779134 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f886z" podStartSLOduration=32.680316091 podStartE2EDuration="33.779117922s" totalImagesPullingTime="1.098801831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:20.77782857 +0000 UTC m=+74.864910111" watchObservedRunningTime="2026-07-28 12:36:20.779117922 +0000 UTC m=+74.866199465" Jul 28 12:36:20.779330 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:20.779223 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-prj57" podStartSLOduration=67.288305251 podStartE2EDuration="1m13.779205578s" totalImagesPullingTime="6.490900327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:19.803796534 +0000 UTC m=+73.890878087" watchObservedRunningTime="2026-07-28 12:36:20.779205578 +0000 UTC m=+74.866287122" Jul 28 12:36:20.899695 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:20.899602 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:20.985757 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:20.985726 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:21.696585 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:21.696551 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:21.796060 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:21.796025 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:21.889832 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:21.889796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:22.230802 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:22.230764 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:22.637757 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:22.637661 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:22.725995 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:22.725959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:23.216854 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:23.216821 2560 patch_prober.go:28] interesting pod/image-registry-5bb57f66b5-fbcs2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 12:36:23.217253 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:23.216914 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 12:36:24.466709 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:24.466652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:24.468965 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:24.468940 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0016e495-949b-4bb0-a310-318d4e5c1ca3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xb7cm\" (UID: \"0016e495-949b-4bb0-a310-318d4e5c1ca3\") " pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:24.710346 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:24.710310 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nrjs7\"" Jul 28 12:36:24.717016 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:24.716962 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xb7cm" Jul 28 12:36:24.879179 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:24.879143 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xb7cm"] Jul 28 12:36:24.882871 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:24.882825 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0016e495_949b_4bb0_a310_318d4e5c1ca3.slice/crio-89ac71f82b3bb1ea43ee7e0c55a7922c00a517793590096fc1c2c85e6f7a53fd WatchSource:0}: Error finding container 89ac71f82b3bb1ea43ee7e0c55a7922c00a517793590096fc1c2c85e6f7a53fd: Status 404 returned error can't find the container with id 89ac71f82b3bb1ea43ee7e0c55a7922c00a517793590096fc1c2c85e6f7a53fd Jul 28 12:36:24.904145 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:24.904083 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.028243 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:25.028147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.796088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:25.796046 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xb7cm" event={"ID":"0016e495-949b-4bb0-a310-318d4e5c1ca3","Type":"ContainerStarted","Data":"89ac71f82b3bb1ea43ee7e0c55a7922c00a517793590096fc1c2c85e6f7a53fd"} Jul 28 12:36:27.909366 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:27.909310 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:28.012433 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:28.012367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:28.179528 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:28.179434 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:29.764177 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:29.764156 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-shcxk" Jul 28 12:36:29.813235 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:29.813183 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xb7cm" event={"ID":"0016e495-949b-4bb0-a310-318d4e5c1ca3","Type":"ContainerStarted","Data":"08093dd01b1146d795c343f422cd1c09693a1ce29350ff9931d482cd0cdb35bd"} Jul 28 12:36:32.617607 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:32.617575 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:33.215793 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:33.215755 2560 patch_prober.go:28] interesting pod/image-registry-5bb57f66b5-fbcs2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 12:36:33.215958 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:33.215821 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 12:36:33.830643 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:33.830594 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xb7cm" event={"ID":"0016e495-949b-4bb0-a310-318d4e5c1ca3","Type":"ContainerStarted","Data":"41ed9ac5e6b24f8485354e80ef73a84bc9eb2d971ce6b9f068df978b001f2658"} Jul 28 12:36:35.326421 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:35.326386 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:35.427638 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:35.427589 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:35.490754 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:35.490711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:36.844226 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:36.844107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xb7cm" event={"ID":"0016e495-949b-4bb0-a310-318d4e5c1ca3","Type":"ContainerStarted","Data":"4ef8508910b7c42c7643e8182e8790eb8bab11f2d4419d143623ad56649ad1d4"} Jul 28 12:36:36.861296 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:36.861248 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xb7cm" podStartSLOduration=33.29479411 podStartE2EDuration="44.861232877s" totalImagesPullingTime="11.566438767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:36.86010192 +0000 UTC m=+90.947183463" watchObservedRunningTime="2026-07-28 12:36:36.861232877 +0000 UTC m=+90.948314419" Jul 28 12:36:38.236019 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.235976 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerName="registry" containerID="cri-o://a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf" gracePeriod=30 Jul 28 12:36:38.473932 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.473903 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:36:38.585510 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585414 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585510 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585475 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-certificates\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585510 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585504 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwdpm\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-kube-api-access-gwdpm\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585540 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-installation-pull-secrets\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585561 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-bound-sa-token\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585596 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-ca-trust-extracted\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585630 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-image-registry-private-configuration\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.585777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.585661 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-trusted-ca\") pod \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\" (UID: \"e41d595a-e0ec-4a79-8636-5ebb312ac9ed\") " Jul 28 12:36:38.586191 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.586160 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:38.586308 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.586184 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:38.588187 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.588157 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-kube-api-access-gwdpm" (OuterVolumeSpecName: "kube-api-access-gwdpm") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "kube-api-access-gwdpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:38.588322 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.588289 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:38.588397 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.588319 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:36:38.588397 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.588379 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:38.588476 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.588399 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:36:38.594393 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.594368 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e41d595a-e0ec-4a79-8636-5ebb312ac9ed" (UID: "e41d595a-e0ec-4a79-8636-5ebb312ac9ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:36:38.686479 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686438 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-trusted-ca\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686479 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686468 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686479 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686479 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-registry-certificates\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686479 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686489 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwdpm\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-kube-api-access-gwdpm\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686770 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686498 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-installation-pull-secrets\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686770 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686506 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-bound-sa-token\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686770 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686514 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-ca-trust-extracted\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.686770 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.686524 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e41d595a-e0ec-4a79-8636-5ebb312ac9ed-image-registry-private-configuration\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:36:38.843953 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.843867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:38.851040 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.851012 2560 generic.go:356] "Generic (PLEG): container finished" podID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerID="a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf" exitCode=0 Jul 28 12:36:38.851171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.851057 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" Jul 28 12:36:38.851171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.851060 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" event={"ID":"e41d595a-e0ec-4a79-8636-5ebb312ac9ed","Type":"ContainerDied","Data":"a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf"} Jul 28 12:36:38.851171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.851110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb57f66b5-fbcs2" event={"ID":"e41d595a-e0ec-4a79-8636-5ebb312ac9ed","Type":"ContainerDied","Data":"2f97267aceffbe264f8a545c5d6428616a6488b399a6be59f46952e84c06708d"} Jul 28 12:36:38.851171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.851134 2560 scope.go:117] "RemoveContainer" containerID="a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf" Jul 28 12:36:38.860141 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.860121 2560 scope.go:117] "RemoveContainer" containerID="a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf" Jul 28 12:36:38.860410 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:38.860393 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf\": container with ID starting with a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf not found: ID does not exist" containerID="a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf" Jul 28 12:36:38.860460 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.860419 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf"} err="failed to get container status \"a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf\": rpc error: code = NotFound desc = could not find container \"a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf\": container with ID starting with a0a82da1c3c06d76225b4489aaf77023188a3746e0fd24a256c2d7a9b8b1becf not found: ID does not exist" Jul 28 12:36:38.876473 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.876448 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb57f66b5-fbcs2"] Jul 28 12:36:38.879483 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.879462 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bb57f66b5-fbcs2"] Jul 28 12:36:38.966997 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:38.966966 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:40.337725 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:40.337697 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" path="/var/lib/kubelet/pods/e41d595a-e0ec-4a79-8636-5ebb312ac9ed/volumes" Jul 28 12:36:41.916626 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:41.916592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:41.985030 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:41.984997 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:42.074228 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:42.074179 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:42.170746 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:42.170670 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:43.146914 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:43.146884 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:43.246870 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:43.246838 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:43.720772 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:43.720745 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ltz6v" Jul 28 12:36:44.191372 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:44.191343 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:44.252941 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:44.252911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:45.295634 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:45.295600 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:46.055370 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:46.055339 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:46.155253 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:46.155198 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:46.426892 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:46.426816 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:46.527366 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:46.527338 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.077951 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.077918 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.299289 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.299254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.382112 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.382025 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cfnjh"] Jul 28 12:36:47.382318 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.382303 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerName="registry" Jul 28 12:36:47.382377 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.382320 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerName="registry" Jul 28 12:36:47.382377 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.382363 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41d595a-e0ec-4a79-8636-5ebb312ac9ed" containerName="registry" Jul 28 12:36:47.390260 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.390236 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.392233 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.392200 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 12:36:47.393242 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.393191 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 12:36:47.393353 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.393267 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 12:36:47.393353 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.393202 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 12:36:47.393353 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.393299 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r62cm\"" Jul 28 12:36:47.393931 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.393909 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 12:36:47.394328 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.394287 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 12:36:47.404107 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.404075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.413017 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.412984 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst"] Jul 28 12:36:47.416740 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.416720 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.418913 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.418894 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 12:36:47.418913 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.418904 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 12:36:47.419040 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.418945 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w9j4s\"" Jul 28 12:36:47.428377 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.428355 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst"] Jul 28 12:36:47.493372 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.493338 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.543458 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.543589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-tls\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-wtmp\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.543740 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-root\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543740 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-metrics-client-ca\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543740 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.543740 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnlqp\" (UniqueName: \"kubernetes.io/projected/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-kube-api-access-wnlqp\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543740 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-sys\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-textfile\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.543887 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.543803 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4p5l\" (UniqueName: \"kubernetes.io/projected/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-kube-api-access-l4p5l\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.611526 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.611484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.645142 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-sys\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645142 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-textfile\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645142 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4p5l\" (UniqueName: \"kubernetes.io/projected/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-kube-api-access-l4p5l\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.645357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.645357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-tls\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645180 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-sys\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-wtmp\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645357 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-root\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645388 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-wtmp\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-metrics-client-ca\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645437 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-root\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645477 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnlqp\" (UniqueName: \"kubernetes.io/projected/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-kube-api-access-wnlqp\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645494 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-textfile\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.645640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.646006 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:47.645786 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 12:36:47.646006 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.646006 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:47.645868 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-tls podName:2b2e188f-40ad-4cb6-81fa-4bbd5bf50067 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:48.145845323 +0000 UTC m=+102.232926850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-gvdst" (UID: "2b2e188f-40ad-4cb6-81fa-4bbd5bf50067") : secret "openshift-state-metrics-tls" not found Jul 28 12:36:47.646006 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.645991 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-metrics-client-ca\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.646190 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.646113 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.647817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.647797 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.648145 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.648127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.648317 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.648300 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-node-exporter-tls\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.658353 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.658327 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4p5l\" (UniqueName: \"kubernetes.io/projected/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-kube-api-access-l4p5l\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:47.658958 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.658935 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnlqp\" (UniqueName: \"kubernetes.io/projected/fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1-kube-api-access-wnlqp\") pod \"node-exporter-cfnjh\" (UID: \"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1\") " pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.702290 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.702256 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfnjh" Jul 28 12:36:47.704139 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.704112 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.714603 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:47.714574 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed97e5c_eb11_4ae1_aafc_06b6a93a5ff1.slice/crio-c482132467dd2bfd47baed8da73e844e2ece20f6c336ec7c488964694bbaef15 WatchSource:0}: Error finding container c482132467dd2bfd47baed8da73e844e2ece20f6c336ec7c488964694bbaef15: Status 404 returned error can't find the container with id c482132467dd2bfd47baed8da73e844e2ece20f6c336ec7c488964694bbaef15 Jul 28 12:36:47.805189 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.805156 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:47.881144 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.881106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfnjh" event={"ID":"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1","Type":"ContainerStarted","Data":"c482132467dd2bfd47baed8da73e844e2ece20f6c336ec7c488964694bbaef15"} Jul 28 12:36:47.908431 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:47.908370 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:48.005894 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.005860 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:48.110125 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.110093 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:48.149439 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.149412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:48.151761 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.151727 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b2e188f-40ad-4cb6-81fa-4bbd5bf50067-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gvdst\" (UID: \"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:48.321378 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.321341 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:48.325252 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.325235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" Jul 28 12:36:48.409019 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.408982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:48.458397 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.458367 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst"] Jul 28 12:36:48.461182 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:48.461160 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2e188f_40ad_4cb6_81fa_4bbd5bf50067.slice/crio-05b36e0e7196c17fe4ee1c67649097c68b2b8fd06025b5c364e61232654a4d37 WatchSource:0}: Error finding container 05b36e0e7196c17fe4ee1c67649097c68b2b8fd06025b5c364e61232654a4d37: Status 404 returned error can't find the container with id 05b36e0e7196c17fe4ee1c67649097c68b2b8fd06025b5c364e61232654a4d37 Jul 28 12:36:48.626805 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.626751 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:48.886966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.886874 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" event={"ID":"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067","Type":"ContainerStarted","Data":"c165a6c1ba5bd4526ff32e3704e7c097e34e304f1cfb3b78b66c47b8bc59e777"} Jul 28 12:36:48.886966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.886937 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" event={"ID":"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067","Type":"ContainerStarted","Data":"54ab27c76c604bed82beb766d3889ab3dc5f80dc726ac9b51aab18c916fec245"} Jul 28 12:36:48.886966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.886959 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" event={"ID":"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067","Type":"ContainerStarted","Data":"05b36e0e7196c17fe4ee1c67649097c68b2b8fd06025b5c364e61232654a4d37"} Jul 28 12:36:48.941280 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:48.941241 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:49.042750 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:49.042722 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:49.894095 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:49.894048 2560 generic.go:356] "Generic (PLEG): container finished" podID="fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1" containerID="f64d0d06b623d3d854a1907c13d0044b92dd847c0475ed3de579d09f3dcbaae5" exitCode=0 Jul 28 12:36:49.894548 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:49.894176 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfnjh" event={"ID":"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1","Type":"ContainerDied","Data":"f64d0d06b623d3d854a1907c13d0044b92dd847c0475ed3de579d09f3dcbaae5"} Jul 28 12:36:50.272747 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.272709 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:50.346873 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.346837 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:50.425032 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.425001 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:50.525170 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.525092 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:50.899974 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.899885 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" event={"ID":"2b2e188f-40ad-4cb6-81fa-4bbd5bf50067","Type":"ContainerStarted","Data":"d94b16b68a27676fb5a2fc41f40a62503eef4ee0040bcceedc5ae8a8b707ac83"} Jul 28 12:36:50.901896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.901865 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfnjh" event={"ID":"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1","Type":"ContainerStarted","Data":"506c78a5372ec5411704fcecc9569b4697d3f85ad9900102ae938abee422a0af"} Jul 28 12:36:50.902011 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.901909 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfnjh" event={"ID":"fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1","Type":"ContainerStarted","Data":"c688d20cd0a773636248cae9cf4903b532fd3999d9b0e8b8b2081c16de6699ed"} Jul 28 12:36:50.918910 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.918854 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gvdst" podStartSLOduration=2.525962797 podStartE2EDuration="3.918836959s" totalImagesPullingTime="1.392874162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:50.917654837 +0000 UTC m=+105.004736391" watchObservedRunningTime="2026-07-28 12:36:50.918836959 +0000 UTC m=+105.005918501" Jul 28 12:36:50.935814 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:50.935752 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cfnjh" podStartSLOduration=2.553366817 podStartE2EDuration="3.935733284s" totalImagesPullingTime="1.317604901s" totalInitContainerRuntime="64.761566ms" isStatefulPod=true podCreationTimestamp="2026-07-28 12:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:50.934026306 +0000 UTC m=+105.021107852" watchObservedRunningTime="2026-07-28 12:36:50.935733284 +0000 UTC m=+105.022814826" Jul 28 12:36:52.129650 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.129605 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:52.215162 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.215126 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4"] Jul 28 12:36:52.220259 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.220226 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:52.254688 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.254654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4"] Jul 28 12:36:52.254859 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.254774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.257094 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.257070 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 12:36:52.257094 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.257092 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qwt8z\"" Jul 28 12:36:52.281121 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.281073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnflp\" (UniqueName: \"kubernetes.io/projected/672c2eb2-7461-4d09-a6b1-b5f019366237-kube-api-access-hnflp\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.281347 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.281237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/672c2eb2-7461-4d09-a6b1-b5f019366237-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.382061 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.381972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/672c2eb2-7461-4d09-a6b1-b5f019366237-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.382061 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.382029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnflp\" (UniqueName: \"kubernetes.io/projected/672c2eb2-7461-4d09-a6b1-b5f019366237-kube-api-access-hnflp\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.382273 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:52.382134 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 12:36:52.382273 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:36:52.382201 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672c2eb2-7461-4d09-a6b1-b5f019366237-monitoring-plugin-cert podName:672c2eb2-7461-4d09-a6b1-b5f019366237 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:52.882181412 +0000 UTC m=+106.969262944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/672c2eb2-7461-4d09-a6b1-b5f019366237-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-4hts4" (UID: "672c2eb2-7461-4d09-a6b1-b5f019366237") : secret "monitoring-plugin-cert" not found Jul 28 12:36:52.394938 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.394908 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnflp\" (UniqueName: \"kubernetes.io/projected/672c2eb2-7461-4d09-a6b1-b5f019366237-kube-api-access-hnflp\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.552627 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.552595 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j"] Jul 28 12:36:52.575773 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.575743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.579036 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.579007 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j"] Jul 28 12:36:52.579236 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.579178 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7wl6m\"" Jul 28 12:36:52.579732 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.579710 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 12:36:52.579732 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.579725 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 12:36:52.579896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.579735 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 12:36:52.579896 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.579825 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 12:36:52.580907 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.580884 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 12:36:52.582874 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.582852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-serving-certs-ca-bundle\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.582975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.582882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.582975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.582903 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-telemeter-client-tls\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.583065 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.582981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-federate-client-tls\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.583065 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.583028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-secret-telemeter-client\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.583137 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.583092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vnw\" (UniqueName: \"kubernetes.io/projected/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-kube-api-access-h7vnw\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.583137 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.583119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.583263 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.583181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-metrics-client-ca\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.593415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.593384 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 12:36:52.683817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.683729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vnw\" (UniqueName: \"kubernetes.io/projected/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-kube-api-access-h7vnw\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.683817 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.683783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684032 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.683835 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-metrics-client-ca\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684032 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.683877 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-serving-certs-ca-bundle\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684117 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.684083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684170 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.684134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-telemeter-client-tls\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684255 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.684171 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-federate-client-tls\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684255 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.684202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-secret-telemeter-client\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684689 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.684660 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-metrics-client-ca\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.684997 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.684972 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-serving-certs-ca-bundle\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.685159 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.685133 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.686705 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.686675 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.686934 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.686917 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-secret-telemeter-client\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.687415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.687388 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-federate-client-tls\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.687499 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.687428 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-telemeter-client-tls\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.692039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.692018 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vnw\" (UniqueName: \"kubernetes.io/projected/b17d37f8-d9f8-4e05-9231-7ff7134aa2b8-kube-api-access-h7vnw\") pod \"telemeter-client-5b7575f9d5-tfj9j\" (UID: \"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8\") " pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.779821 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.779785 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:52.885633 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.885597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/672c2eb2-7461-4d09-a6b1-b5f019366237-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.888055 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.888022 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/672c2eb2-7461-4d09-a6b1-b5f019366237-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4hts4\" (UID: \"672c2eb2-7461-4d09-a6b1-b5f019366237\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:52.892917 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.892891 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" Jul 28 12:36:52.920537 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:52.920493 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:53.083820 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.083787 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j"] Jul 28 12:36:53.086810 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:53.086777 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17d37f8_d9f8_4e05_9231_7ff7134aa2b8.slice/crio-fab4235efc49420368c75560f89cc5f47e0374975e5919702c46cc308e005a8c WatchSource:0}: Error finding container fab4235efc49420368c75560f89cc5f47e0374975e5919702c46cc308e005a8c: Status 404 returned error can't find the container with id fab4235efc49420368c75560f89cc5f47e0374975e5919702c46cc308e005a8c Jul 28 12:36:53.164468 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.164434 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:53.172811 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.172782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:53.261894 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.261865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:53.340666 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.340633 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4"] Jul 28 12:36:53.343686 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:53.343660 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672c2eb2_7461_4d09_a6b1_b5f019366237.slice/crio-f4ff770c51e9e9fde79093ee0176679d2a6f040dff02bb96423aa466318cb9cb WatchSource:0}: Error finding container f4ff770c51e9e9fde79093ee0176679d2a6f040dff02bb96423aa466318cb9cb: Status 404 returned error can't find the container with id f4ff770c51e9e9fde79093ee0176679d2a6f040dff02bb96423aa466318cb9cb Jul 28 12:36:53.645753 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.645674 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:36:53.671189 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.671159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.674232 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.674187 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 12:36:53.674812 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.674561 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 12:36:53.674812 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.674569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 12:36:53.674812 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.674782 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 12:36:53.675039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.674880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wcg9k\"" Jul 28 12:36:53.675039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.674983 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 12:36:53.675132 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675087 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 12:36:53.675132 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675091 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2dnregce3a8pt\"" Jul 28 12:36:53.675338 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675299 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 12:36:53.675562 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675544 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 12:36:53.675683 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675603 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 12:36:53.675752 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675730 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 12:36:53.675811 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.675791 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 12:36:53.676042 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.676021 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 12:36:53.676695 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.676477 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:36:53.676807 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.676793 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 12:36:53.678111 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.678079 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:53.678308 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.678111 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 12:36:53.682229 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.682187 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 12:36:53.691999 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.691968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692168 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692168 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692168 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692316 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692316 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692316 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692266 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692316 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692491 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692491 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692400 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd58g\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-kube-api-access-nd58g\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692491 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692442 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692491 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692629 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692629 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692629 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692629 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692742 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692638 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692742 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692742 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.692742 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.692706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793700 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793700 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.793939 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.793983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794042 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794125 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd58g\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-kube-api-access-nd58g\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794337 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.794924 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.794704 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.796651 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.795250 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.796651 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.795256 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.796651 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.795781 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.796651 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.796140 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.797104 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.797079 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.799505 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.799446 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.799505 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.799457 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.799835 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.799570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.800520 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.800257 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.800520 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.800451 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.800520 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.800486 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.800735 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.800677 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.801066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.800972 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.802056 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.801266 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.802056 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.801564 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.802056 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.801823 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.802056 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.801840 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.803155 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.803130 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd58g\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-kube-api-access-nd58g\") pod \"prometheus-k8s-0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:53.914310 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.914202 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" event={"ID":"672c2eb2-7461-4d09-a6b1-b5f019366237","Type":"ContainerStarted","Data":"f4ff770c51e9e9fde79093ee0176679d2a6f040dff02bb96423aa466318cb9cb"} Jul 28 12:36:53.915385 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.915358 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" event={"ID":"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8","Type":"ContainerStarted","Data":"fab4235efc49420368c75560f89cc5f47e0374975e5919702c46cc308e005a8c"} Jul 28 12:36:53.983929 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:53.983888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:36:54.179863 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:54.179713 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:36:54.183222 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:36:54.183182 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfc3f3f_90c4_4ca0_b48e_44360af514b0.slice/crio-bd48b54bab30dc35202bbc062a81cf2c0705dae9cc0f83b615d7676f94ea21c0 WatchSource:0}: Error finding container bd48b54bab30dc35202bbc062a81cf2c0705dae9cc0f83b615d7676f94ea21c0: Status 404 returned error can't find the container with id bd48b54bab30dc35202bbc062a81cf2c0705dae9cc0f83b615d7676f94ea21c0 Jul 28 12:36:54.920580 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:54.920542 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"bd48b54bab30dc35202bbc062a81cf2c0705dae9cc0f83b615d7676f94ea21c0"} Jul 28 12:36:56.909412 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.909375 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:56.930082 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.930045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" event={"ID":"672c2eb2-7461-4d09-a6b1-b5f019366237","Type":"ContainerStarted","Data":"dc802729b7999e7182e035615e90df33243c45d2e22eeebae28963b69e68c327"} Jul 28 12:36:56.930331 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.930140 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:56.932409 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.932375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" event={"ID":"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8","Type":"ContainerStarted","Data":"8d5520df7dc863611a4bdfe51af264ed86e0a86d61ebce3bd9c3ea7d603b35ae"} Jul 28 12:36:56.932549 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.932446 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" event={"ID":"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8","Type":"ContainerStarted","Data":"df5cba93096ba922d6dce673be6845078ccbf68db81b0a2e6d2bdb955fd1c7b1"} Jul 28 12:36:56.932549 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.932480 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" event={"ID":"b17d37f8-d9f8-4e05-9231-7ff7134aa2b8","Type":"ContainerStarted","Data":"a28917deb61bea1344ae0bc0456bafe632b1eee5a928a5294fd93a934ca595ec"} Jul 28 12:36:56.933973 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.933947 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" exitCode=0 Jul 28 12:36:56.934084 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.933974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} Jul 28 12:36:56.935728 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.935712 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" Jul 28 12:36:56.946014 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.945960 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4hts4" podStartSLOduration=2.445480254 podStartE2EDuration="4.945945931s" totalImagesPullingTime="2.500465677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:56.945316672 +0000 UTC m=+111.032398216" watchObservedRunningTime="2026-07-28 12:36:56.945945931 +0000 UTC m=+111.033027475" Jul 28 12:36:56.980879 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.980826 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b7575f9d5-tfj9j" podStartSLOduration=1.843886773 podStartE2EDuration="4.98080961s" totalImagesPullingTime="3.136922837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:56.979356149 +0000 UTC m=+111.066437694" watchObservedRunningTime="2026-07-28 12:36:56.98080961 +0000 UTC m=+111.067891152" Jul 28 12:36:56.997997 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:56.997968 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:58.162006 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:58.161957 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:58.229794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:36:58.229759 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:00.957805 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:00.957769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} Jul 28 12:37:00.958175 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:00.957838 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} Jul 28 12:37:03.972984 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:03.972952 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} Jul 28 12:37:03.973415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:03.973017 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} Jul 28 12:37:03.973415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:03.973044 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} Jul 28 12:37:03.973415 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:03.973096 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerStarted","Data":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} Jul 28 12:37:03.985010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:03.984978 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:37:04.001543 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:04.001490 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.66669296 podStartE2EDuration="11.001467947s" totalImagesPullingTime="8.309344263s" totalInitContainerRuntime="25.430724ms" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:37:04.000186437 +0000 UTC m=+118.087267997" watchObservedRunningTime="2026-07-28 12:37:04.001467947 +0000 UTC m=+118.088549491" Jul 28 12:37:04.118936 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:04.118906 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:04.220390 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:04.220358 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:05.044891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:05.044858 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:05.115196 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:05.115163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:09.187796 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:09.187746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:09.288603 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:09.288573 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:09.363595 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:09.363563 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:11.903636 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:11.903599 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:11.966322 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:11.966285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:17.022611 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:17.022576 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fbc7905-79fa-42fb-a11c-6d569c83d68a" containerID="b3e88368c0e763e95403a2bafdc741d3176e40898d85ab4e831f053ca802099d" exitCode=0 Jul 28 12:37:17.022987 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:17.022654 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" event={"ID":"6fbc7905-79fa-42fb-a11c-6d569c83d68a","Type":"ContainerDied","Data":"b3e88368c0e763e95403a2bafdc741d3176e40898d85ab4e831f053ca802099d"} Jul 28 12:37:17.023046 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:17.023032 2560 scope.go:117] "RemoveContainer" containerID="b3e88368c0e763e95403a2bafdc741d3176e40898d85ab4e831f053ca802099d" Jul 28 12:37:18.032532 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:18.032492 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-t5qbr" event={"ID":"6fbc7905-79fa-42fb-a11c-6d569c83d68a","Type":"ContainerStarted","Data":"dd71357c0e46237bdfd99fc89baf0f5ff97018c04ffc14266408cde11620e461"} Jul 28 12:37:18.151997 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:18.151967 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9qfk_111d9174-0d98-44a5-9c45-f680f4ac3905/serve-healthcheck-canary/0.log" Jul 28 12:37:20.100241 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:20.100184 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:20.201374 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:20.201343 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:20.417151 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:20.417069 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:37.708035 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:37.708004 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:37.783607 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:37.783555 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:53.984966 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:53.984910 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:37:54.003560 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:54.003530 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:37:54.187724 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:37:54.187692 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:03.473892 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:03.473812 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:03.554824 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:03.554790 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:11.946807 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.946774 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:38:11.947427 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.947073 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="prometheus" containerID="cri-o://f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" gracePeriod=600 Jul 28 12:38:11.947427 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.947102 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="thanos-sidecar" containerID="cri-o://b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" gracePeriod=600 Jul 28 12:38:11.947427 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.947160 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="config-reloader" containerID="cri-o://f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" gracePeriod=600 Jul 28 12:38:11.947427 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.947118 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy" containerID="cri-o://3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" gracePeriod=600 Jul 28 12:38:11.947427 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.947289 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-web" containerID="cri-o://0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" gracePeriod=600 Jul 28 12:38:11.947699 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:11.947445 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" gracePeriod=600 Jul 28 12:38:12.183855 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.183831 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245611 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" exitCode=0 Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245638 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" exitCode=0 Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245646 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" exitCode=0 Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245654 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" exitCode=0 Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245662 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" exitCode=0 Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245669 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" exitCode=0 Jul 28 12:38:12.245692 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245686 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245697 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245805 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245842 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245887 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} Jul 28 12:38:12.246088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.245910 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bfc3f3f-90c4-4ca0-b48e-44360af514b0","Type":"ContainerDied","Data":"bd48b54bab30dc35202bbc062a81cf2c0705dae9cc0f83b615d7676f94ea21c0"} Jul 28 12:38:12.253488 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.253467 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.260136 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.260121 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.266637 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.266621 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.272871 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.272855 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.279313 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.279292 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.281327 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281312 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config-out\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281411 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281363 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281411 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281381 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-tls-assets\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281411 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281406 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281422 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-trusted-ca-bundle\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281442 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-1\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281476 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-0\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281511 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-metrics-client-ca\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281540 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-thanos-prometheus-http-client-file\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281575 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281573 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-grpc-tls\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281868 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281597 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-2\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281868 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281623 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd58g\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-kube-api-access-nd58g\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.281971 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.281909 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.282028 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282005 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-serving-certs-ca-bundle\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282028 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282005 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.282131 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282041 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-kubelet-serving-ca-bundle\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282131 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282106 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-kube-rbac-proxy\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282267 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282137 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-db\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282267 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282169 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-tls\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282267 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282192 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.282421 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282195 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-metrics-client-certs\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282421 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282395 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.282421 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282405 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282571 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282432 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-web-config\") pod \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\" (UID: \"9bfc3f3f-90c4-4ca0-b48e-44360af514b0\") " Jul 28 12:38:12.282733 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282707 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-metrics-client-ca\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.282837 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282735 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.282837 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282752 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.282837 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.282766 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.284085 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.283685 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.284085 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.283981 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.284536 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.284510 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:12.284892 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.284868 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:38:12.286015 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.285906 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config" (OuterVolumeSpecName: "config") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.286015 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.285965 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.286363 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.286315 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:38:12.286559 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.286517 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config-out" (OuterVolumeSpecName: "config-out") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:38:12.286849 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.286824 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.287023 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.287000 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-kube-api-access-nd58g" (OuterVolumeSpecName: "kube-api-access-nd58g") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "kube-api-access-nd58g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:38:12.287201 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.287178 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.287521 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.287493 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.287521 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.287504 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.287639 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.287555 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.287639 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.287614 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.288695 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.288680 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.296586 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.296570 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.296863 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.296847 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.296932 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.296874 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} err="failed to get container status \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" Jul 28 12:38:12.296932 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.296900 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.297165 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.297142 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.297200 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297176 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} err="failed to get container status \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" Jul 28 12:38:12.297282 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297201 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.297468 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.297451 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.297511 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297474 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} err="failed to get container status \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" Jul 28 12:38:12.297511 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297491 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.297727 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.297710 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.297777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297732 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} err="failed to get container status \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" Jul 28 12:38:12.297777 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297750 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.297852 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297827 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-web-config" (OuterVolumeSpecName: "web-config") pod "9bfc3f3f-90c4-4ca0-b48e-44360af514b0" (UID: "9bfc3f3f-90c4-4ca0-b48e-44360af514b0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:12.297936 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.297921 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.297976 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297939 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} err="failed to get container status \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" Jul 28 12:38:12.297976 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.297956 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.298181 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.298163 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.298321 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298183 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} err="failed to get container status \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" Jul 28 12:38:12.298321 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298196 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.298465 ip-10-0-129-244 kubenswrapper[2560]: E0728 12:38:12.298444 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.298498 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298460 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} err="failed to get container status \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" Jul 28 12:38:12.298498 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298476 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.298684 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298662 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} err="failed to get container status \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" Jul 28 12:38:12.298684 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298683 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.298874 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298858 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} err="failed to get container status \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" Jul 28 12:38:12.298920 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.298876 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.299057 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299042 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} err="failed to get container status \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" Jul 28 12:38:12.299094 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299057 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.299289 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299272 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} err="failed to get container status \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" Jul 28 12:38:12.299349 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299289 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.299478 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299460 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} err="failed to get container status \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" Jul 28 12:38:12.299517 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299478 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.299678 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299659 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} err="failed to get container status \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" Jul 28 12:38:12.299678 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299678 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.299898 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299879 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} err="failed to get container status \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" Jul 28 12:38:12.299941 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.299899 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.300066 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300051 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} err="failed to get container status \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" Jul 28 12:38:12.300108 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300068 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.300235 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300204 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} err="failed to get container status \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" Jul 28 12:38:12.300273 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300236 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.300446 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300428 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} err="failed to get container status \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" Jul 28 12:38:12.300501 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300445 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.300602 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300587 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} err="failed to get container status \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" Jul 28 12:38:12.300644 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300602 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.300794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300778 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} err="failed to get container status \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" Jul 28 12:38:12.300842 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300794 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.300993 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300975 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} err="failed to get container status \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" Jul 28 12:38:12.301035 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.300994 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.301163 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301149 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} err="failed to get container status \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" Jul 28 12:38:12.301202 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301163 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.301406 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301389 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} err="failed to get container status \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" Jul 28 12:38:12.301447 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301405 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.301589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301573 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} err="failed to get container status \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" Jul 28 12:38:12.301589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301588 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.301760 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301744 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} err="failed to get container status \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" Jul 28 12:38:12.301760 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301760 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.301975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301959 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} err="failed to get container status \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" Jul 28 12:38:12.302021 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.301977 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.302199 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302180 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} err="failed to get container status \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" Jul 28 12:38:12.302275 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302201 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.302401 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302386 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} err="failed to get container status \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" Jul 28 12:38:12.302443 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302402 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.302623 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302604 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} err="failed to get container status \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" Jul 28 12:38:12.302672 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302624 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.302809 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302795 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} err="failed to get container status \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" Jul 28 12:38:12.302852 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302809 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.302990 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302974 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} err="failed to get container status \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" Jul 28 12:38:12.303026 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.302992 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.303166 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303150 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} err="failed to get container status \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" Jul 28 12:38:12.303231 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303166 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.303398 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303375 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} err="failed to get container status \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" Jul 28 12:38:12.303398 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303391 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.303584 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303567 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} err="failed to get container status \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" Jul 28 12:38:12.303643 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303585 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.303802 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303779 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} err="failed to get container status \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" Jul 28 12:38:12.303802 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303793 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.303969 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303954 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} err="failed to get container status \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" Jul 28 12:38:12.304010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.303970 2560 scope.go:117] "RemoveContainer" containerID="508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3" Jul 28 12:38:12.304147 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304133 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3"} err="failed to get container status \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": rpc error: code = NotFound desc = could not find container \"508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3\": container with ID starting with 508a6129889b0af75b4d002e5983acd85524a52ea73fd40cd3ece00b127f0de3 not found: ID does not exist" Jul 28 12:38:12.304185 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304149 2560 scope.go:117] "RemoveContainer" containerID="3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef" Jul 28 12:38:12.304396 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304381 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef"} err="failed to get container status \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": rpc error: code = NotFound desc = could not find container \"3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef\": container with ID starting with 3a7282abcd9b4b40352444d4a3030611edf0bb71d1d18a372152591ca76c15ef not found: ID does not exist" Jul 28 12:38:12.304441 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304396 2560 scope.go:117] "RemoveContainer" containerID="0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16" Jul 28 12:38:12.304581 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304566 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16"} err="failed to get container status \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": rpc error: code = NotFound desc = could not find container \"0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16\": container with ID starting with 0a60e1486d9673dee3aef036519eddd629995e4a62053fe9adf063f79c69ca16 not found: ID does not exist" Jul 28 12:38:12.304622 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304582 2560 scope.go:117] "RemoveContainer" containerID="b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97" Jul 28 12:38:12.304781 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304767 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97"} err="failed to get container status \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": rpc error: code = NotFound desc = could not find container \"b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97\": container with ID starting with b9439ed0248c9367738692c4e1527d64923d53ddd6f95e096296d792e3670e97 not found: ID does not exist" Jul 28 12:38:12.304781 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304780 2560 scope.go:117] "RemoveContainer" containerID="f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb" Jul 28 12:38:12.304934 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304920 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb"} err="failed to get container status \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": rpc error: code = NotFound desc = could not find container \"f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb\": container with ID starting with f1985c24e681df1dac474f338a816f3607e8315ca1120b98e22e16ac3c1c49eb not found: ID does not exist" Jul 28 12:38:12.304979 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.304934 2560 scope.go:117] "RemoveContainer" containerID="f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25" Jul 28 12:38:12.305127 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.305114 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25"} err="failed to get container status \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": rpc error: code = NotFound desc = could not find container \"f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25\": container with ID starting with f63fe1e21f9c032cfd6a158800ccba1179beb33c50bc05d1cc88a9b5f5d46c25 not found: ID does not exist" Jul 28 12:38:12.305171 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.305127 2560 scope.go:117] "RemoveContainer" containerID="3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1" Jul 28 12:38:12.305342 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.305325 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1"} err="failed to get container status \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": rpc error: code = NotFound desc = could not find container \"3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1\": container with ID starting with 3f0215f1311a6d9ec9ea0354002f1997b853b60425fd2f16822bdd64e1e0d3b1 not found: ID does not exist" Jul 28 12:38:12.383115 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383086 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383115 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383113 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383123 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383135 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-grpc-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383144 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd58g\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-kube-api-access-nd58g\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383155 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383165 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383174 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-kube-rbac-proxy\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383182 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-prometheus-k8s-db\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383190 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383199 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-metrics-client-certs\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383229 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383238 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-web-config\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383246 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-config-out\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383254 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.383305 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.383261 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bfc3f3f-90c4-4ca0-b48e-44360af514b0-tls-assets\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 12:38:12.563967 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.563894 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:38:12.568527 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.568501 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:38:12.595623 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595595 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:38:12.595851 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595839 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-web" Jul 28 12:38:12.595891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595853 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-web" Jul 28 12:38:12.595891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595862 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-thanos" Jul 28 12:38:12.595891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595868 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-thanos" Jul 28 12:38:12.595891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595880 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="config-reloader" Jul 28 12:38:12.595891 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595885 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="config-reloader" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595896 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="init-config-reloader" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595902 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="init-config-reloader" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595910 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="thanos-sidecar" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595915 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="thanos-sidecar" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595921 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595926 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595937 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="prometheus" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595942 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="prometheus" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595981 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="thanos-sidecar" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595987 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-web" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595992 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.595997 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="kube-rbac-proxy-thanos" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.596002 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="prometheus" Jul 28 12:38:12.596039 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.596009 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" containerName="config-reloader" Jul 28 12:38:12.601078 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.601061 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.603332 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603306 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 12:38:12.603457 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603358 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2dnregce3a8pt\"" Jul 28 12:38:12.603457 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603386 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 12:38:12.603588 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603458 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wcg9k\"" Jul 28 12:38:12.603588 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603492 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 12:38:12.603588 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603529 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 12:38:12.603903 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 12:38:12.603903 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603782 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 12:38:12.603903 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603793 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 12:38:12.603903 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.603819 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 12:38:12.604130 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.604081 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 12:38:12.604130 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.604087 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 12:38:12.604390 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.604373 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 12:38:12.604485 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.604437 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 12:38:12.604760 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.604743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 12:38:12.607201 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.607178 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 12:38:12.609750 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.609725 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 12:38:12.614755 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.614737 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:38:12.685983 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.685941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.685983 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.685987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/482781ab-8936-4da2-82a0-a266ea6aeb16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686257 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4w8p\" (UniqueName: \"kubernetes.io/projected/482781ab-8936-4da2-82a0-a266ea6aeb16-kube-api-access-j4w8p\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-config\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/482781ab-8936-4da2-82a0-a266ea6aeb16-config-out\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686449 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-web-config\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686776 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.686776 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.686609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787088 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/482781ab-8936-4da2-82a0-a266ea6aeb16-config-out\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787265 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787265 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787265 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787381 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787275 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-web-config\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.787734 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787740 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787917 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/482781ab-8936-4da2-82a0-a266ea6aeb16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788010 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.787985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788424 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.788020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.788424 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.788394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.790653 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.789001 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.790653 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.790111 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/482781ab-8936-4da2-82a0-a266ea6aeb16-config-out\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.790653 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.790536 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791187 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791324 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.788064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4w8p\" (UniqueName: \"kubernetes.io/projected/482781ab-8936-4da2-82a0-a266ea6aeb16-kube-api-access-j4w8p\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-config\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791636 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.791789 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.792121 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.792193 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.792975 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.792601 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/482781ab-8936-4da2-82a0-a266ea6aeb16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.793785 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.793758 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-web-config\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.794346 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.794279 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.794346 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.794301 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/482781ab-8936-4da2-82a0-a266ea6aeb16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.797181 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.794817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.797181 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.794875 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.797181 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.795082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-config\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.797181 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.795955 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/482781ab-8936-4da2-82a0-a266ea6aeb16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.797181 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.796799 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4w8p\" (UniqueName: \"kubernetes.io/projected/482781ab-8936-4da2-82a0-a266ea6aeb16-kube-api-access-j4w8p\") pod \"prometheus-k8s-0\" (UID: \"482781ab-8936-4da2-82a0-a266ea6aeb16\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:12.911076 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:12.910983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:13.055639 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:13.055537 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 12:38:13.058189 ip-10-0-129-244 kubenswrapper[2560]: W0728 12:38:13.058161 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482781ab_8936_4da2_82a0_a266ea6aeb16.slice/crio-88d1c8adcf7f120fbe2844d3cd2707653374fbbc315ed7745768fc270dd0701e WatchSource:0}: Error finding container 88d1c8adcf7f120fbe2844d3cd2707653374fbbc315ed7745768fc270dd0701e: Status 404 returned error can't find the container with id 88d1c8adcf7f120fbe2844d3cd2707653374fbbc315ed7745768fc270dd0701e Jul 28 12:38:13.251569 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:13.251533 2560 generic.go:356] "Generic (PLEG): container finished" podID="482781ab-8936-4da2-82a0-a266ea6aeb16" containerID="611066bf3d10d63d1d82d21899967e2e50025206ec18182c73269939475a214a" exitCode=0 Jul 28 12:38:13.251717 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:13.251595 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerDied","Data":"611066bf3d10d63d1d82d21899967e2e50025206ec18182c73269939475a214a"} Jul 28 12:38:13.251717 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:13.251645 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"88d1c8adcf7f120fbe2844d3cd2707653374fbbc315ed7745768fc270dd0701e"} Jul 28 12:38:13.991172 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:13.991142 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:14.053105 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.053070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:14.259278 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.259159 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"e9c7e9e368f40d7c7ae6198440a5b4e2d2c37f4a507815043bf82c6cda29644c"} Jul 28 12:38:14.259278 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.259266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"4c28dabe75f0289e800836b87ce59a64bcefa0146b87e5665d8d08db6bbccf45"} Jul 28 12:38:14.259794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.259294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"92def1215258871e54b703d12bbb656e72ef514884a816cefa6aa0d8a08390c8"} Jul 28 12:38:14.259794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.259323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"804aaf3c9a7d30c82c248574052c15092cab1a0d2cfbe5abc9b17ad3844d3405"} Jul 28 12:38:14.259794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.259348 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"b588a4c31ca4d61760fda3731c92f1d58d45b01779fa82b22729af286ee301c7"} Jul 28 12:38:14.259794 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.259370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"482781ab-8936-4da2-82a0-a266ea6aeb16","Type":"ContainerStarted","Data":"83539bb8cbcbd9090c8a08890eb5e11a2e7bd3e33943a41cf22d4385ef6f3a77"} Jul 28 12:38:14.285709 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.285634 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.264344894 podStartE2EDuration="2.285615475s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.270581ms" isStatefulPod=false podCreationTimestamp="2026-07-28 12:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:38:14.285136463 +0000 UTC m=+188.372218008" watchObservedRunningTime="2026-07-28 12:38:14.285615475 +0000 UTC m=+188.372697011" Jul 28 12:38:14.338753 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:14.338717 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bfc3f3f-90c4-4ca0-b48e-44360af514b0" path="/var/lib/kubelet/pods/9bfc3f3f-90c4-4ca0-b48e-44360af514b0/volumes" Jul 28 12:38:15.386365 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:15.386323 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:15.448867 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:15.448832 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:17.911424 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:17.911384 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:38:24.509468 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:24.509438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:24.609805 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:24.609776 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:24.709841 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:24.709808 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:26.917165 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:26.917129 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:27.018798 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:27.018761 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:27.081501 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:27.081472 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:29.294359 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:29.294326 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:48.326768 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:48.326738 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:48.432155 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:48.432129 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:51.513455 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:38:51.513423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:12.912052 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:39:12.912008 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:39:12.927095 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:39:12.927069 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:39:13.505137 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:39:13.505104 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 12:40:04.802330 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:40:04.802292 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:06.254585 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:40:06.250335 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 12:40:59.086950 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:40:59.086868 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:06.709312 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:06.709282 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:06.767358 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:06.767327 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:07.128625 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:07.128538 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:07.230012 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:07.229972 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:07.331991 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:07.331956 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:29.390570 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:29.390519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:29.502641 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:29.502591 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:36.372358 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:36.372321 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:36.675154 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:36.675055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:36.932018 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:36.931915 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:37.036454 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:37.036420 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:37.216599 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:37.216558 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:37.771192 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:37.771160 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:37.873872 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:37.873836 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:37.971046 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:37.971019 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:38.070636 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:38.070539 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:38.186640 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:38.186593 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:38.271396 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:41:38.271361 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:00.776674 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:00.776638 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:00.973481 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:00.973447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:01.153968 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:01.153886 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:01.456930 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:01.456890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:01.660391 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:01.660364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:11.721906 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:11.721850 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:11.778317 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:11.778285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:11.844226 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:11.844190 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:56.583109 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:56.583070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:56.664848 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:56.664816 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:56.727990 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:56.727952 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:56.828407 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:56.828372 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:57.229843 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:57.229807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:57.331062 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:42:57.331026 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:28.328447 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:43:28.328406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:55.526334 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:43:55.526297 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:55.590093 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:43:55.590058 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:04.040139 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:44:04.040055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:12.938599 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:44:12.938567 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.093468 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:44:13.093428 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.187041 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:44:13.187006 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.883612 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:44:13.883581 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.979250 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:44:13.979191 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:45:37.378852 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:45:37.378815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:45:46.861649 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:45:46.861591 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:45:46.962998 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:45:46.962951 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:46:00.448162 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:46:00.448126 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:46:00.588173 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:46:00.588135 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:46:00.755038 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:46:00.754945 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:46:01.981589 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:46:01.981559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:30.566377 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:30.566333 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:30.907616 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:30.907508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:40.886314 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:40.886275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:41.064714 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:41.064662 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:41.203819 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:41.203789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:41.288985 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:41.288942 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:41.404473 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:41.404430 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:41.527571 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:41.527488 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:47:41.630596 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:47:41.630565 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:10.561812 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:10.561779 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:10.920385 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:10.920303 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:20.706691 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:20.706649 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:20.789853 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:20.789812 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:20.882394 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:20.882356 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:20.948941 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:20.948894 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:21.018499 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:21.018415 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:21.565524 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:21.565495 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:21.791597 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:21.791563 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:41.122105 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:41.122019 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:48:41.242720 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:48:41.242690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:30.913051 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:49:30.913015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:31.390347 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:49:31.390314 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:50:10.667762 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:50:10.667724 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:50:23.578667 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:50:23.578631 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:51:43.658501 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:51:43.658410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:51:45.551103 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:51:45.551067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:54:39.678206 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:54:39.678109 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:56:35.674677 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:56:35.674641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:56:55.808872 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:56:55.808835 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:56:58.226613 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:56:58.226572 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:03.086635 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:03.086597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:45.627970 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:45.627887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:45.731351 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:45.731315 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:45.807957 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:45.807924 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:45.888988 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:45.888896 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:46.203616 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:46.203583 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:46.620064 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:46.619960 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:56.042510 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:56.042473 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:57:56.391322 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:57:56.391206 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:06.109870 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:06.109776 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:06.230147 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:06.230109 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:06.297566 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:06.297536 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:06.380721 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:06.380609 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:06.512566 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:06.512535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:06.745612 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:06.745577 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:45.794507 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:45.794469 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:46.217393 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:46.217361 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:48.254767 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:48.254729 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:49.167013 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:49.166981 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:55.897901 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:55.897853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:56.016438 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:56.016372 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:56.107730 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:56.107682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:56.181845 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:56.181748 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:56.337016 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:56.336984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:58:56.980848 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:58:56.980812 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:59:00.081170 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:59:00.081089 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:59:06.333987 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:59:06.333951 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 12:59:06.506097 ip-10-0-129-244 kubenswrapper[2560]: I0728 12:59:06.506061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:00:07.657313 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:00:07.657279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:00:07.751839 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:00:07.751801 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:01:32.268155 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:01:32.268114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:06:23.400773 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:06:23.400734 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.033549 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.033511 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.143877 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.143839 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.242510 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.242477 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.317836 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.317750 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.392664 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.392626 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.492068 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.492031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:07:21.592301 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:07:21.592220 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:20.741515 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:20.741467 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:20.816597 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:20.816567 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:20.916864 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:20.916831 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:21.016780 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.016699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:21.087078 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.087043 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:21.198523 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.198486 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:21.208950 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.208919 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p"] Jul 28 13:08:21.212025 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.212009 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.213722 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.213699 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-4b3a0-kube-rbac-proxy-sar-config\"" Jul 28 13:08:21.213854 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.213835 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-mdrhx\"" Jul 28 13:08:21.213910 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.213836 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 13:08:21.214083 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.214071 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-4b3a0-serving-cert\"" Jul 28 13:08:21.221536 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.221513 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p"] Jul 28 13:08:21.286609 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.286522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:21.329736 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.329703 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-openshift-service-ca-bundle\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.329872 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.329756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.430434 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.430398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-openshift-service-ca-bundle\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.430592 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.430448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.430592 ip-10-0-129-244 kubenswrapper[2560]: E0728 13:08:21.430559 2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-4b3a0-serving-cert: secret "splitter-graph-4b3a0-serving-cert" not found Jul 28 13:08:21.430666 ip-10-0-129-244 kubenswrapper[2560]: E0728 13:08:21.430615 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls podName:d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c nodeName:}" failed. No retries permitted until 2026-07-28 13:08:21.930597923 +0000 UTC m=+1996.017679444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls") pod "splitter-graph-4b3a0-85574dc76d-6696p" (UID: "d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c") : secret "splitter-graph-4b3a0-serving-cert" not found Jul 28 13:08:21.431069 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.431049 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-openshift-service-ca-bundle\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.738238 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.738186 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:21.936220 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.936188 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:21.938726 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:21.938697 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls\") pod \"splitter-graph-4b3a0-85574dc76d-6696p\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:22.121855 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:22.121764 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:22.250706 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:22.250632 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p"] Jul 28 13:08:22.254530 ip-10-0-129-244 kubenswrapper[2560]: W0728 13:08:22.254502 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7aeb751_3d59_45e0_b0b2_1c2b0fd0b45c.slice/crio-0d9c9f3f713cb202df4884a889be1038374c766cfe7ce0c241337b86b0c23165 WatchSource:0}: Error finding container 0d9c9f3f713cb202df4884a889be1038374c766cfe7ce0c241337b86b0c23165: Status 404 returned error can't find the container with id 0d9c9f3f713cb202df4884a889be1038374c766cfe7ce0c241337b86b0c23165 Jul 28 13:08:22.256850 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:22.256833 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:08:22.941367 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:22.941333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" event={"ID":"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c","Type":"ContainerStarted","Data":"0d9c9f3f713cb202df4884a889be1038374c766cfe7ce0c241337b86b0c23165"} Jul 28 13:08:24.950618 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:24.950582 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" event={"ID":"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c","Type":"ContainerStarted","Data":"19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b"} Jul 28 13:08:24.950992 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:24.950700 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:24.967749 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:24.967697 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podStartSLOduration=1.474312808 podStartE2EDuration="3.967682184s" totalImagesPullingTime="2.493369376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:08:24.966549067 +0000 UTC m=+1999.053630621" watchObservedRunningTime="2026-07-28 13:08:24.967682184 +0000 UTC m=+1999.054763727" Jul 28 13:08:30.960496 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:30.960465 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:31.299942 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.299853 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p"] Jul 28 13:08:31.300111 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.300043 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" containerID="cri-o://19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b" gracePeriod=30 Jul 28 13:08:31.321904 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.321863 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:31.431191 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.431138 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:31.510783 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.510731 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:31.592702 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.592596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:31.690045 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:31.689995 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:08:35.958293 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:35.958254 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:08:40.958597 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:40.958549 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:08:45.958584 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:45.958545 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:08:45.958993 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:45.958680 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:08:50.959081 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:50.959040 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:08:55.959044 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:08:55.959004 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:09:00.958792 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:00.958748 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:09:01.956078 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:01.956046 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:09:02.066940 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.066841 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-openshift-service-ca-bundle\") pod \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " Jul 28 13:09:02.066940 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.066902 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls\") pod \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\" (UID: \"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c\") " Jul 28 13:09:02.067378 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.067205 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" (UID: "d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:09:02.069136 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.069110 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" (UID: "d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:09:02.089865 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.089829 2560 generic.go:356] "Generic (PLEG): container finished" podID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerID="19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b" exitCode=0 Jul 28 13:09:02.090032 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.089871 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" Jul 28 13:09:02.090032 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.089894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" event={"ID":"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c","Type":"ContainerDied","Data":"19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b"} Jul 28 13:09:02.090032 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.089938 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p" event={"ID":"d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c","Type":"ContainerDied","Data":"0d9c9f3f713cb202df4884a889be1038374c766cfe7ce0c241337b86b0c23165"} Jul 28 13:09:02.090032 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.089959 2560 scope.go:117] "RemoveContainer" containerID="19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b" Jul 28 13:09:02.098566 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.098546 2560 scope.go:117] "RemoveContainer" containerID="19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b" Jul 28 13:09:02.098859 ip-10-0-129-244 kubenswrapper[2560]: E0728 13:09:02.098839 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b\": container with ID starting with 19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b not found: ID does not exist" containerID="19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b" Jul 28 13:09:02.098912 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.098868 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b"} err="failed to get container status \"19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b\": rpc error: code = NotFound desc = could not find container \"19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b\": container with ID starting with 19ccd015dbbbd27fda05a7d29faf60d3fe3514084a70ff0b298584ddcf98328b not found: ID does not exist" Jul 28 13:09:02.109772 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.109743 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p"] Jul 28 13:09:02.113050 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.113020 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b3a0-85574dc76d-6696p"] Jul 28 13:09:02.168109 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.168066 2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-openshift-service-ca-bundle\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 13:09:02.168109 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.168103 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c-proxy-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 13:09:02.338422 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:02.338339 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" path="/var/lib/kubelet/pods/d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c/volumes" Jul 28 13:09:20.968003 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.967961 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f"] Jul 28 13:09:20.968623 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.968467 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" Jul 28 13:09:20.968623 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.968487 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" Jul 28 13:09:20.968623 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.968583 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7aeb751-3d59-45e0-b0b2-1c2b0fd0b45c" containerName="splitter-graph-4b3a0" Jul 28 13:09:20.971507 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.971484 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:20.973500 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.973476 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-dde97-serving-cert\"" Jul 28 13:09:20.973663 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.973646 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-mdrhx\"" Jul 28 13:09:20.973748 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.973725 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-dde97-kube-rbac-proxy-sar-config\"" Jul 28 13:09:20.973948 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.973931 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 13:09:20.985999 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.985963 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f"] Jul 28 13:09:20.992097 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:20.992071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:09:21.126984 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.126941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fea4f5-204d-4fc4-b50e-82533c39e8ec-openshift-service-ca-bundle\") pod \"switch-graph-dde97-5c79545b7c-hs55f\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.127156 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.127069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89fea4f5-204d-4fc4-b50e-82533c39e8ec-proxy-tls\") pod \"switch-graph-dde97-5c79545b7c-hs55f\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.207456 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.207419 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:09:21.227794 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.227720 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fea4f5-204d-4fc4-b50e-82533c39e8ec-openshift-service-ca-bundle\") pod \"switch-graph-dde97-5c79545b7c-hs55f\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.227888 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.227810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89fea4f5-204d-4fc4-b50e-82533c39e8ec-proxy-tls\") pod \"switch-graph-dde97-5c79545b7c-hs55f\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.228406 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.228387 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fea4f5-204d-4fc4-b50e-82533c39e8ec-openshift-service-ca-bundle\") pod \"switch-graph-dde97-5c79545b7c-hs55f\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.230255 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.230237 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89fea4f5-204d-4fc4-b50e-82533c39e8ec-proxy-tls\") pod \"switch-graph-dde97-5c79545b7c-hs55f\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.286344 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.286310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:21.418032 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:21.417899 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f"] Jul 28 13:09:21.420891 ip-10-0-129-244 kubenswrapper[2560]: W0728 13:09:21.420853 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fea4f5_204d_4fc4_b50e_82533c39e8ec.slice/crio-9e3d655328e4dfe1b527a81060f78b8db088453ec7765581b7da04341f54f9ed WatchSource:0}: Error finding container 9e3d655328e4dfe1b527a81060f78b8db088453ec7765581b7da04341f54f9ed: Status 404 returned error can't find the container with id 9e3d655328e4dfe1b527a81060f78b8db088453ec7765581b7da04341f54f9ed Jul 28 13:09:22.169821 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:22.169783 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" event={"ID":"89fea4f5-204d-4fc4-b50e-82533c39e8ec","Type":"ContainerStarted","Data":"bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3"} Jul 28 13:09:22.170279 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:22.169834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" event={"ID":"89fea4f5-204d-4fc4-b50e-82533c39e8ec","Type":"ContainerStarted","Data":"9e3d655328e4dfe1b527a81060f78b8db088453ec7765581b7da04341f54f9ed"} Jul 28 13:09:22.170279 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:22.169878 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:22.187355 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:22.187297 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podStartSLOduration=2.187276214 podStartE2EDuration="2.187276214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:09:22.186393371 +0000 UTC m=+2056.273474914" watchObservedRunningTime="2026-07-28 13:09:22.187276214 +0000 UTC m=+2056.274357760" Jul 28 13:09:28.179190 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:28.179160 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:09:31.541003 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.540970 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z"] Jul 28 13:09:31.544296 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.544278 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.545924 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.545902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-13bf1-kube-rbac-proxy-sar-config\"" Jul 28 13:09:31.546049 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.545946 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-13bf1-serving-cert\"" Jul 28 13:09:31.547223 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.547183 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:09:31.553849 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.553817 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z"] Jul 28 13:09:31.718182 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.718148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af4104-cb55-4490-b09d-133abc0205b7-proxy-tls\") pod \"splitter-graph-13bf1-6d966d6b6b-lpb8z\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.718372 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.718189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af4104-cb55-4490-b09d-133abc0205b7-openshift-service-ca-bundle\") pod \"splitter-graph-13bf1-6d966d6b6b-lpb8z\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.819491 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.819398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af4104-cb55-4490-b09d-133abc0205b7-proxy-tls\") pod \"splitter-graph-13bf1-6d966d6b6b-lpb8z\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.819491 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.819447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af4104-cb55-4490-b09d-133abc0205b7-openshift-service-ca-bundle\") pod \"splitter-graph-13bf1-6d966d6b6b-lpb8z\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.820104 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.820076 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af4104-cb55-4490-b09d-133abc0205b7-openshift-service-ca-bundle\") pod \"splitter-graph-13bf1-6d966d6b6b-lpb8z\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.821954 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.821927 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af4104-cb55-4490-b09d-133abc0205b7-proxy-tls\") pod \"splitter-graph-13bf1-6d966d6b6b-lpb8z\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.822163 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.822146 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:09:31.855365 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.855323 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:31.982737 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:31.982706 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z"] Jul 28 13:09:31.987004 ip-10-0-129-244 kubenswrapper[2560]: W0728 13:09:31.986975 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56af4104_cb55_4490_b09d_133abc0205b7.slice/crio-b4c0345af089ce1aa2206f500fb46a6afb31965acd4f48859bc525ff806e4f54 WatchSource:0}: Error finding container b4c0345af089ce1aa2206f500fb46a6afb31965acd4f48859bc525ff806e4f54: Status 404 returned error can't find the container with id b4c0345af089ce1aa2206f500fb46a6afb31965acd4f48859bc525ff806e4f54 Jul 28 13:09:32.211123 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:32.211084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" event={"ID":"56af4104-cb55-4490-b09d-133abc0205b7","Type":"ContainerStarted","Data":"8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05"} Jul 28 13:09:32.211337 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:32.211139 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" event={"ID":"56af4104-cb55-4490-b09d-133abc0205b7","Type":"ContainerStarted","Data":"b4c0345af089ce1aa2206f500fb46a6afb31965acd4f48859bc525ff806e4f54"} Jul 28 13:09:32.211337 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:32.211240 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:32.226361 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:32.226314 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podStartSLOduration=1.226297435 podStartE2EDuration="1.226297435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:09:32.224907666 +0000 UTC m=+2066.311989208" watchObservedRunningTime="2026-07-28 13:09:32.226297435 +0000 UTC m=+2066.313378977" Jul 28 13:09:38.222257 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:38.222202 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:09:56.710799 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:09:56.710763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:14:00.978325 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:14:00.978244 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:14:02.555932 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:14:02.555887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:17:46.269838 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:46.269800 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z"] Jul 28 13:17:46.272474 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:46.270024 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" containerID="cri-o://8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05" gracePeriod=30 Jul 28 13:17:46.325630 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:46.325596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:17:46.420685 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:46.420652 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:17:46.520350 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:46.520267 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:17:48.219793 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:48.219751 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:17:53.219960 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:53.219919 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:17:58.220379 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:58.220340 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:17:58.220792 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:17:58.220468 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:18:03.219895 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:03.219852 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:18:08.219766 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:08.219722 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:18:13.219904 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:13.219863 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:18:16.411754 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.411725 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:18:16.559129 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.559036 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af4104-cb55-4490-b09d-133abc0205b7-openshift-service-ca-bundle\") pod \"56af4104-cb55-4490-b09d-133abc0205b7\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " Jul 28 13:18:16.559329 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.559134 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af4104-cb55-4490-b09d-133abc0205b7-proxy-tls\") pod \"56af4104-cb55-4490-b09d-133abc0205b7\" (UID: \"56af4104-cb55-4490-b09d-133abc0205b7\") " Jul 28 13:18:16.559496 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.559471 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56af4104-cb55-4490-b09d-133abc0205b7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "56af4104-cb55-4490-b09d-133abc0205b7" (UID: "56af4104-cb55-4490-b09d-133abc0205b7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:18:16.561098 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.561079 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56af4104-cb55-4490-b09d-133abc0205b7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "56af4104-cb55-4490-b09d-133abc0205b7" (UID: "56af4104-cb55-4490-b09d-133abc0205b7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:18:16.660224 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.660175 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af4104-cb55-4490-b09d-133abc0205b7-proxy-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 13:18:16.660224 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:16.660202 2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af4104-cb55-4490-b09d-133abc0205b7-openshift-service-ca-bundle\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 13:18:17.188685 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.188648 2560 generic.go:356] "Generic (PLEG): container finished" podID="56af4104-cb55-4490-b09d-133abc0205b7" containerID="8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05" exitCode=0 Jul 28 13:18:17.188959 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.188693 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" Jul 28 13:18:17.188959 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.188695 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" event={"ID":"56af4104-cb55-4490-b09d-133abc0205b7","Type":"ContainerDied","Data":"8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05"} Jul 28 13:18:17.188959 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.188764 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z" event={"ID":"56af4104-cb55-4490-b09d-133abc0205b7","Type":"ContainerDied","Data":"b4c0345af089ce1aa2206f500fb46a6afb31965acd4f48859bc525ff806e4f54"} Jul 28 13:18:17.188959 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.188796 2560 scope.go:117] "RemoveContainer" containerID="8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05" Jul 28 13:18:17.197527 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.197504 2560 scope.go:117] "RemoveContainer" containerID="8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05" Jul 28 13:18:17.197814 ip-10-0-129-244 kubenswrapper[2560]: E0728 13:18:17.197792 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05\": container with ID starting with 8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05 not found: ID does not exist" containerID="8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05" Jul 28 13:18:17.197869 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.197824 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05"} err="failed to get container status \"8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05\": rpc error: code = NotFound desc = could not find container \"8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05\": container with ID starting with 8b63e7eebdb2f44121c3d38536b170748af9bef91e05027c09df31e707d4dc05 not found: ID does not exist" Jul 28 13:18:17.212504 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.212482 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z"] Jul 28 13:18:17.216542 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:17.216522 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-13bf1-6d966d6b6b-lpb8z"] Jul 28 13:18:18.338347 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:18:18.338311 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56af4104-cb55-4490-b09d-133abc0205b7" path="/var/lib/kubelet/pods/56af4104-cb55-4490-b09d-133abc0205b7/volumes" Jul 28 13:20:58.231165 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:20:58.231134 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:23:51.108397 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:23:51.108359 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:25:40.272042 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:40.272011 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f"] Jul 28 13:25:40.272585 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:40.272229 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" containerID="cri-o://bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3" gracePeriod=30 Jul 28 13:25:40.326611 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:40.326566 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:25:40.412930 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:40.412894 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:25:40.474145 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:40.474113 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:25:42.162178 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:42.162145 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:25:42.265984 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:42.265946 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:25:43.178384 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:43.178342 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:25:48.177932 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:48.177888 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:25:53.178363 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:53.178316 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:25:53.178738 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:53.178428 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:25:58.126746 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:58.126711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:25:58.178342 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:58.178307 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:25:58.961372 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:58.961344 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:25:59.783335 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:25:59.783301 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:00.595111 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:00.595080 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:01.383583 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:01.383555 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:02.187661 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:02.187630 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:02.998184 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:02.998153 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:03.178425 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:03.178389 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:26:03.797719 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:03.797688 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:04.572906 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:04.572878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:05.352567 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:05.352531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:06.150884 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:06.150854 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:06.947826 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:06.947797 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:07.776831 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:07.776804 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:08.178385 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:08.178298 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:26:08.626495 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:08.626461 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-dde97-5c79545b7c-hs55f_89fea4f5-204d-4fc4-b50e-82533c39e8ec/switch-graph-dde97/0.log" Jul 28 13:26:10.411103 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.411082 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:26:10.486698 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.486660 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89fea4f5-204d-4fc4-b50e-82533c39e8ec-proxy-tls\") pod \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " Jul 28 13:26:10.486881 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.486783 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fea4f5-204d-4fc4-b50e-82533c39e8ec-openshift-service-ca-bundle\") pod \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\" (UID: \"89fea4f5-204d-4fc4-b50e-82533c39e8ec\") " Jul 28 13:26:10.487119 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.487093 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89fea4f5-204d-4fc4-b50e-82533c39e8ec-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "89fea4f5-204d-4fc4-b50e-82533c39e8ec" (UID: "89fea4f5-204d-4fc4-b50e-82533c39e8ec"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:26:10.488682 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.488665 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fea4f5-204d-4fc4-b50e-82533c39e8ec-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "89fea4f5-204d-4fc4-b50e-82533c39e8ec" (UID: "89fea4f5-204d-4fc4-b50e-82533c39e8ec"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:26:10.587462 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.587385 2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fea4f5-204d-4fc4-b50e-82533c39e8ec-openshift-service-ca-bundle\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 13:26:10.587462 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.587416 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89fea4f5-204d-4fc4-b50e-82533c39e8ec-proxy-tls\") on node \"ip-10-0-129-244.ec2.internal\" DevicePath \"\"" Jul 28 13:26:10.690087 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.690053 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:26:10.957964 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.957926 2560 generic.go:356] "Generic (PLEG): container finished" podID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerID="bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3" exitCode=0 Jul 28 13:26:10.958132 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.957975 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" Jul 28 13:26:10.958132 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.958011 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" event={"ID":"89fea4f5-204d-4fc4-b50e-82533c39e8ec","Type":"ContainerDied","Data":"bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3"} Jul 28 13:26:10.958132 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.958062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f" event={"ID":"89fea4f5-204d-4fc4-b50e-82533c39e8ec","Type":"ContainerDied","Data":"9e3d655328e4dfe1b527a81060f78b8db088453ec7765581b7da04341f54f9ed"} Jul 28 13:26:10.958132 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.958086 2560 scope.go:117] "RemoveContainer" containerID="bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3" Jul 28 13:26:10.966434 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.966416 2560 scope.go:117] "RemoveContainer" containerID="bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3" Jul 28 13:26:10.966706 ip-10-0-129-244 kubenswrapper[2560]: E0728 13:26:10.966686 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3\": container with ID starting with bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3 not found: ID does not exist" containerID="bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3" Jul 28 13:26:10.966753 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.966714 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3"} err="failed to get container status \"bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3\": rpc error: code = NotFound desc = could not find container \"bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3\": container with ID starting with bb53527c936f845bd4e313ad55d271d1b8a37c4f144b2d6a6e7ca5a16a449ef3 not found: ID does not exist" Jul 28 13:26:10.977055 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.977026 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f"] Jul 28 13:26:10.981232 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:10.980118 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-dde97-5c79545b7c-hs55f"] Jul 28 13:26:11.903627 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903592 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jls2/must-gather-gsx5s"] Jul 28 13:26:11.903997 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903907 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" Jul 28 13:26:11.903997 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903917 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" Jul 28 13:26:11.903997 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903934 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" Jul 28 13:26:11.903997 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903939 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" Jul 28 13:26:11.903997 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903990 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" containerName="switch-graph-dde97" Jul 28 13:26:11.903997 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.903997 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56af4104-cb55-4490-b09d-133abc0205b7" containerName="splitter-graph-13bf1" Jul 28 13:26:11.908303 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.908287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:11.910295 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.910265 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jls2\"/\"openshift-service-ca.crt\"" Jul 28 13:26:11.910406 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.910327 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jls2\"/\"kube-root-ca.crt\"" Jul 28 13:26:11.910722 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.910709 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6jls2\"/\"default-dockercfg-gtdpd\"" Jul 28 13:26:11.914002 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.913981 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jls2/must-gather-gsx5s"] Jul 28 13:26:11.999969 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:11.999930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bfc3ce66-d533-4e61-a218-b0a9cb6c1d11-must-gather-output\") pod \"must-gather-gsx5s\" (UID: \"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11\") " pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.000141 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.000004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q77dx\" (UniqueName: \"kubernetes.io/projected/bfc3ce66-d533-4e61-a218-b0a9cb6c1d11-kube-api-access-q77dx\") pod \"must-gather-gsx5s\" (UID: \"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11\") " pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.100527 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.100496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bfc3ce66-d533-4e61-a218-b0a9cb6c1d11-must-gather-output\") pod \"must-gather-gsx5s\" (UID: \"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11\") " pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.100693 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.100557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77dx\" (UniqueName: \"kubernetes.io/projected/bfc3ce66-d533-4e61-a218-b0a9cb6c1d11-kube-api-access-q77dx\") pod \"must-gather-gsx5s\" (UID: \"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11\") " pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.100878 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.100857 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bfc3ce66-d533-4e61-a218-b0a9cb6c1d11-must-gather-output\") pod \"must-gather-gsx5s\" (UID: \"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11\") " pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.108255 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.108225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q77dx\" (UniqueName: \"kubernetes.io/projected/bfc3ce66-d533-4e61-a218-b0a9cb6c1d11-kube-api-access-q77dx\") pod \"must-gather-gsx5s\" (UID: \"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11\") " pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.218805 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.218765 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jls2/must-gather-gsx5s" Jul 28 13:26:12.338639 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.338606 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89fea4f5-204d-4fc4-b50e-82533c39e8ec" path="/var/lib/kubelet/pods/89fea4f5-204d-4fc4-b50e-82533c39e8ec/volumes" Jul 28 13:26:12.349382 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.349354 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jls2/must-gather-gsx5s"] Jul 28 13:26:12.352460 ip-10-0-129-244 kubenswrapper[2560]: W0728 13:26:12.352430 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfc3ce66_d533_4e61_a218_b0a9cb6c1d11.slice/crio-334602e3cb6f90aa7bb92a8fa5c829c0ad8e0a24497950f5c378d266496fba49 WatchSource:0}: Error finding container 334602e3cb6f90aa7bb92a8fa5c829c0ad8e0a24497950f5c378d266496fba49: Status 404 returned error can't find the container with id 334602e3cb6f90aa7bb92a8fa5c829c0ad8e0a24497950f5c378d266496fba49 Jul 28 13:26:12.354272 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.354254 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:26:12.601859 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.601784 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:26:12.966751 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:12.966713 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jls2/must-gather-gsx5s" event={"ID":"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11","Type":"ContainerStarted","Data":"334602e3cb6f90aa7bb92a8fa5c829c0ad8e0a24497950f5c378d266496fba49"} Jul 28 13:26:13.975978 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:13.975156 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jls2/must-gather-gsx5s" event={"ID":"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11","Type":"ContainerStarted","Data":"f659a20a5bb65c5444631ccd3504d8486f12dd3b39777735beb8c157b8e06e0f"} Jul 28 13:26:13.975978 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:13.975236 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jls2/must-gather-gsx5s" event={"ID":"bfc3ce66-d533-4e61-a218-b0a9cb6c1d11","Type":"ContainerStarted","Data":"e85740fdf4ea02b427764a04bace7e645bc7553c35c3fdaf156e266e8c2bf932"} Jul 28 13:26:13.990303 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:13.990161 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jls2/must-gather-gsx5s" podStartSLOduration=1.755773944 podStartE2EDuration="2.990143334s" totalImagesPullingTime="1.23436939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:26:13.989616365 +0000 UTC m=+3068.076697909" watchObservedRunningTime="2026-07-28 13:26:13.990143334 +0000 UTC m=+3068.077224877" Jul 28 13:26:15.064841 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:15.064811 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-prj57_dcfa1c56-ff1b-43e4-9d62-8e8e51b31507/global-pull-secret-syncer/0.log" Jul 28 13:26:15.104730 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:15.104675 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" Jul 28 13:26:15.205025 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:15.204995 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-244.ec2.internal_43a980200e7c460c93c1cfd19f9e4b64/haproxy/0.log" Jul 28 13:26:17.475905 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:17.475854 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:26:17.555094 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:17.555031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p6gt_f3ef614b-8c91-4bfa-8968-40b13eded54d/konnectivity-agent/0.log" limit=1024 Jul 28 13:26:19.459393 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.459360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-4hts4_672c2eb2-7461-4d09-a6b1-b5f019366237/monitoring-plugin/0.log" Jul 28 13:26:19.577410 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.577378 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfnjh_fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1/node-exporter/0.log" Jul 28 13:26:19.613867 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.613838 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfnjh_fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1/kube-rbac-proxy/0.log" Jul 28 13:26:19.635194 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.635093 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfnjh_fed97e5c-eb11-4ae1-aafc-06b6a93a5ff1/init-textfile/0.log" Jul 28 13:26:19.736570 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.736533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gvdst_2b2e188f-40ad-4cb6-81fa-4bbd5bf50067/kube-rbac-proxy-main/0.log" Jul 28 13:26:19.758579 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.758549 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gvdst_2b2e188f-40ad-4cb6-81fa-4bbd5bf50067/kube-rbac-proxy-self/0.log" Jul 28 13:26:19.782780 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.782725 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gvdst_2b2e188f-40ad-4cb6-81fa-4bbd5bf50067/openshift-state-metrics/0.log" Jul 28 13:26:19.824638 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.824605 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/prometheus/0.log" Jul 28 13:26:19.847349 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.847325 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/config-reloader/0.log" Jul 28 13:26:19.872562 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.872533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/thanos-sidecar/0.log" Jul 28 13:26:19.905051 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.905015 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/kube-rbac-proxy-web/0.log" Jul 28 13:26:19.926484 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.926439 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/kube-rbac-proxy/0.log" Jul 28 13:26:19.953065 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.953027 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/kube-rbac-proxy-thanos/0.log" Jul 28 13:26:19.977015 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:19.976983 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_482781ab-8936-4da2-82a0-a266ea6aeb16/init-config-reloader/0.log" Jul 28 13:26:20.091390 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:20.091276 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7575f9d5-tfj9j_b17d37f8-d9f8-4e05-9231-7ff7134aa2b8/telemeter-client/0.log" Jul 28 13:26:20.115676 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:20.115648 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7575f9d5-tfj9j_b17d37f8-d9f8-4e05-9231-7ff7134aa2b8/reload/0.log" Jul 28 13:26:20.142907 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:20.142879 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7575f9d5-tfj9j_b17d37f8-d9f8-4e05-9231-7ff7134aa2b8/kube-rbac-proxy/0.log" Jul 28 13:26:21.573829 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:21.573798 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-f886z_adc29358-31a2-4f0f-b099-6ef5e959f176/networking-console-plugin/0.log" Jul 28 13:26:23.531088 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.531049 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk"] Jul 28 13:26:23.536986 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.536958 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.544322 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.544295 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk"] Jul 28 13:26:23.612326 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.612287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-proc\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.612527 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.612355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-sys\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.612527 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.612404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-podres\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.612527 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.612437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-lib-modules\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.612527 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.612496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrhjf\" (UniqueName: \"kubernetes.io/projected/1cb1fe41-f45b-44ed-b368-78a1310c876c-kube-api-access-zrhjf\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713340 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-proc\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713529 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-sys\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713592 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713510 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-podres\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713592 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-lib-modules\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713692 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713451 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-sys\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713692 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713303 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-proc\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713796 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713762 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-lib-modules\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713851 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713772 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cb1fe41-f45b-44ed-b368-78a1310c876c-podres\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.713851 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.713793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrhjf\" (UniqueName: \"kubernetes.io/projected/1cb1fe41-f45b-44ed-b368-78a1310c876c-kube-api-access-zrhjf\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.722636 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.722599 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrhjf\" (UniqueName: \"kubernetes.io/projected/1cb1fe41-f45b-44ed-b368-78a1310c876c-kube-api-access-zrhjf\") pod \"perf-node-gather-daemonset-kz4hk\" (UID: \"1cb1fe41-f45b-44ed-b368-78a1310c876c\") " pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:23.850805 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:23.850726 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:24.023432 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:24.023307 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk"] Jul 28 13:26:24.181913 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:24.181885 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-shcxk_e8352141-ea47-45dd-a409-3719c896c28f/dns/0.log" Jul 28 13:26:24.203424 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:24.203397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-shcxk_e8352141-ea47-45dd-a409-3719c896c28f/kube-rbac-proxy/0.log" Jul 28 13:26:24.274127 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:24.274097 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vzxth_f83edffb-8dbc-40b4-8dfd-fde591190296/dns-node-resolver/0.log" Jul 28 13:26:24.807980 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:24.807945 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r96dr_ace93791-38ec-4326-98b3-10ea850ef171/node-ca/0.log" Jul 28 13:26:25.037787 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:25.037738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" event={"ID":"1cb1fe41-f45b-44ed-b368-78a1310c876c","Type":"ContainerStarted","Data":"0d1057bb7f0f28a25d223e5d90f558eebd0c30190713057fee1fe400f2aaf6c2"} Jul 28 13:26:25.037988 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:25.037815 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" event={"ID":"1cb1fe41-f45b-44ed-b368-78a1310c876c","Type":"ContainerStarted","Data":"7c82be1814a574bb8dfe7255275a386905594081f2403de3e589ffad8738b0b7"} Jul 28 13:26:25.038698 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:25.038669 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:25.052670 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:25.052614 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" podStartSLOduration=2.052593713 podStartE2EDuration="2.052593713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:26:25.052082173 +0000 UTC m=+3079.139163715" watchObservedRunningTime="2026-07-28 13:26:25.052593713 +0000 UTC m=+3079.139675269" Jul 28 13:26:25.966582 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:25.966552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9qfk_111d9174-0d98-44a5-9c45-f680f4ac3905/serve-healthcheck-canary/0.log" Jul 28 13:26:26.320099 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:26.320022 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-t5qbr_6fbc7905-79fa-42fb-a11c-6d569c83d68a/insights-operator/0.log" Jul 28 13:26:26.320956 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:26.320933 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-t5qbr_6fbc7905-79fa-42fb-a11c-6d569c83d68a/insights-operator/1.log" Jul 28 13:26:26.499550 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:26.499520 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xb7cm_0016e495-949b-4bb0-a310-318d4e5c1ca3/kube-rbac-proxy/0.log" Jul 28 13:26:26.546457 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:26.546422 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xb7cm_0016e495-949b-4bb0-a310-318d4e5c1ca3/exporter/0.log" Jul 28 13:26:26.574609 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:26.574533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xb7cm_0016e495-949b-4bb0-a310-318d4e5c1ca3/extractor/0.log" Jul 28 13:26:32.057799 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:32.057766 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6jls2/perf-node-gather-daemonset-kz4hk" Jul 28 13:26:34.550547 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.550525 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/kube-multus-additional-cni-plugins/0.log" Jul 28 13:26:34.574226 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.574187 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/egress-router-binary-copy/0.log" Jul 28 13:26:34.596176 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.596148 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/cni-plugins/0.log" Jul 28 13:26:34.622170 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.622095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/bond-cni-plugin/0.log" Jul 28 13:26:34.644409 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.644383 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/routeoverride-cni/0.log" Jul 28 13:26:34.670344 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.670321 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/whereabouts-cni-bincopy/0.log" Jul 28 13:26:34.695366 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.695339 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8f5j_68d5c145-a34e-4fa6-84f1-b9ad45205542/whereabouts-cni/0.log" Jul 28 13:26:34.730580 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.730550 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rpgqh_777b0c3a-9df3-4f8d-8d93-6ee00437ede8/kube-multus/0.log" Jul 28 13:26:34.872602 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.872537 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jzh5z_1d41a0a1-9fcf-4c97-9390-6d7b3189ea49/network-metrics-daemon/0.log" Jul 28 13:26:34.893326 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:34.893293 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jzh5z_1d41a0a1-9fcf-4c97-9390-6d7b3189ea49/kube-rbac-proxy/0.log" Jul 28 13:26:36.100958 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.100892 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/ovn-controller/0.log" Jul 28 13:26:36.118951 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.118927 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/ovn-acl-logging/0.log" Jul 28 13:26:36.141600 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.141548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/kube-rbac-proxy-node/0.log" Jul 28 13:26:36.164419 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.164391 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 13:26:36.183637 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.183606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/northd/0.log" Jul 28 13:26:36.204355 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.204328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/nbdb/0.log" Jul 28 13:26:36.224753 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.224733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/sbdb/0.log" Jul 28 13:26:36.266256 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:36.266231 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjrpn_a63d41de-ea8f-4134-be3f-05e536246a8b/ovnkube-controller/0.log" Jul 28 13:26:37.288485 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:37.288457 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-kjsff_c77f525f-fa1a-42f4-96df-1a79c81b5c5f/check-endpoints/0.log" Jul 28 13:26:37.369060 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:37.369025 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ltz6v_8efe9764-90be-4fc8-a84f-e4d583acf315/network-check-target-container/0.log" Jul 28 13:26:38.314051 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:38.314020 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-s72w9_a19de1b1-4d5d-42e1-81b8-2eeea422af77/iptables-alerter/0.log" Jul 28 13:26:38.978001 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:38.977973 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gbtcz_0751881b-31a6-4d51-a0c1-97ee66b1774c/tuned/0.log" Jul 28 13:26:40.751824 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:40.751794 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-nsdvm_2ab91886-f8da-4e94-be39-c59b4a55ae55/cluster-samples-operator/0.log" Jul 28 13:26:40.769082 ip-10-0-129-244 kubenswrapper[2560]: I0728 13:26:40.769054 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-nsdvm_2ab91886-f8da-4e94-be39-c59b4a55ae55/cluster-samples-operator-watch/0.log"