Jul 06 20:48:55.747526 ip-10-0-138-164 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:48:56.217850 ip-10-0-138-164 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:48:56.217850 ip-10-0-138-164 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:48:56.217850 ip-10-0-138-164 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:48:56.217850 ip-10-0-138-164 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:48:56.217850 ip-10-0-138-164 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:48:56.220877 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.220797 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:48:56.226856 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226836 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:56.226856 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226854 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:56.226856 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226858 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:56.226856 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226861 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226865 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226868 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226871 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226874 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226876 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226879 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226882 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226884 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226887 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226889 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226892 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226894 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226896 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226899 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226901 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226904 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226906 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226909 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226911 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:56.227013 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226914 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226916 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226921 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226926 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226929 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226932 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226935 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226938 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226941 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226945 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226948 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226951 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226953 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226956 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226959 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226962 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226965 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226968 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226970 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:56.227511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226973 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226975 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226977 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226980 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226982 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226985 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226987 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.226990 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227000 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227002 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227005 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227007 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227009 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227012 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227014 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227017 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227019 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227022 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227025 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227027 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:56.227967 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227030 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227032 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227034 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227037 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227040 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227042 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227044 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227048 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227051 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227053 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227055 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227058 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227083 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227086 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227090 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227094 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227097 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227099 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227101 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227104 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:56.228461 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227107 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227115 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227117 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227120 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227122 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227125 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227127 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227130 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227132 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227135 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227137 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227139 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227142 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227144 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227146 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227150 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227152 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227903 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227909 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227913 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:56.228939 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227915 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227918 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227920 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227923 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227926 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227928 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227930 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227933 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227935 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227938 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227941 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227943 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227946 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227948 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227957 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227959 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227962 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227964 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227967 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227969 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:56.229434 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227973 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227975 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227978 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227981 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227983 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227985 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227988 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227990 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227993 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.227996 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228000 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228004 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228007 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228010 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228013 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228016 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228018 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228021 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228023 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:56.229934 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228026 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228028 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228031 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228033 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228035 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228038 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228041 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228044 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228053 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228056 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228058 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228061 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228064 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228066 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228068 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228071 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228073 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228076 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228078 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228081 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:56.230418 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228083 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228086 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228089 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228091 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228094 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228097 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228099 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228101 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228104 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228106 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228108 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228111 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228113 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228116 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228120 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228122 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228125 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228127 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228129 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228132 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228134 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:56.230904 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228142 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228145 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228147 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228150 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228152 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228154 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228156 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228159 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228167 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228169 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228172 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228175 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228178 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228182 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228184 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228187 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228666 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228672 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228675 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:56.231530 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228678 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228681 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228683 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228686 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228688 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228691 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228693 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228696 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228698 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228701 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228705 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228708 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228710 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228724 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228727 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228734 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228736 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228739 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228741 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228744 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:56.231985 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228746 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228749 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228751 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228754 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228756 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228764 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228767 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228769 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228772 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228775 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228777 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228780 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228782 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228785 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228787 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228791 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228795 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228797 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228800 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:56.232510 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228803 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228805 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228808 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228810 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228812 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228815 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228817 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228825 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228829 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228831 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228834 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228837 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228839 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228844 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228847 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228849 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228852 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228855 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228858 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:56.232961 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228860 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228863 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228866 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228868 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228871 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228873 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228875 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228878 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228880 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228882 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228885 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228887 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228890 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228892 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228894 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228897 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228899 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228901 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228904 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228906 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:56.233441 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228908 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228913 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228917 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228919 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228922 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228925 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228927 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228930 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228933 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228935 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228937 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228940 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228942 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228945 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228947 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228950 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228952 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.228955 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229021 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229028 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:48:56.233943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229034 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229038 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229041 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229044 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229048 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229052 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229055 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229057 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229060 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229064 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229066 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229069 2576 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229072 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229075 2576 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229079 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229082 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229085 2576 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229090 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229093 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229096 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229099 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229102 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229105 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:48:56.234443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229108 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229110 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229113 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229116 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229119 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229121 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229124 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229128 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229130 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229133 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229135 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229138 2576 flags.go:64] FLAG: --enable-server="true" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229141 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229145 2576 flags.go:64] FLAG: --event-burst="100" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229148 2576 flags.go:64] FLAG: --event-qps="50" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229151 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229153 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229156 2576 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229159 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229162 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229165 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229167 2576 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229170 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229173 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229176 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:48:56.234982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229179 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229184 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229186 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229189 2576 flags.go:64] FLAG: --feature-gates="" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229193 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229195 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229198 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229201 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229204 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229206 2576 flags.go:64] FLAG: --help="false" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229209 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229212 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229214 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229217 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229220 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229224 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229226 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229229 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229231 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229234 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229237 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229240 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229242 2576 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229245 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:48:56.235637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229247 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229265 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229268 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229271 2576 flags.go:64] FLAG: --lock-file="" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229274 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229276 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229279 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229285 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229288 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229292 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229294 2576 flags.go:64] FLAG: --logging-format="text" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229297 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229300 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229303 2576 flags.go:64] FLAG: --manifest-url="" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229305 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229309 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229312 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229316 2576 flags.go:64] FLAG: --max-pods="110" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229318 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229321 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229324 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229326 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229329 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229332 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229334 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:48:56.236224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229341 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229344 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229346 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229349 2576 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229351 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229356 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229359 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229362 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229364 2576 flags.go:64] FLAG: --port="10250" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229367 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229370 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085872f3c9c3add01" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229373 2576 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229376 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229378 2576 flags.go:64] FLAG: --register-node="true" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229381 2576 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229384 2576 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229388 2576 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229391 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229394 2576 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229397 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229400 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229403 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229405 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229408 2576 flags.go:64] FLAG: --runonce="false" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229410 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:48:56.236854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229413 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229416 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229418 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229421 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229424 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229426 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229429 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229432 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229434 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229437 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229439 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229442 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229445 2576 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229448 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229452 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229455 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229458 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229465 2576 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229468 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229470 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229473 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229476 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229478 2576 flags.go:64] FLAG: --v="2" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229483 2576 flags.go:64] FLAG: --version="false" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229487 2576 flags.go:64] FLAG: --vmodule="" Jul 06 20:48:56.237469 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229490 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.229493 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229609 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229612 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229615 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229618 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229621 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229624 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229626 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229629 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229631 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229634 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229636 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229639 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229641 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229644 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229646 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229648 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229651 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229653 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:56.238067 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229656 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229658 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229660 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229664 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229666 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229668 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229671 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229673 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229676 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229678 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229682 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229684 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229687 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229689 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229692 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229694 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229697 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229699 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229702 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229704 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:56.238637 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229707 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229709 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229711 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229714 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229716 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229719 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229721 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229723 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229726 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229728 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229730 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229733 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229735 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229738 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229740 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229744 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229746 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229749 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229751 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:56.239115 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229753 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229756 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229759 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229762 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229764 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229767 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229770 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229772 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229774 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229777 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229779 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229782 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229784 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229787 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229789 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229791 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229794 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229796 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229798 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229802 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:56.239587 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229805 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229808 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229811 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229813 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229816 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229818 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229822 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229825 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229829 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229832 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229835 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229837 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229840 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229844 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229847 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229851 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229854 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229856 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229859 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:56.240061 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229863 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229865 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.229874 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.230590 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.237317 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.237335 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.237353 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.237360 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237414 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237419 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237423 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237426 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237429 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237432 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:56.240539 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237435 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237438 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237441 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237443 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237446 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237449 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237451 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237454 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237456 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237459 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237461 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237464 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237466 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237468 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237471 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237474 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237476 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237479 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237482 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237484 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237487 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:56.240889 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237489 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237505 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237512 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237515 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237518 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237522 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237525 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237527 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237530 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237533 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237536 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237538 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237541 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237544 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237547 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237550 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237552 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237555 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237558 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237561 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:56.241392 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237563 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237565 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237568 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237571 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237573 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237576 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237578 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237581 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237583 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237586 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237588 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237590 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237593 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237595 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237598 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237602 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237604 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237606 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237609 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:56.241876 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237611 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237614 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237616 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237619 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237621 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237624 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237626 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237628 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237630 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237633 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237635 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237637 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237640 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237642 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237645 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237647 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237650 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237652 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237654 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237657 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:56.242359 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237659 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237661 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237664 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237666 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237669 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237671 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237674 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237677 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237679 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237684 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237686 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237689 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237692 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.237697 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:48:56.242843 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237803 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237807 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237811 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237814 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237817 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237819 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237822 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237824 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237827 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237829 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237832 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237834 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237836 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237839 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237841 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237843 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237846 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237848 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237851 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237853 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:56.243185 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237855 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237858 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237860 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237862 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237865 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237867 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237870 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237872 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237876 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237878 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237880 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237883 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237885 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237888 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237890 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237892 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237895 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237898 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237900 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:56.243680 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237903 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237905 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237907 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237910 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237912 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237914 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237916 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237919 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237921 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237923 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237926 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237928 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237931 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237933 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237935 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237938 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237941 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237944 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237946 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237949 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:56.244134 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237952 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237954 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237957 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237960 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237962 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237965 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237967 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237970 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237972 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237974 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237977 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237979 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237981 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237984 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237986 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237988 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237991 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237993 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237995 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.237998 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:56.244630 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238000 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238003 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238007 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238022 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238026 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238028 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238031 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238034 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238036 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238039 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238041 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238044 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238046 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238049 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238051 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238056 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238059 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238062 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238064 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:56.245114 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:56.238066 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:56.245577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.238071 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:48:56.245577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.238165 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:48:56.245577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.240380 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:48:56.245577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.241879 2576 server.go:1019] "Starting client certificate rotation" Jul 06 20:48:56.245577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.241972 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:48:56.245577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.242758 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:48:56.246125 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.246112 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:48:56.251575 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.251553 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:48:56.263088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.263071 2576 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:48:56.265147 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.265135 2576 log.go:25] "Validated CRI v1 image API" Jul 06 20:48:56.265952 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.265935 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:48:56.270824 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.270804 2576 fs.go:135] Filesystem UUIDs: map[740ee81e-bff2-43d5-ae16-1bdbc1955128:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e161732b-57a1-4ff9-9f8d-637e486fe5e4:/dev/nvme0n1p4] Jul 06 20:48:56.270885 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.270823 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:48:56.273293 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.273278 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:48:56.275840 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.275741 2576 manager.go:216] Machine: {Timestamp:2026-07-06 20:48:56.275244588 +0000 UTC m=+0.397023224 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3130607 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bee6891b7f18b2707918eede65c98 SystemUUID:ec2bee68-91b7-f18b-2707-918eede65c98 BootID:85cd4573-b9be-4721-9077-82f5755e6fdf Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:29:52:58:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:29:52:58:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:a1:a5:d4:11:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:48:56.275840 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.275835 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:48:56.275942 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.275900 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:48:56.279228 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.279207 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:48:56.279365 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.279232 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:48:56.280010 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.280001 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:48:56.280039 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.280014 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:48:56.280039 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.280021 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:48:56.280039 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.280031 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:48:56.281446 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.281437 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:48:56.284640 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284629 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:48:56.284748 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284738 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:48:56.284786 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284778 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:48:56.284818 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284805 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:48:56.284847 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284821 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:48:56.284847 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284835 2576 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:48:56.284847 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.284846 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:48:56.285219 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.285208 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:48:56.285284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.285226 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:48:56.287393 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.287371 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:48:56.289549 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.289536 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:48:56.289589 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.289566 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:48:56.291695 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291683 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291702 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291708 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291713 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291721 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291726 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291734 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:48:56.291741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291740 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:48:56.291911 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291747 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:48:56.291911 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291752 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:48:56.291911 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291764 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:48:56.291911 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.291769 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:48:56.292533 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.292522 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:48:56.292568 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.292534 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:48:56.295001 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.294977 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k5ndb" Jul 06 20:48:56.295572 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.295550 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:48:56.295649 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.295575 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:48:56.295649 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.295632 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:48:56.296214 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.296201 2576 server.go:1268] "Started kubelet" Jul 06 20:48:56.296295 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.296266 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:48:56.296385 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.296337 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:48:56.296427 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.296412 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:48:56.297180 ip-10-0-138-164 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:48:56.297750 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.297731 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:48:56.298999 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.298986 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:48:56.303665 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.303645 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k5ndb" Jul 06 20:48:56.303747 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.303723 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:48:56.309346 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.309248 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:48:56.309346 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.309287 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:48:56.309551 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.309408 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.310100 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310075 2576 factory.go:55] Registering systemd factory Jul 06 20:48:56.310100 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310097 2576 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:48:56.310229 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310079 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:48:56.310229 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310081 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:48:56.310229 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310139 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:48:56.310377 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310240 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:48:56.310377 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310266 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:48:56.310377 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310340 2576 factory.go:153] Registering CRI-O factory Jul 06 20:48:56.310377 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310360 2576 factory.go:223] Registration of the crio container factory successfully Jul 06 20:48:56.310561 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310414 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:48:56.310561 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310445 2576 factory.go:103] Registering Raw factory Jul 06 20:48:56.310561 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.310459 2576 manager.go:1196] Started watching for new ooms in manager Jul 06 20:48:56.311028 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.311014 2576 manager.go:349] Starting recovery of all containers Jul 06 20:48:56.314238 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.314219 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:56.318561 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.318536 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-164.ec2.internal\" not found" node="ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.320215 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.320195 2576 manager.go:354] Recovery completed Jul 06 20:48:56.324383 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.324287 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.326639 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.326624 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.326702 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.326650 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.326702 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.326664 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.327188 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327175 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.327273 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327177 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:48:56.327273 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327205 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:48:56.327273 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327221 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:48:56.327873 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327858 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.327929 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327886 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.327929 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.327902 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.328607 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.328596 2576 policy_none.go:49] "None policy: Start" Jul 06 20:48:56.328648 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.328611 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:48:56.328648 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.328620 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:48:56.330049 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.330037 2576 policy_none.go:47] "Start" Jul 06 20:48:56.372353 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372339 2576 manager.go:337] "Starting Device Plugin manager" Jul 06 20:48:56.372435 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.372381 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:48:56.372435 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372394 2576 server.go:87] "Starting device plugin registration server" Jul 06 20:48:56.372621 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372609 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:48:56.372678 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372623 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:48:56.372730 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372702 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:48:56.372847 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372778 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:48:56.372847 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.372793 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:48:56.373434 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.373396 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:48:56.373511 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.373451 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.447303 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.447274 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:48:56.448549 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.448528 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:48:56.448620 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.448565 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:48:56.448620 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.448586 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:48:56.448620 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.448615 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:48:56.451087 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.451071 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:56.473077 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.473027 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.473790 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.473773 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.473867 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.473796 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.473867 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.473811 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.473867 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.473835 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.485843 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.485827 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.485931 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.485850 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-164.ec2.internal\": node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.503831 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.503811 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.549153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.549133 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal"] Jul 06 20:48:56.549215 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.549186 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.549921 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.549906 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.550000 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.549937 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.550000 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.549952 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.551344 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.551330 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.551461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.551445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.551519 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.551477 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.552027 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.552008 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.552092 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.552039 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.552092 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.552049 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.552162 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.552012 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.552162 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.552117 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.552162 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.552130 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.553155 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.553141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.553207 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.553164 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:56.553833 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.553820 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:56.553894 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.553847 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:56.553894 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.553857 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:56.574856 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.574834 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-164.ec2.internal\" not found" node="ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.579160 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.579146 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-164.ec2.internal\" not found" node="ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.604495 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.604476 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.611852 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.611835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10944d234455d22ceb44537c639c9a77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal\" (UID: \"10944d234455d22ceb44537c639c9a77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.611919 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.611858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10944d234455d22ceb44537c639c9a77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal\" (UID: \"10944d234455d22ceb44537c639c9a77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.611919 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.611876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea14a54407f26f0ae00b311aa4745e29-config\") pod \"kube-apiserver-proxy-ip-10-0-138-164.ec2.internal\" (UID: \"ea14a54407f26f0ae00b311aa4745e29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.704767 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.704748 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.712106 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.712079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10944d234455d22ceb44537c639c9a77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal\" (UID: \"10944d234455d22ceb44537c639c9a77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.712169 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.712111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10944d234455d22ceb44537c639c9a77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal\" (UID: \"10944d234455d22ceb44537c639c9a77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.712169 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.712129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea14a54407f26f0ae00b311aa4745e29-config\") pod \"kube-apiserver-proxy-ip-10-0-138-164.ec2.internal\" (UID: \"ea14a54407f26f0ae00b311aa4745e29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.712238 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.712180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea14a54407f26f0ae00b311aa4745e29-config\") pod \"kube-apiserver-proxy-ip-10-0-138-164.ec2.internal\" (UID: \"ea14a54407f26f0ae00b311aa4745e29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.712238 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.712196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10944d234455d22ceb44537c639c9a77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal\" (UID: \"10944d234455d22ceb44537c639c9a77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.712238 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.712181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10944d234455d22ceb44537c639c9a77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal\" (UID: \"10944d234455d22ceb44537c639c9a77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.804954 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.804911 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:56.878390 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.878361 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.882775 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:56.882483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" Jul 06 20:48:56.905785 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:56.905761 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:57.006343 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:57.006320 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:58.326194 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:58.326174 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:58.426736 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:58.426715 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:58.460199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.460180 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:48:58.460661 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.460294 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:48:58.460661 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.460326 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:48:58.526799 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:58.526778 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:58.527778 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.527756 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:43:57 +0000 UTC" deadline="2028-04-06 14:44:46.386674058 +0000 UTC" Jul 06 20:48:58.527822 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.527777 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15353h55m47.858899s" Jul 06 20:48:58.627605 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:58.627582 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-164.ec2.internal\" not found" Jul 06 20:48:58.639570 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.639550 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:58.681394 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:58.681367 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea14a54407f26f0ae00b311aa4745e29.slice/crio-36aff065eb6cafe4d44e5bbc0f1c49d9bac78bab2c23117db805e7a3a744a6b6 WatchSource:0}: Error finding container 36aff065eb6cafe4d44e5bbc0f1c49d9bac78bab2c23117db805e7a3a744a6b6: Status 404 returned error can't find the container with id 36aff065eb6cafe4d44e5bbc0f1c49d9bac78bab2c23117db805e7a3a744a6b6 Jul 06 20:48:58.681686 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:48:58.681663 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10944d234455d22ceb44537c639c9a77.slice/crio-c6dc94a9b055340c7d2c960be702d9689dc6a3ace7ebc90fa3318547e65accc1 WatchSource:0}: Error finding container c6dc94a9b055340c7d2c960be702d9689dc6a3ace7ebc90fa3318547e65accc1: Status 404 returned error can't find the container with id c6dc94a9b055340c7d2c960be702d9689dc6a3ace7ebc90fa3318547e65accc1 Jul 06 20:48:58.688774 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.688755 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:48:58.728797 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.728776 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" Jul 06 20:48:58.742684 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.742666 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:48:58.744662 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.744650 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" Jul 06 20:48:58.754116 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.754101 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:48:58.871916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:58.871855 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:59.505239 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.505207 2576 apiserver.go:52] "Watching apiserver" Jul 06 20:48:59.517986 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.517941 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:48:59.518484 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.518459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-x2gsk","openshift-multus/multus-additional-cni-plugins-dshnd","openshift-multus/multus-qpl6w","openshift-network-operator/iptables-alerter-gvj4g","kube-system/global-pull-secret-syncer-m8fqq","kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl","openshift-dns/node-resolver-ktp2g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal","openshift-multus/network-metrics-daemon-rxwd5","openshift-network-diagnostics/network-check-target-99sk9","openshift-ovn-kubernetes/ovnkube-node-4vcn6","kube-system/konnectivity-agent-mk8g9","openshift-cluster-node-tuning-operator/tuned-qdghq"] Jul 06 20:48:59.520898 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.520357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.522065 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.522045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.523329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qmf4d\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.523537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.523694 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.523840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.524338 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.524875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pp86d\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.525068 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.525260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.527505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.526224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.528073 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.528048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.528166 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.528121 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:48:59.528683 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.528665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.528835 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.528821 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-shg9r\"" Jul 06 20:48:59.528978 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.528964 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:48:59.529116 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.529103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:48:59.529249 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.529237 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.529984 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.529963 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:48:59.530155 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.530135 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.530248 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.530158 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.530308 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.530141 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2h4ln\"" Jul 06 20:48:59.530365 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.530347 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:48:59.530539 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.530524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.531832 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.531794 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.533694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.532785 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.533694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.533088 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zjx57\"" Jul 06 20:48:59.533694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.533304 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.533694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.533355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.534189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.533810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.534227 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.534214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.534418 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.534351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5rlzj\"" Jul 06 20:48:59.535562 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.535248 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:48:59.535562 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.535403 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.535777 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.535674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cbxb6\"" Jul 06 20:48:59.536021 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.535967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.537475 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-cnibin\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537475 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-cni-binary-copy\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537475 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-conf-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537475 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.537475 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-registration-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.537475 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qrhm\" (UniqueName: \"kubernetes.io/projected/67b00bfb-db02-4134-b663-7aad9217abe2-kube-api-access-9qrhm\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-k8s-cni-cncf-io\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-multus-certs\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fd63e78-3035-4faa-b686-338c45530cb9-host-slash\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-kubernetes\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-socket-dir-parent\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-etc-kubernetes\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-run\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-var-lib-kubelet\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-host\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9194403-8522-4675-a585-5bb984d97618-etc-tuned\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-etc-selinux\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.537861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-cni-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-cni-bin\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysconfig\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysctl-d\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-lib-modules\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96x4\" (UniqueName: \"kubernetes.io/projected/e9194403-8522-4675-a585-5bb984d97618-kube-api-access-q96x4\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.537986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88c64e78-a89d-47e1-8694-755a2133c0cb-kubelet-config\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-kubelet\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-daemon-config\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5nc8\" (UniqueName: \"kubernetes.io/projected/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-kube-api-access-h5nc8\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-modprobe-d\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysctl-conf\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-systemd\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-device-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-os-release\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-cni-multus\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.538447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-hostroot\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fd63e78-3035-4faa-b686-338c45530cb9-iptables-alerter-script\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-sys\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-sys-fs\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67b00bfb-db02-4134-b663-7aad9217abe2-hosts-file\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-netns\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997hv\" (UniqueName: \"kubernetes.io/projected/0fd63e78-3035-4faa-b686-338c45530cb9-kube-api-access-997hv\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9194403-8522-4675-a585-5bb984d97618-tmp\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-socket-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjhgc\" (UniqueName: \"kubernetes.io/projected/395b8bf9-7c30-4296-b24d-45841a9b1641-kube-api-access-cjhgc\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-system-cni-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05fac989-aecb-447d-96b6-34a10fa109ae-agent-certs\") pod \"konnectivity-agent-mk8g9\" (UID: \"05fac989-aecb-447d-96b6-34a10fa109ae\") " pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05fac989-aecb-447d-96b6-34a10fa109ae-konnectivity-ca\") pod \"konnectivity-agent-mk8g9\" (UID: \"05fac989-aecb-447d-96b6-34a10fa109ae\") " pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88c64e78-a89d-47e1-8694-755a2133c0cb-dbus\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.539189 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.538538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b00bfb-db02-4134-b663-7aad9217abe2-tmp-dir\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.540353 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.539860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.543858 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.543154 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:48:59.543858 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.543185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7r275\"" Jul 06 20:48:59.543858 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.543156 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:48:59.544084 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.544060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:48:59.546501 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.544347 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:48:59.546593 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.546550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:48:59.546665 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.546640 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:48:59.547882 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.547196 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:48:59.549346 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.549329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.551831 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.551812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:48:59.552273 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.552256 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:48:59.552506 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.552490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:48:59.552675 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.552660 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:48:59.552782 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.552767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f7zdj\"" Jul 06 20:48:59.555326 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.555264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:48:59.555772 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.555735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:48:59.566002 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.565982 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-45dfg" Jul 06 20:48:59.575010 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.574990 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-45dfg" Jul 06 20:48:59.587679 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.587662 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:59.630609 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.630585 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:48:59.638740 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-system-cni-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.638836 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-cni-binary-copy\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.638836 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/637895eb-a57a-4aff-8148-6226bbf552c8-host\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.638836 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-cni-netd\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.638836 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.638836 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-cnibin\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.639027 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-system-cni-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639027 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05fac989-aecb-447d-96b6-34a10fa109ae-konnectivity-ca\") pod \"konnectivity-agent-mk8g9\" (UID: \"05fac989-aecb-447d-96b6-34a10fa109ae\") " pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.639027 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b00bfb-db02-4134-b663-7aad9217abe2-tmp-dir\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.639027 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.638970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-cnibin\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639195 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-cnibin\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639195 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-cni-binary-copy\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639195 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-conf-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639195 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-multus-certs\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639195 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-k8s-cni-cncf-io\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-kubernetes\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-run\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/637895eb-a57a-4aff-8148-6226bbf552c8-serviceca\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b9ln\" (UniqueName: \"kubernetes.io/projected/637895eb-a57a-4aff-8148-6226bbf552c8-kube-api-access-8b9ln\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b00bfb-db02-4134-b663-7aad9217abe2-tmp-dir\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-slash\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-run-netns\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-k8s-cni-cncf-io\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-socket-dir-parent\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-etc-kubernetes\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-host\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9194403-8522-4675-a585-5bb984d97618-etc-tuned\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-var-lib-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovnkube-config\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05fac989-aecb-447d-96b6-34a10fa109ae-konnectivity-ca\") pod \"konnectivity-agent-mk8g9\" (UID: \"05fac989-aecb-447d-96b6-34a10fa109ae\") " pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovnkube-script-lib\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-cni-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-cni-bin\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-multus-certs\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysconfig\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysctl-d\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-conf-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-etc-kubernetes\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-lib-modules\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-host\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwkt5\" (UniqueName: \"kubernetes.io/projected/d88b54e9-ad7a-4289-8981-312cb84aac57-kube-api-access-dwkt5\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.639943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5nc8\" (UniqueName: \"kubernetes.io/projected/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-kube-api-access-h5nc8\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysctl-conf\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-systemd\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-device-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-os-release\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-hostroot\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-systemd-units\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-systemd\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-ovn\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-cni-dir\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640038 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-log-socket\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-netns\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-kubernetes\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997hv\" (UniqueName: \"kubernetes.io/projected/0fd63e78-3035-4faa-b686-338c45530cb9-kube-api-access-997hv\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9194403-8522-4675-a585-5bb984d97618-tmp\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-run\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.640597 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-socket-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-socket-dir-parent\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-lib-modules\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysconfig\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-hostroot\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-cni-bin\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysctl-conf\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-sysctl-d\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-systemd\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.639886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-cni-binary-copy\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-device-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.640980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-os-release\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-socket-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96x4\" (UniqueName: \"kubernetes.io/projected/e9194403-8522-4675-a585-5bb984d97618-kube-api-access-q96x4\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05fac989-aecb-447d-96b6-34a10fa109ae-agent-certs\") pod \"konnectivity-agent-mk8g9\" (UID: \"05fac989-aecb-447d-96b6-34a10fa109ae\") " pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88c64e78-a89d-47e1-8694-755a2133c0cb-dbus\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-run-netns\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.641447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-cni-bin\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-registration-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qrhm\" (UniqueName: \"kubernetes.io/projected/67b00bfb-db02-4134-b663-7aad9217abe2-kube-api-access-9qrhm\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fd63e78-3035-4faa-b686-338c45530cb9-host-slash\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-var-lib-kubelet\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-system-cni-dir\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-etc-selinux\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-os-release\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88c64e78-a89d-47e1-8694-755a2133c0cb-dbus\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-var-lib-kubelet\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovn-node-metrics-cert\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fd63e78-3035-4faa-b686-338c45530cb9-host-slash\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nm22\" (UniqueName: \"kubernetes.io/projected/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-kube-api-access-8nm22\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88c64e78-a89d-47e1-8694-755a2133c0cb-kubelet-config\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.642284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-kubelet\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-registration-dir\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.641946 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88c64e78-a89d-47e1-8694-755a2133c0cb-kubelet-config\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-kubelet\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.641981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-etc-selinux\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-daemon-config\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-modprobe-d\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.642223 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:00.14218016 +0000 UTC m=+3.044597369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-cni-multus\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-etc-modprobe-d\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fd63e78-3035-4faa-b686-338c45530cb9-iptables-alerter-script\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-host-var-lib-cni-multus\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-sys\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-etc-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-env-overrides\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.643096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9194403-8522-4675-a585-5bb984d97618-sys\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-sys-fs\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67b00bfb-db02-4134-b663-7aad9217abe2-hosts-file\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/395b8bf9-7c30-4296-b24d-45841a9b1641-sys-fs\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-multus-daemon-config\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnjh\" (UniqueName: \"kubernetes.io/projected/1c6b0565-8357-41d5-96d6-45fdab333c88-kube-api-access-6bnjh\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67b00bfb-db02-4134-b663-7aad9217abe2-hosts-file\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-kubelet\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-node-log\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.642823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjhgc\" (UniqueName: \"kubernetes.io/projected/395b8bf9-7c30-4296-b24d-45841a9b1641-kube-api-access-cjhgc\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.643721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.643207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fd63e78-3035-4faa-b686-338c45530cb9-iptables-alerter-script\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.645875 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.645855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9194403-8522-4675-a585-5bb984d97618-tmp\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.646013 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.645880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9194403-8522-4675-a585-5bb984d97618-etc-tuned\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.646130 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.646114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05fac989-aecb-447d-96b6-34a10fa109ae-agent-certs\") pod \"konnectivity-agent-mk8g9\" (UID: \"05fac989-aecb-447d-96b6-34a10fa109ae\") " pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.649230 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.649211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5nc8\" (UniqueName: \"kubernetes.io/projected/82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2-kube-api-access-h5nc8\") pod \"multus-qpl6w\" (UID: \"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2\") " pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.649922 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.649899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qrhm\" (UniqueName: \"kubernetes.io/projected/67b00bfb-db02-4134-b663-7aad9217abe2-kube-api-access-9qrhm\") pod \"node-resolver-ktp2g\" (UID: \"67b00bfb-db02-4134-b663-7aad9217abe2\") " pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.650326 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.650305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96x4\" (UniqueName: \"kubernetes.io/projected/e9194403-8522-4675-a585-5bb984d97618-kube-api-access-q96x4\") pod \"tuned-qdghq\" (UID: \"e9194403-8522-4675-a585-5bb984d97618\") " pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.651413 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.651391 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-997hv\" (UniqueName: \"kubernetes.io/projected/0fd63e78-3035-4faa-b686-338c45530cb9-kube-api-access-997hv\") pod \"iptables-alerter-gvj4g\" (UID: \"0fd63e78-3035-4faa-b686-338c45530cb9\") " pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.651925 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.651902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjhgc\" (UniqueName: \"kubernetes.io/projected/395b8bf9-7c30-4296-b24d-45841a9b1641-kube-api-access-cjhgc\") pod \"aws-ebs-csi-driver-node-bpjsl\" (UID: \"395b8bf9-7c30-4296-b24d-45841a9b1641\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.672507 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.672453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" event={"ID":"ea14a54407f26f0ae00b311aa4745e29","Type":"ContainerStarted","Data":"36aff065eb6cafe4d44e5bbc0f1c49d9bac78bab2c23117db805e7a3a744a6b6"} Jul 06 20:48:59.674212 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.674180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" event={"ID":"10944d234455d22ceb44537c639c9a77","Type":"ContainerStarted","Data":"c6dc94a9b055340c7d2c960be702d9689dc6a3ace7ebc90fa3318547e65accc1"} Jul 06 20:48:59.743375 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:48:59.743526 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-cni-bin\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.743526 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-cni-bin\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.743526 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-system-cni-dir\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.743530 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-os-release\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-system-cni-dir\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovn-node-metrics-cert\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.743689 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:00.243667035 +0000 UTC m=+3.146084239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-os-release\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.743723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nm22\" (UniqueName: \"kubernetes.io/projected/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-kube-api-access-8nm22\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-etc-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-env-overrides\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-etc-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnjh\" (UniqueName: \"kubernetes.io/projected/1c6b0565-8357-41d5-96d6-45fdab333c88-kube-api-access-6bnjh\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-kubelet\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-node-log\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.743982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-cni-binary-copy\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/637895eb-a57a-4aff-8148-6226bbf552c8-host\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-cni-netd\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-node-log\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-cnibin\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c6b0565-8357-41d5-96d6-45fdab333c88-cnibin\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/637895eb-a57a-4aff-8148-6226bbf552c8-serviceca\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b9ln\" (UniqueName: \"kubernetes.io/projected/637895eb-a57a-4aff-8148-6226bbf552c8-kube-api-access-8b9ln\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-slash\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-run-netns\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-var-lib-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-cni-netd\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovnkube-config\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/637895eb-a57a-4aff-8148-6226bbf552c8-host\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovnkube-script-lib\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkt5\" (UniqueName: \"kubernetes.io/projected/d88b54e9-ad7a-4289-8981-312cb84aac57-kube-api-access-dwkt5\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-systemd-units\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.744756 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-systemd\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-ovn\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-log-socket\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-kubelet\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-log-socket\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-cni-binary-copy\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-slash\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-run-netns\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-var-lib-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-env-overrides\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-systemd-units\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-openvswitch\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-systemd\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.745382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-run-ovn\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.746053 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.744945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c6b0565-8357-41d5-96d6-45fdab333c88-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.746053 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.745201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovnkube-config\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.746053 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.745299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovnkube-script-lib\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.746053 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.745341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/637895eb-a57a-4aff-8148-6226bbf552c8-serviceca\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.746336 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.746316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-ovn-node-metrics-cert\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.754504 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.754487 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:59.754604 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.754508 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:59.754604 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.754518 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:59.754604 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:48:59.754581 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:00.254567239 +0000 UTC m=+3.156984430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:59.757629 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.757562 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nm22\" (UniqueName: \"kubernetes.io/projected/6acc2a15-00e8-4b53-bd31-0988fdb3dabc-kube-api-access-8nm22\") pod \"ovnkube-node-4vcn6\" (UID: \"6acc2a15-00e8-4b53-bd31-0988fdb3dabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.757629 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.757573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b9ln\" (UniqueName: \"kubernetes.io/projected/637895eb-a57a-4aff-8148-6226bbf552c8-kube-api-access-8b9ln\") pod \"node-ca-x2gsk\" (UID: \"637895eb-a57a-4aff-8148-6226bbf552c8\") " pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.758100 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.758081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnjh\" (UniqueName: \"kubernetes.io/projected/1c6b0565-8357-41d5-96d6-45fdab333c88-kube-api-access-6bnjh\") pod \"multus-additional-cni-plugins-dshnd\" (UID: \"1c6b0565-8357-41d5-96d6-45fdab333c88\") " pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.758243 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.758223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwkt5\" (UniqueName: \"kubernetes.io/projected/d88b54e9-ad7a-4289-8981-312cb84aac57-kube-api-access-dwkt5\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:48:59.837768 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.837730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" Jul 06 20:48:59.847083 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.847064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:48:59.858901 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.858882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpl6w" Jul 06 20:48:59.864523 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.864504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvj4g" Jul 06 20:48:59.878334 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.878311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdghq" Jul 06 20:48:59.885501 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.885484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ktp2g" Jul 06 20:48:59.892397 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.892376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x2gsk" Jul 06 20:48:59.899999 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.899983 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dshnd" Jul 06 20:48:59.904869 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.904849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:48:59.971402 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:48:59.971385 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:49:00.146483 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.146444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:00.146631 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.146589 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:00.146694 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.146666 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:01.146647614 +0000 UTC m=+4.049064805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:00.247224 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.247188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:00.247391 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.247379 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:00.247456 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.247435 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:01.247421632 +0000 UTC m=+4.149838825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:00.348232 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.348200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:00.348417 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.348390 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:00.348417 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.348412 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:00.348558 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.348424 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:00.348558 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:00.348493 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:01.348474703 +0000 UTC m=+4.250891900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:00.577252 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.577099 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:43:59 +0000 UTC" deadline="2027-12-21 17:25:53.21710764 +0000 UTC" Jul 06 20:49:00.577680 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.577253 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12788h36m52.639859112s" Jul 06 20:49:00.678160 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.678131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" event={"ID":"ea14a54407f26f0ae00b311aa4745e29","Type":"ContainerStarted","Data":"1ba615d1966da005d427b4db2f8e690e1a85aac5e9be3dec951afe4ea36d0b7b"} Jul 06 20:49:00.680391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.680365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdghq" event={"ID":"e9194403-8522-4675-a585-5bb984d97618","Type":"ContainerStarted","Data":"ae5300ef8defbe301390fb87873307680d2f3f2a0f207867b728ef555ecabfde"} Jul 06 20:49:00.681308 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.681285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x2gsk" event={"ID":"637895eb-a57a-4aff-8148-6226bbf552c8","Type":"ContainerStarted","Data":"daa232a7e548310420d9004a295902afa8b092af35b0cc8d685ff9562b94e8e0"} Jul 06 20:49:00.684348 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.684328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpl6w" event={"ID":"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2","Type":"ContainerStarted","Data":"564a4b307867c06bac86afc2c61e179a55f9295d1a5e967d6fbb400407037c26"} Jul 06 20:49:00.685254 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.685231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" event={"ID":"395b8bf9-7c30-4296-b24d-45841a9b1641","Type":"ContainerStarted","Data":"87cc41b64096890f3fb46f188642b1272840d37b1ed9dfec6d511ded1c6f12a2"} Jul 06 20:49:00.686233 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.686213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mk8g9" event={"ID":"05fac989-aecb-447d-96b6-34a10fa109ae","Type":"ContainerStarted","Data":"41053870bbb0fcde38d901294d565f19c892ddd8e8e8c5ff5f63b94f51d2a2ec"} Jul 06 20:49:00.690277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.690257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvj4g" event={"ID":"0fd63e78-3035-4faa-b686-338c45530cb9","Type":"ContainerStarted","Data":"711c57935c39389e615faaf2d4d31c92fda634cd23a991a5c7a318c02ad86cc8"} Jul 06 20:49:00.692713 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.692682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerStarted","Data":"c296cad0718e6e65ef9a2aa3cf4986f3883ae850f034331c13efa5146fb39f72"} Jul 06 20:49:00.694233 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.694203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ktp2g" event={"ID":"67b00bfb-db02-4134-b663-7aad9217abe2","Type":"ContainerStarted","Data":"0ef40c54cc4ba31d7b1045227a3434053681fcb954b928e49f7f6ad51cb02da2"} Jul 06 20:49:00.694673 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.694632 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-164.ec2.internal" podStartSLOduration=2.694598852 podStartE2EDuration="2.694598852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:00.694067387 +0000 UTC m=+3.596484601" watchObservedRunningTime="2026-07-06 20:49:00.694598852 +0000 UTC m=+3.597016071" Jul 06 20:49:00.695256 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:00.695235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"03272ab7e668bf271334a8c724ea3b1c448ecad96d7fadfb2da5f31baee53546"} Jul 06 20:49:01.153594 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.153553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:01.153805 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.153726 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:01.153876 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.153808 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:03.153770141 +0000 UTC m=+6.056187356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:01.255127 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.255090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:01.255293 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.255261 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:01.255363 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.255323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:03.255304694 +0000 UTC m=+6.157721889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:01.359913 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.359875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:01.360112 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.360092 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:01.360207 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.360120 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:01.360207 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.360133 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:01.360207 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.360194 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:03.360175217 +0000 UTC m=+6.262592414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:01.577946 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.577903 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:43:59 +0000 UTC" deadline="2028-04-10 14:14:30.583066262 +0000 UTC" Jul 06 20:49:01.577946 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.577944 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15449h25m29.005127177s" Jul 06 20:49:01.668845 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.668306 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:01.668845 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.668434 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:01.668845 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.668534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:01.668845 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.668675 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:01.668845 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.668317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:01.668845 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:01.668786 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:01.719530 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.718913 2576 generic.go:356] "Generic (PLEG): container finished" podID="10944d234455d22ceb44537c639c9a77" containerID="aea53357b55569bd4346fa4328e81eff78fef19828b6bcea199eaf3d912459cc" exitCode=0 Jul 06 20:49:01.719530 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:01.719103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" event={"ID":"10944d234455d22ceb44537c639c9a77","Type":"ContainerDied","Data":"aea53357b55569bd4346fa4328e81eff78fef19828b6bcea199eaf3d912459cc"} Jul 06 20:49:02.737389 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:02.737344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" event={"ID":"10944d234455d22ceb44537c639c9a77","Type":"ContainerStarted","Data":"c57df5af411b82634dea770a2f32cfa42986190f58fafbcb04a1acb9709585df"} Jul 06 20:49:03.177004 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:03.176965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:03.177195 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.177110 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:03.177255 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.177199 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:07.177179876 +0000 UTC m=+10.079597082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:03.278301 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:03.278267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:03.278484 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.278415 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:03.278484 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.278474 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:07.278455746 +0000 UTC m=+10.180872939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:03.378957 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:03.378910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:03.379109 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.379088 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:03.379109 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.379108 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:03.379205 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.379120 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:03.379205 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.379173 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:07.379155745 +0000 UTC m=+10.281572960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:03.669913 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:03.669388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:03.669913 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:03.669409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:03.669913 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.669515 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:03.669913 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:03.669576 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:03.669913 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.669696 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:03.669913 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:03.669796 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:05.670731 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:05.670702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:05.671182 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:05.670738 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:05.671182 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:05.670816 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:05.671182 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:05.670712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:05.671182 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:05.670906 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:05.671182 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:05.670979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:07.212085 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:07.211530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:07.212085 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.211689 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:07.212085 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.211747 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:15.211730709 +0000 UTC m=+18.114147904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:07.312271 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:07.312162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:07.312450 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.312276 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:07.312450 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.312356 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:15.31232317 +0000 UTC m=+18.214740387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:07.412988 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:07.412954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:07.413160 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.413107 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:07.413160 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.413127 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:07.413160 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.413140 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:07.413297 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.413192 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:15.413174726 +0000 UTC m=+18.315591943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:07.669468 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:07.669435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:07.669644 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.669550 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:07.670006 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:07.669985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:07.670114 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.670097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:07.670179 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:07.670159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:07.670235 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:07.670220 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:09.670544 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:09.670500 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:09.670982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:09.670500 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:09.670982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:09.670651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:09.670982 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:09.670741 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:09.670982 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:09.670646 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:09.670982 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:09.670842 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:11.668433 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:11.668398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:11.668433 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:11.668416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:11.668994 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:11.668518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:11.668994 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:11.668582 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:11.668994 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:11.668659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:11.668994 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:11.668713 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:13.668849 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:13.668815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:13.668849 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:13.668834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:13.669347 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:13.668820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:13.669347 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:13.668941 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:13.669347 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:13.669025 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:13.669347 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:13.669119 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:15.268506 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:15.268468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:15.268985 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.268643 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:15.268985 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.268716 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:31.268701122 +0000 UTC m=+34.171118317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:15.368950 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:15.368919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:15.369126 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.369058 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:15.369126 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.369123 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:31.36910708 +0000 UTC m=+34.271524272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:15.469966 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:15.469933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:15.470129 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.470071 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:15.470129 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.470090 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:15.470129 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.470102 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:15.470267 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.470156 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:31.470141092 +0000 UTC m=+34.372558283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:15.668432 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:15.668406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:15.668627 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:15.668445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:15.668627 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:15.668418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:15.668627 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.668527 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:15.668808 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.668636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:15.668808 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:15.668741 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:17.669259 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:17.669222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:17.669734 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:17.669331 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:17.669734 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:17.669434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:17.669734 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:17.669534 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:17.669734 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:17.669599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:17.669734 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:17.669683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:19.669632 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.669228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:19.669929 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:19.669693 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:19.669929 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.669895 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:19.670021 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:19.669992 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:19.670077 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.670062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:19.670254 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:19.670148 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:19.776142 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.775992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" event={"ID":"395b8bf9-7c30-4296-b24d-45841a9b1641","Type":"ContainerStarted","Data":"2ad74ca2525bdb5ab37a0561c90841858325b16957e4c62447c5f25a634735d4"} Jul 06 20:49:19.778255 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.778230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mk8g9" event={"ID":"05fac989-aecb-447d-96b6-34a10fa109ae","Type":"ContainerStarted","Data":"2718864856a9d1adf903a7f8a8ceaaf12ea70c17dd55e11f847125cfc1afe44c"} Jul 06 20:49:19.784671 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.781720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerStarted","Data":"696b3bc192dbb512f839dbb58bafdf722efa61997331400f3d4586583e6d5c3b"} Jul 06 20:49:19.785459 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.785009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ktp2g" event={"ID":"67b00bfb-db02-4134-b663-7aad9217abe2","Type":"ContainerStarted","Data":"459785db1dc2e5f424dfe417564c19c95126a15601b7d012e5ce4810791687c5"} Jul 06 20:49:19.787083 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.786964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:49:19.787589 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.787566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"a4b8abf5d1d1f5df1c4965e4d506c11f22feacf2dca4a8ab02da4d13e0627a4e"} Jul 06 20:49:19.787728 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.787711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"4ed868ed0a98eb940ea89866effdeac7e54fb7dffefd37de68ac9725ab995f05"} Jul 06 20:49:19.789682 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.789659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdghq" event={"ID":"e9194403-8522-4675-a585-5bb984d97618","Type":"ContainerStarted","Data":"c533e528287126dfdbce0e458a39d0c529124395857823baa50bc0ca2bcdf8d8"} Jul 06 20:49:19.791869 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.791849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x2gsk" event={"ID":"637895eb-a57a-4aff-8148-6226bbf552c8","Type":"ContainerStarted","Data":"d3b8c3b0b10c5aca8b9783d53ddca3837ed16baee137f6ebf9d49cd78161e8b2"} Jul 06 20:49:19.793577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.793556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpl6w" event={"ID":"82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2","Type":"ContainerStarted","Data":"fdc443c2a19df9857a019c449ab0860d00b59c27652874d48e0a4c4ae615da99"} Jul 06 20:49:19.795598 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.795534 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-164.ec2.internal" podStartSLOduration=21.795520166 podStartE2EDuration="21.795520166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:02.754819055 +0000 UTC m=+5.657236270" watchObservedRunningTime="2026-07-06 20:49:19.795520166 +0000 UTC m=+22.697937379" Jul 06 20:49:19.795901 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.795869 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mk8g9" podStartSLOduration=8.499088958 podStartE2EDuration="22.795861766s" totalImagesPullingTime="14.296772808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:19.795795046 +0000 UTC m=+22.698212261" watchObservedRunningTime="2026-07-06 20:49:19.795861766 +0000 UTC m=+22.698278980" Jul 06 20:49:19.814007 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.813954 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qdghq" podStartSLOduration=3.852665224 podStartE2EDuration="22.813934649s" totalImagesPullingTime="18.961269425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:19.813488358 +0000 UTC m=+22.715905572" watchObservedRunningTime="2026-07-06 20:49:19.813934649 +0000 UTC m=+22.716351865" Jul 06 20:49:19.832303 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.832258 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpl6w" podStartSLOduration=3.805719816 podStartE2EDuration="22.83224433s" totalImagesPullingTime="19.026524514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:19.83167213 +0000 UTC m=+22.734089346" watchObservedRunningTime="2026-07-06 20:49:19.83224433 +0000 UTC m=+22.734661544" Jul 06 20:49:19.847815 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.847765 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ktp2g" podStartSLOduration=3.890112068 podStartE2EDuration="22.847746734s" totalImagesPullingTime="18.957634666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:19.847358017 +0000 UTC m=+22.749775233" watchObservedRunningTime="2026-07-06 20:49:19.847746734 +0000 UTC m=+22.750163952" Jul 06 20:49:19.863062 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:19.863017 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x2gsk" podStartSLOduration=3.917712959 podStartE2EDuration="22.863004083s" totalImagesPullingTime="18.945291124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:19.862810856 +0000 UTC m=+22.765228069" watchObservedRunningTime="2026-07-06 20:49:19.863004083 +0000 UTC m=+22.765421297" Jul 06 20:49:20.797517 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.797444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvj4g" event={"ID":"0fd63e78-3035-4faa-b686-338c45530cb9","Type":"ContainerStarted","Data":"9465b029d0a72042d38dcde09becd2178a752f01a05f7eb27a541ce27d2aeb07"} Jul 06 20:49:20.799114 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.799091 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c6b0565-8357-41d5-96d6-45fdab333c88" containerID="696b3bc192dbb512f839dbb58bafdf722efa61997331400f3d4586583e6d5c3b" exitCode=0 Jul 06 20:49:20.799229 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.799149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerDied","Data":"696b3bc192dbb512f839dbb58bafdf722efa61997331400f3d4586583e6d5c3b"} Jul 06 20:49:20.802490 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.802471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:49:20.802887 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.802861 2576 generic.go:356] "Generic (PLEG): container finished" podID="6acc2a15-00e8-4b53-bd31-0988fdb3dabc" containerID="a4b8abf5d1d1f5df1c4965e4d506c11f22feacf2dca4a8ab02da4d13e0627a4e" exitCode=1 Jul 06 20:49:20.802989 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.802957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerDied","Data":"a4b8abf5d1d1f5df1c4965e4d506c11f22feacf2dca4a8ab02da4d13e0627a4e"} Jul 06 20:49:20.803059 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.803031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"9bda08c73ab09106ea4dc581ca782d97b447e5f10fde5ed14229cc15714d0128"} Jul 06 20:49:20.803114 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.803083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"f8d49a603972708365e581399b05da1b5aeb96a42cbb300bd4dd02fcc2913e8e"} Jul 06 20:49:20.803167 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.803133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"3ec218fa601ed8a87b8f6b2b0334d8a0aa5173816597877841731da791700afc"} Jul 06 20:49:20.803219 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:20.803184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"b3fc41906f7ad4fd29dec4ced27e127e7c560261a2b054c713778d38227c54d7"} Jul 06 20:49:21.007686 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.007661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:49:21.008286 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.008260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:49:21.027214 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.027167 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gvj4g" podStartSLOduration=5.080067246 podStartE2EDuration="24.027149141s" totalImagesPullingTime="18.947081895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:20.8270602 +0000 UTC m=+23.729477415" watchObservedRunningTime="2026-07-06 20:49:21.027149141 +0000 UTC m=+23.929566357" Jul 06 20:49:21.140868 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.140848 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:49:21.605385 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.605258 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:49:21.140864608Z","UUID":"5100fce5-be4e-4411-b2a8-e57b9bb21166","Handler":null,"Name":"","Endpoint":""} Jul 06 20:49:21.606932 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.606820 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:49:21.606932 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.606862 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:49:21.672719 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.672695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:21.672862 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.672693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:21.672862 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.672827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:21.672862 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:21.672823 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:21.673031 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:21.672931 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:21.673031 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:21.673013 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:21.807851 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.807467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" event={"ID":"395b8bf9-7c30-4296-b24d-45841a9b1641","Type":"ContainerStarted","Data":"8dc1cf50f1df0a58df10c9c284ef43198e3f8e0cd86d8ea47d5a69c3f6b6f73b"} Jul 06 20:49:21.808331 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.807860 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:49:21.808407 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:21.808390 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mk8g9" Jul 06 20:49:22.812893 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:22.812371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" event={"ID":"395b8bf9-7c30-4296-b24d-45841a9b1641","Type":"ContainerStarted","Data":"c7b2a5385dd2ebcaf0f796f87868e3181d09df2ac1e8dd45be9d8814621cafc6"} Jul 06 20:49:22.815731 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:22.815712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:49:22.816196 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:22.816110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"8d8e1d4cce254bca1cfe83aa4a9099b90cae8f367a7b45575651e546ca792656"} Jul 06 20:49:22.835277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:22.835230 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bpjsl" podStartSLOduration=4.575641485 podStartE2EDuration="25.835212371s" totalImagesPullingTime="21.259570886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:22.834147768 +0000 UTC m=+25.736564983" watchObservedRunningTime="2026-07-06 20:49:22.835212371 +0000 UTC m=+25.737629594" Jul 06 20:49:23.668694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:23.668662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:23.668893 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:23.668662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:23.668893 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:23.668788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:23.668893 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:23.668793 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:23.669054 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:23.668896 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:23.669054 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:23.668967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:24.165546 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.165520 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:24.275789 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.274869 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:24.821711 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.821486 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c6b0565-8357-41d5-96d6-45fdab333c88" containerID="1ce15235e7e350a7148eb56cf8ea022409deddbeee01dba0598fbf976dd97cdf" exitCode=0 Jul 06 20:49:24.821891 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.821577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerDied","Data":"1ce15235e7e350a7148eb56cf8ea022409deddbeee01dba0598fbf976dd97cdf"} Jul 06 20:49:24.825236 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.825217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:49:24.825563 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.825541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"acf163df5edc0c4580b2c13f1bcc65d6b452d58a67614de6c73b773fd7912f74"} Jul 06 20:49:24.825833 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.825818 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:49:24.826040 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.826021 2576 scope.go:117] "RemoveContainer" containerID="a4b8abf5d1d1f5df1c4965e4d506c11f22feacf2dca4a8ab02da4d13e0627a4e" Jul 06 20:49:24.842758 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:24.842740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:49:25.669085 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.669054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:25.669757 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:25.669193 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:25.669757 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.669553 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:25.669757 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:25.669693 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:25.669757 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.669729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:25.669960 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:25.669818 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:25.831717 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.831694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:49:25.832053 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.832029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" event={"ID":"6acc2a15-00e8-4b53-bd31-0988fdb3dabc","Type":"ContainerStarted","Data":"5ece34d11f269a899271ab29056dea23f2fde93910abf0e21b75ae159bf99e31"} Jul 06 20:49:25.832202 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.832190 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:49:25.832255 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.832244 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:49:25.848552 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.848530 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:49:25.862418 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.862380 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" podStartSLOduration=9.834200102 podStartE2EDuration="28.862367446s" totalImagesPullingTime="19.028167344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:25.861152357 +0000 UTC m=+28.763569571" watchObservedRunningTime="2026-07-06 20:49:25.862367446 +0000 UTC m=+28.764784659" Jul 06 20:49:25.894287 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:25.894266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:26.362373 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.362343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8fqq"] Jul 06 20:49:26.362533 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.362485 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:26.362585 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:26.362570 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:26.365502 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.365481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxwd5"] Jul 06 20:49:26.365629 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.365583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:26.365718 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:26.365700 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:26.366562 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.366538 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99sk9"] Jul 06 20:49:26.366658 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.366630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:26.366724 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:26.366702 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:26.836394 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.836361 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c6b0565-8357-41d5-96d6-45fdab333c88" containerID="bf7f0cc7f55c46f8af4b77a1c62434b4356655c154786f66abeab6e29cd8c4f8" exitCode=0 Jul 06 20:49:26.836856 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:26.836454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerDied","Data":"bf7f0cc7f55c46f8af4b77a1c62434b4356655c154786f66abeab6e29cd8c4f8"} Jul 06 20:49:27.670029 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:27.669864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:27.670184 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:27.670111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:28.668353 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:28.668327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:28.668712 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:28.668330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:28.668712 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:28.668414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:28.668712 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:28.668501 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:28.842548 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:28.842479 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c6b0565-8357-41d5-96d6-45fdab333c88" containerID="ea1d1293f1fbe930964f1ac55caff23068837d7ce089e67d063dbcbc05a432d1" exitCode=0 Jul 06 20:49:28.842548 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:28.842542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerDied","Data":"ea1d1293f1fbe930964f1ac55caff23068837d7ce089e67d063dbcbc05a432d1"} Jul 06 20:49:28.973751 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:28.973711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:29.074081 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:29.074048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:29.142068 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:29.141989 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:29.671671 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:29.671643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:29.672364 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:29.671764 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:30.668828 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:30.668803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:30.669011 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:30.668906 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:30.669074 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:30.669006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:30.669127 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:30.669100 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:31.251222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:31.251194 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:31.297073 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:31.297044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:31.297208 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.297159 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:31.297249 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.297209 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret podName:88c64e78-a89d-47e1-8694-755a2133c0cb nodeName:}" failed. No retries permitted until 2026-07-06 20:50:03.297196074 +0000 UTC m=+66.199613270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret") pod "global-pull-secret-syncer-m8fqq" (UID: "88c64e78-a89d-47e1-8694-755a2133c0cb") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:31.352100 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:31.352018 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:31.398293 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:31.398258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:31.398443 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.398427 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:31.398494 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.398485 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:03.398472249 +0000 UTC m=+66.300889445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:31.499474 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:31.499445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:31.499652 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.499575 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:31.499652 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.499594 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:31.499652 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.499606 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pzjvf for pod openshift-network-diagnostics/network-check-target-99sk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:31.499779 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.499668 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf podName:fd8640b2-e59b-4157-b2bd-9cb7bf1e9514 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:03.499654271 +0000 UTC m=+66.402071466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzjvf" (UniqueName: "kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf") pod "network-check-target-99sk9" (UID: "fd8640b2-e59b-4157-b2bd-9cb7bf1e9514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:31.671689 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:31.671664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:31.671836 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:31.671771 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxwd5" podUID="d88b54e9-ad7a-4289-8981-312cb84aac57" Jul 06 20:49:32.020117 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:32.020033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:32.079385 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:32.079347 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:32.668273 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:32.668242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:32.668729 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:32.668246 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:32.668729 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:32.668344 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8fqq" podUID="88c64e78-a89d-47e1-8694-755a2133c0cb" Jul 06 20:49:32.668729 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:32.668455 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99sk9" podUID="fd8640b2-e59b-4157-b2bd-9cb7bf1e9514" Jul 06 20:49:33.393488 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.393317 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-164.ec2.internal" event="NodeReady" Jul 06 20:49:33.393592 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.393587 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:49:33.437831 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.437804 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gh27w"] Jul 06 20:49:33.453792 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.453760 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9jqrw"] Jul 06 20:49:33.453905 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.453816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.458745 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.458727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:49:33.458854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.458727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cqvbv\"" Jul 06 20:49:33.458978 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.458962 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:49:33.466381 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.466363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gh27w"] Jul 06 20:49:33.466463 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.466393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9jqrw"] Jul 06 20:49:33.466505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.466463 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.470057 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.470038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:49:33.470130 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.470080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:49:33.470377 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.470363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wqqk\"" Jul 06 20:49:33.470479 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.470462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:49:33.616461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.616397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-tmp-dir\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.616461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.616430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqcr6\" (UniqueName: \"kubernetes.io/projected/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-kube-api-access-kqcr6\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.616461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.616453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtcs\" (UniqueName: \"kubernetes.io/projected/3cde5ee0-abcd-42de-8f5f-0332734aa7af-kube-api-access-qjtcs\") pod \"ingress-canary-9jqrw\" (UID: \"3cde5ee0-abcd-42de-8f5f-0332734aa7af\") " pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.616655 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.616520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cde5ee0-abcd-42de-8f5f-0332734aa7af-cert\") pod \"ingress-canary-9jqrw\" (UID: \"3cde5ee0-abcd-42de-8f5f-0332734aa7af\") " pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.616655 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.616551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-config-volume\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.616655 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.616573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.669107 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.669088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:49:33.671687 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.671668 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:49:33.671928 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.671913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mg5p6\"" Jul 06 20:49:33.717802 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.717776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-tmp-dir\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.717908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.717810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqcr6\" (UniqueName: \"kubernetes.io/projected/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-kube-api-access-kqcr6\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.717908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.717832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtcs\" (UniqueName: \"kubernetes.io/projected/3cde5ee0-abcd-42de-8f5f-0332734aa7af-kube-api-access-qjtcs\") pod \"ingress-canary-9jqrw\" (UID: \"3cde5ee0-abcd-42de-8f5f-0332734aa7af\") " pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.717908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.717860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cde5ee0-abcd-42de-8f5f-0332734aa7af-cert\") pod \"ingress-canary-9jqrw\" (UID: \"3cde5ee0-abcd-42de-8f5f-0332734aa7af\") " pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.717908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.717878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-config-volume\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.717908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.717893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.718131 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:33.717970 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:33.718131 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:33.718029 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls podName:6ae3bdd5-5da5-4f44-8da2-b10d637b8c44 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:34.218011741 +0000 UTC m=+37.120428951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls") pod "dns-default-gh27w" (UID: "6ae3bdd5-5da5-4f44-8da2-b10d637b8c44") : secret "dns-default-metrics-tls" not found Jul 06 20:49:33.718205 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.718189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-tmp-dir\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.718443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.718425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-config-volume\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.722284 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.722269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cde5ee0-abcd-42de-8f5f-0332734aa7af-cert\") pod \"ingress-canary-9jqrw\" (UID: \"3cde5ee0-abcd-42de-8f5f-0332734aa7af\") " pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.727357 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.727338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqcr6\" (UniqueName: \"kubernetes.io/projected/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-kube-api-access-kqcr6\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:33.727650 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.727633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtcs\" (UniqueName: \"kubernetes.io/projected/3cde5ee0-abcd-42de-8f5f-0332734aa7af-kube-api-access-qjtcs\") pod \"ingress-canary-9jqrw\" (UID: \"3cde5ee0-abcd-42de-8f5f-0332734aa7af\") " pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.774685 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.774665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9jqrw" Jul 06 20:49:33.861859 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.861533 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c6b0565-8357-41d5-96d6-45fdab333c88" containerID="49c45f29cc7d8f0330875ca41fe9e7041f1fc1b8ea2600f5959e655cd83688e1" exitCode=0 Jul 06 20:49:33.861859 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.861635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerDied","Data":"49c45f29cc7d8f0330875ca41fe9e7041f1fc1b8ea2600f5959e655cd83688e1"} Jul 06 20:49:33.912743 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:33.912643 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9jqrw"] Jul 06 20:49:33.918449 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:49:33.918425 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cde5ee0_abcd_42de_8f5f_0332734aa7af.slice/crio-640d90b8065896ffaf736b79b23c48c9974b3cf3aa8345b1c4fc2d993c8a5df4 WatchSource:0}: Error finding container 640d90b8065896ffaf736b79b23c48c9974b3cf3aa8345b1c4fc2d993c8a5df4: Status 404 returned error can't find the container with id 640d90b8065896ffaf736b79b23c48c9974b3cf3aa8345b1c4fc2d993c8a5df4 Jul 06 20:49:34.221028 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.220993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:34.221170 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:34.221131 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:34.221207 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:34.221195 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls podName:6ae3bdd5-5da5-4f44-8da2-b10d637b8c44 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:35.221180461 +0000 UTC m=+38.123597657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls") pod "dns-default-gh27w" (UID: "6ae3bdd5-5da5-4f44-8da2-b10d637b8c44") : secret "dns-default-metrics-tls" not found Jul 06 20:49:34.668926 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.668896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:49:34.669116 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.669071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:49:34.671887 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.671866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:49:34.672097 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.672074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:49:34.672916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.672898 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xtfpf\"" Jul 06 20:49:34.673008 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.672931 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:49:34.867888 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.867851 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c6b0565-8357-41d5-96d6-45fdab333c88" containerID="649d4fa65b5e448d33c86e737f7782e7939bec18602319fd012cdaac152eb574" exitCode=0 Jul 06 20:49:34.868052 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.867955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerDied","Data":"649d4fa65b5e448d33c86e737f7782e7939bec18602319fd012cdaac152eb574"} Jul 06 20:49:34.869652 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:34.869273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9jqrw" event={"ID":"3cde5ee0-abcd-42de-8f5f-0332734aa7af","Type":"ContainerStarted","Data":"640d90b8065896ffaf736b79b23c48c9974b3cf3aa8345b1c4fc2d993c8a5df4"} Jul 06 20:49:35.228212 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:35.227945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:35.228398 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:35.228106 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:35.228398 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:35.228318 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls podName:6ae3bdd5-5da5-4f44-8da2-b10d637b8c44 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:37.22829303 +0000 UTC m=+40.130710246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls") pod "dns-default-gh27w" (UID: "6ae3bdd5-5da5-4f44-8da2-b10d637b8c44") : secret "dns-default-metrics-tls" not found Jul 06 20:49:35.875684 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:35.875651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshnd" event={"ID":"1c6b0565-8357-41d5-96d6-45fdab333c88","Type":"ContainerStarted","Data":"79c0cb33010c86743d4ef22c700cf146051dbfc0535e98e160c8b891f8ad768c"} Jul 06 20:49:36.056433 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.056409 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:36.153722 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.153645 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:36.537983 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.537949 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:36.617305 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.617280 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:36.879648 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.879542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9jqrw" event={"ID":"3cde5ee0-abcd-42de-8f5f-0332734aa7af","Type":"ContainerStarted","Data":"a5e8a1245b3a5608a45d1040291f9766acff5b1555d158a351e4687168bb30ea"} Jul 06 20:49:36.895751 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.895700 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dshnd" podStartSLOduration=9.929330547 podStartE2EDuration="39.895683407s" totalImagesPullingTime="29.96635286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:35.917032997 +0000 UTC m=+38.819450211" watchObservedRunningTime="2026-07-06 20:49:36.895683407 +0000 UTC m=+39.798100622" Jul 06 20:49:36.896145 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:36.896094 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9jqrw" podStartSLOduration=1.805476504 podStartE2EDuration="3.896087339s" totalImagesPullingTime="2.090610835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:36.895151923 +0000 UTC m=+39.797569137" watchObservedRunningTime="2026-07-06 20:49:36.896087339 +0000 UTC m=+39.798504573" Jul 06 20:49:37.241759 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:37.241732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:37.241907 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:37.241838 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:37.241907 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:37.241886 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls podName:6ae3bdd5-5da5-4f44-8da2-b10d637b8c44 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:41.241875296 +0000 UTC m=+44.144292492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls") pod "dns-default-gh27w" (UID: "6ae3bdd5-5da5-4f44-8da2-b10d637b8c44") : secret "dns-default-metrics-tls" not found Jul 06 20:49:39.333764 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:39.333730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:41.267361 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:41.267325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:41.267770 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:41.267466 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:41.267770 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:41.267536 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls podName:6ae3bdd5-5da5-4f44-8da2-b10d637b8c44 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:49.267520187 +0000 UTC m=+52.169937378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls") pod "dns-default-gh27w" (UID: "6ae3bdd5-5da5-4f44-8da2-b10d637b8c44") : secret "dns-default-metrics-tls" not found Jul 06 20:49:43.372629 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.372580 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8"] Jul 06 20:49:43.394073 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.394047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8"] Jul 06 20:49:43.394193 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.394129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" Jul 06 20:49:43.397851 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.397830 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 20:49:43.398305 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.398288 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zjkjr\"" Jul 06 20:49:43.398398 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.398321 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:49:43.484145 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.484122 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z"] Jul 06 20:49:43.504358 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.504320 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86476bbd4c-gshm9"] Jul 06 20:49:43.504554 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.504534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.511584 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.511540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 20:49:43.511707 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.511596 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-87ssj\"" Jul 06 20:49:43.511754 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.511744 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 20:49:43.511944 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.511922 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 20:49:43.512027 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.511931 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:49:43.522496 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.522478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.522496 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.522481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z"] Jul 06 20:49:43.522629 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.522525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86476bbd4c-gshm9"] Jul 06 20:49:43.525080 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.525047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:49:43.525173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.525134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:49:43.525246 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.525210 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:49:43.525356 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.525251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2xps\"" Jul 06 20:49:43.530423 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.530405 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:49:43.574140 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.574117 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:43.583401 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.583381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgnzw\" (UniqueName: \"kubernetes.io/projected/c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1-kube-api-access-qgnzw\") pod \"volume-data-source-validator-5d456fdbcd-t29v8\" (UID: \"c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" Jul 06 20:49:43.671778 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.671757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:43.683913 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.683898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgnzw\" (UniqueName: \"kubernetes.io/projected/c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1-kube-api-access-qgnzw\") pod \"volume-data-source-validator-5d456fdbcd-t29v8\" (UID: \"c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" Jul 06 20:49:43.683990 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.683924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-installation-pull-secrets\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.683990 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.683948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-trusted-ca\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684060 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ht75\" (UniqueName: \"kubernetes.io/projected/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-kube-api-access-2ht75\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.684098 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684131 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-image-registry-private-configuration\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684131 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ada4eca-8672-4e89-9358-72e6e30ac9c2-ca-trust-extracted\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-certificates\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-bound-sa-token\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684274 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl5zp\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-kube-api-access-wl5zp\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.684274 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.684274 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.684260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.693311 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.693292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgnzw\" (UniqueName: \"kubernetes.io/projected/c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1-kube-api-access-qgnzw\") pod \"volume-data-source-validator-5d456fdbcd-t29v8\" (UID: \"c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" Jul 06 20:49:43.703021 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.703003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" Jul 06 20:49:43.785441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ht75\" (UniqueName: \"kubernetes.io/projected/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-kube-api-access-2ht75\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-image-registry-private-configuration\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ada4eca-8672-4e89-9358-72e6e30ac9c2-ca-trust-extracted\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-certificates\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-bound-sa-token\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl5zp\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-kube-api-access-wl5zp\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.785829 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.785829 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-installation-pull-secrets\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.785829 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.785678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-trusted-ca\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.786446 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:43.786125 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:43.786446 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:43.786147 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86476bbd4c-gshm9: secret "image-registry-tls" not found Jul 06 20:49:43.786446 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:43.786215 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls podName:9ada4eca-8672-4e89-9358-72e6e30ac9c2 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:44.286195517 +0000 UTC m=+47.188612726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls") pod "image-registry-86476bbd4c-gshm9" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2") : secret "image-registry-tls" not found Jul 06 20:49:43.786724 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.786562 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.786724 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.786639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-trusted-ca\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.786724 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.786638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-certificates\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.786975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.786805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ada4eca-8672-4e89-9358-72e6e30ac9c2-ca-trust-extracted\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.788457 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.788437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.788537 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.788495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-image-registry-private-configuration\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.789060 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.789042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-installation-pull-secrets\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.798321 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.798274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ht75\" (UniqueName: \"kubernetes.io/projected/ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b-kube-api-access-2ht75\") pod \"kube-storage-version-migrator-operator-846bf668f7-tlc5z\" (UID: \"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.798678 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.798657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-bound-sa-token\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.799585 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.799560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl5zp\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-kube-api-access-wl5zp\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:43.813262 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.813237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" Jul 06 20:49:43.843235 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.843208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8"] Jul 06 20:49:43.846706 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:49:43.846686 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16c93f1_c5f3_45fd_a51f_8b9e7090b5b1.slice/crio-5b000a9080a05a84b9750d52855b7295c3c54be7f675f2b5436c17bd36532e0d WatchSource:0}: Error finding container 5b000a9080a05a84b9750d52855b7295c3c54be7f675f2b5436c17bd36532e0d: Status 404 returned error can't find the container with id 5b000a9080a05a84b9750d52855b7295c3c54be7f675f2b5436c17bd36532e0d Jul 06 20:49:43.896880 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.896849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" event={"ID":"c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1","Type":"ContainerStarted","Data":"5b000a9080a05a84b9750d52855b7295c3c54be7f675f2b5436c17bd36532e0d"} Jul 06 20:49:43.963911 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:43.963846 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z"] Jul 06 20:49:43.966675 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:49:43.966651 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5aa2bb_46cb_4de9_b6a4_d5b0e3042c9b.slice/crio-c06a18036b6dbc25302e3d4d3cbb95d2eea32733a1ec7fe5e7d232839a2409c5 WatchSource:0}: Error finding container c06a18036b6dbc25302e3d4d3cbb95d2eea32733a1ec7fe5e7d232839a2409c5: Status 404 returned error can't find the container with id c06a18036b6dbc25302e3d4d3cbb95d2eea32733a1ec7fe5e7d232839a2409c5 Jul 06 20:49:44.289939 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:44.289862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:44.290083 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:44.289987 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:44.290083 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:44.289999 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86476bbd4c-gshm9: secret "image-registry-tls" not found Jul 06 20:49:44.290083 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:44.290055 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls podName:9ada4eca-8672-4e89-9358-72e6e30ac9c2 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:45.29004126 +0000 UTC m=+48.192458453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls") pod "image-registry-86476bbd4c-gshm9" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2") : secret "image-registry-tls" not found Jul 06 20:49:44.901353 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:44.901316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" event={"ID":"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b","Type":"ContainerStarted","Data":"c06a18036b6dbc25302e3d4d3cbb95d2eea32733a1ec7fe5e7d232839a2409c5"} Jul 06 20:49:45.298681 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:45.298642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:45.298864 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:45.298781 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:45.298864 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:45.298794 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86476bbd4c-gshm9: secret "image-registry-tls" not found Jul 06 20:49:45.298864 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:45.298852 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls podName:9ada4eca-8672-4e89-9358-72e6e30ac9c2 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:47.29883223 +0000 UTC m=+50.201249422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls") pod "image-registry-86476bbd4c-gshm9" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2") : secret "image-registry-tls" not found Jul 06 20:49:45.905085 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:45.905009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" event={"ID":"c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1","Type":"ContainerStarted","Data":"948ed4016515ff475fef184cd8af316e287605b1144de6c3024cab329cde2531"} Jul 06 20:49:45.922608 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:45.922567 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t29v8" podStartSLOduration=1.16783723 podStartE2EDuration="2.922553563s" totalImagesPullingTime="1.754716333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:45.92239349 +0000 UTC m=+48.824810704" watchObservedRunningTime="2026-07-06 20:49:45.922553563 +0000 UTC m=+48.824970777" Jul 06 20:49:46.059381 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:46.059355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:46.160238 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:46.160214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:47.074996 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:47.074970 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:47.179938 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:47.179913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:47.313079 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:47.313049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:47.313256 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:47.313150 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:47.313256 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:47.313161 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86476bbd4c-gshm9: secret "image-registry-tls" not found Jul 06 20:49:47.313256 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:47.313203 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls podName:9ada4eca-8672-4e89-9358-72e6e30ac9c2 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:51.313191103 +0000 UTC m=+54.215608296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls") pod "image-registry-86476bbd4c-gshm9" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2") : secret "image-registry-tls" not found Jul 06 20:49:47.910633 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:47.910588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" event={"ID":"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b","Type":"ContainerStarted","Data":"b85fb74dc6a2975c3a9f3a075497fcaf27227fccc54b4366d7233c3c31e6408a"} Jul 06 20:49:47.932464 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:47.932422 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" podStartSLOduration=1.787613027 podStartE2EDuration="4.932404266s" totalImagesPullingTime="3.144791239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:47.931687006 +0000 UTC m=+50.834104221" watchObservedRunningTime="2026-07-06 20:49:47.932404266 +0000 UTC m=+50.834821480" Jul 06 20:49:48.185088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:48.185006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:48.281951 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:48.281915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:49.168202 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.168175 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6"] Jul 06 20:49:49.185851 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.185813 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6"] Jul 06 20:49:49.186198 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.185929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" Jul 06 20:49:49.188281 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.188255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gkgfc\"" Jul 06 20:49:49.189036 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.189021 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 20:49:49.189248 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.189224 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 20:49:49.226310 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.226283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2sch\" (UniqueName: \"kubernetes.io/projected/bd5bc2d3-cd57-4048-8974-e0339d6eb73f-kube-api-access-r2sch\") pod \"migrator-d57d58cc9-5rzk6\" (UID: \"bd5bc2d3-cd57-4048-8974-e0339d6eb73f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" Jul 06 20:49:49.230956 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.230936 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:49.237204 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.237188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tvpd5"] Jul 06 20:49:49.256087 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.256062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.257764 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.257746 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvpd5"] Jul 06 20:49:49.258767 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.258748 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:49:49.258945 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.258931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:49:49.259014 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.258967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:49:49.259088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.259068 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8tr2s\"" Jul 06 20:49:49.259142 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.259095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:49:49.305221 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.305162 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:49.327441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:49:49.327513 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-crio-socket\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.327513 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.327601 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-data-volume\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.327601 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2sch\" (UniqueName: \"kubernetes.io/projected/bd5bc2d3-cd57-4048-8974-e0339d6eb73f-kube-api-access-r2sch\") pod \"migrator-d57d58cc9-5rzk6\" (UID: \"bd5bc2d3-cd57-4048-8974-e0339d6eb73f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" Jul 06 20:49:49.327601 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.327567 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:49.327601 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb2kp\" (UniqueName: \"kubernetes.io/projected/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-api-access-zb2kp\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.327765 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.327609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.327765 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.327665 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls podName:6ae3bdd5-5da5-4f44-8da2-b10d637b8c44 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:05.32764732 +0000 UTC m=+68.230064532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls") pod "dns-default-gh27w" (UID: "6ae3bdd5-5da5-4f44-8da2-b10d637b8c44") : secret "dns-default-metrics-tls" not found Jul 06 20:49:49.336218 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.336194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2sch\" (UniqueName: \"kubernetes.io/projected/bd5bc2d3-cd57-4048-8974-e0339d6eb73f-kube-api-access-r2sch\") pod \"migrator-d57d58cc9-5rzk6\" (UID: \"bd5bc2d3-cd57-4048-8974-e0339d6eb73f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" Jul 06 20:49:49.428760 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.428697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.428760 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.428728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-data-volume\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.428760 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.428754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb2kp\" (UniqueName: \"kubernetes.io/projected/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-api-access-zb2kp\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.428961 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.428813 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:49:49.428961 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.428871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.428961 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.428883 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:49.92886598 +0000 UTC m=+52.831283172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : configmap "kube-rbac-proxy" not found Jul 06 20:49:49.428961 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.428949 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:49:49.429100 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.428993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-crio-socket\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.429100 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.429030 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:49.929022595 +0000 UTC m=+52.831439787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : secret "insights-runtime-extractor-tls" not found Jul 06 20:49:49.429100 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.429054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-data-volume\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.429195 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.429127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-crio-socket\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.437407 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.437379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb2kp\" (UniqueName: \"kubernetes.io/projected/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-api-access-zb2kp\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.494328 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.494309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" Jul 06 20:49:49.630581 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.630550 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6"] Jul 06 20:49:49.633588 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:49:49.633564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5bc2d3_cd57_4048_8974_e0339d6eb73f.slice/crio-c3e0e7f936a04e3cb166044fcc9f01d1d252d65818393fbc045b1d1c1d018b97 WatchSource:0}: Error finding container c3e0e7f936a04e3cb166044fcc9f01d1d252d65818393fbc045b1d1c1d018b97: Status 404 returned error can't find the container with id c3e0e7f936a04e3cb166044fcc9f01d1d252d65818393fbc045b1d1c1d018b97 Jul 06 20:49:49.916568 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.916535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" event={"ID":"bd5bc2d3-cd57-4048-8974-e0339d6eb73f","Type":"ContainerStarted","Data":"c3e0e7f936a04e3cb166044fcc9f01d1d252d65818393fbc045b1d1c1d018b97"} Jul 06 20:49:49.932953 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.932934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.933011 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:49.932971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:49.933078 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.933061 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:49:49.933111 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.933078 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:49:49.933146 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.933129 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:50.933113257 +0000 UTC m=+53.835530449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : configmap "kube-rbac-proxy" not found Jul 06 20:49:49.933146 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:49.933142 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:50.933136374 +0000 UTC m=+53.835553566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : secret "insights-runtime-extractor-tls" not found Jul 06 20:49:50.376759 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.376685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:50.616270 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.616234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:50.718995 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.718967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:50.817281 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.817248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:50.923577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.923548 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:50.939900 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.939875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:50.940021 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:50.939924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:50.940021 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:50.939991 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:49:50.940021 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:50.940018 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:49:50.940150 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:50.940055 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:52.940038582 +0000 UTC m=+55.842455774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : configmap "kube-rbac-proxy" not found Jul 06 20:49:50.940150 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:50.940071 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:52.940064776 +0000 UTC m=+55.842481969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : secret "insights-runtime-extractor-tls" not found Jul 06 20:49:51.017441 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:51.017362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:51.218406 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:51.218371 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:51.343405 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:51.343338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:51.343541 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:51.343454 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:51.343541 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:51.343466 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86476bbd4c-gshm9: secret "image-registry-tls" not found Jul 06 20:49:51.343541 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:51.343510 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls podName:9ada4eca-8672-4e89-9358-72e6e30ac9c2 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:59.343498808 +0000 UTC m=+62.245916000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls") pod "image-registry-86476bbd4c-gshm9" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2") : secret "image-registry-tls" not found Jul 06 20:49:51.926962 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:51.926932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" event={"ID":"bd5bc2d3-cd57-4048-8974-e0339d6eb73f","Type":"ContainerStarted","Data":"f16ef921dfe41f182a9fd8c3f8db6cc71e475d232907e03ea4432ce453f421d4"} Jul 06 20:49:51.927323 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:51.927012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" event={"ID":"bd5bc2d3-cd57-4048-8974-e0339d6eb73f","Type":"ContainerStarted","Data":"665ca1626e5a7ae1861d4fd442406e635ed6c5163f31cc933c24cddac183bd66"} Jul 06 20:49:51.957050 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:51.957006 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5rzk6" podStartSLOduration=1.048246597 podStartE2EDuration="2.956992556s" totalImagesPullingTime="1.908745959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:51.956982907 +0000 UTC m=+54.859400121" watchObservedRunningTime="2026-07-06 20:49:51.956992556 +0000 UTC m=+54.859409770" Jul 06 20:49:52.019933 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.019913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktp2g_67b00bfb-db02-4134-b663-7aad9217abe2/dns-node-resolver/0.log" Jul 06 20:49:52.086133 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.086103 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:52.185829 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.185762 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:52.686453 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.686421 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xl65f"] Jul 06 20:49:52.712659 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.712636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xl65f"] Jul 06 20:49:52.712782 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.712717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.715296 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.715277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 20:49:52.715296 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.715289 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 20:49:52.716348 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.716329 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 20:49:52.716435 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.716363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-brzcr\"" Jul 06 20:49:52.716512 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.716493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 20:49:52.753804 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.753778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/62691ba8-2068-4a79-b88c-ea318438ad6b-signing-key\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.753910 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.753850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gml\" (UniqueName: \"kubernetes.io/projected/62691ba8-2068-4a79-b88c-ea318438ad6b-kube-api-access-n2gml\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.753968 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.753912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/62691ba8-2068-4a79-b88c-ea318438ad6b-signing-cabundle\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.800824 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.800799 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:52.855226 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.855197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gml\" (UniqueName: \"kubernetes.io/projected/62691ba8-2068-4a79-b88c-ea318438ad6b-kube-api-access-n2gml\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.855326 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.855231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/62691ba8-2068-4a79-b88c-ea318438ad6b-signing-cabundle\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.855326 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.855311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/62691ba8-2068-4a79-b88c-ea318438ad6b-signing-key\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.855902 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.855883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/62691ba8-2068-4a79-b88c-ea318438ad6b-signing-cabundle\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.857752 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.857733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/62691ba8-2068-4a79-b88c-ea318438ad6b-signing-key\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.864664 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.864642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gml\" (UniqueName: \"kubernetes.io/projected/62691ba8-2068-4a79-b88c-ea318438ad6b-kube-api-access-n2gml\") pod \"service-ca-758f599c5-xl65f\" (UID: \"62691ba8-2068-4a79-b88c-ea318438ad6b\") " pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:52.898178 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.898148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:52.955973 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.955920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:52.955973 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:52.955950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:52.956271 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:52.956030 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:49:52.956271 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:52.956064 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:49:52.956271 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:52.956090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:56.956075262 +0000 UTC m=+59.858492467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : configmap "kube-rbac-proxy" not found Jul 06 20:49:52.956271 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:52.956111 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:56.956099926 +0000 UTC m=+59.858517118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : secret "insights-runtime-extractor-tls" not found Jul 06 20:49:53.022118 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:53.022091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xl65f" Jul 06 20:49:53.169658 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:53.169629 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xl65f"] Jul 06 20:49:53.173232 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:49:53.173204 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62691ba8_2068_4a79_b88c_ea318438ad6b.slice/crio-5edb938db8a65051ac17f3ec02d466531f6eeb74b4860d4d8fc396b0e509b808 WatchSource:0}: Error finding container 5edb938db8a65051ac17f3ec02d466531f6eeb74b4860d4d8fc396b0e509b808: Status 404 returned error can't find the container with id 5edb938db8a65051ac17f3ec02d466531f6eeb74b4860d4d8fc396b0e509b808 Jul 06 20:49:53.217401 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:53.217352 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x2gsk_637895eb-a57a-4aff-8148-6226bbf552c8/node-ca/0.log" Jul 06 20:49:53.616850 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:53.616789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9jqrw_3cde5ee0-abcd-42de-8f5f-0332734aa7af/serve-healthcheck-canary/0.log" Jul 06 20:49:53.675853 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:53.675830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:53.934606 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:53.934539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xl65f" event={"ID":"62691ba8-2068-4a79-b88c-ea318438ad6b","Type":"ContainerStarted","Data":"5edb938db8a65051ac17f3ec02d466531f6eeb74b4860d4d8fc396b0e509b808"} Jul 06 20:49:54.217186 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:54.217106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5rzk6_bd5bc2d3-cd57-4048-8974-e0339d6eb73f/migrator/0.log" Jul 06 20:49:54.416731 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:54.416703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5rzk6_bd5bc2d3-cd57-4048-8974-e0339d6eb73f/graceful-termination/0.log" Jul 06 20:49:54.616916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:54.616846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tlc5z_ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b/kube-storage-version-migrator-operator/0.log" Jul 06 20:49:55.944997 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:55.944962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xl65f" event={"ID":"62691ba8-2068-4a79-b88c-ea318438ad6b","Type":"ContainerStarted","Data":"5aa6cad688d4650d594267cd077bbb9e9440016247c9e494e69de8f49a715ad6"} Jul 06 20:49:55.960900 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:55.960855 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-xl65f" podStartSLOduration=1.544735542 podStartE2EDuration="3.960840639s" totalImagesPullingTime="2.416105097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:55.959554337 +0000 UTC m=+58.861971550" watchObservedRunningTime="2026-07-06 20:49:55.960840639 +0000 UTC m=+58.863257853" Jul 06 20:49:56.928408 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:56.928374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:56.987578 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:56.987543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:56.988038 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:56.987591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:49:56.988038 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:56.987729 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:49:56.988038 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:56.987796 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:04.987779311 +0000 UTC m=+67.890196516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : secret "insights-runtime-extractor-tls" not found Jul 06 20:49:56.988038 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:56.987825 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:49:56.988038 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:56.987899 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:04.987882523 +0000 UTC m=+67.890299733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : configmap "kube-rbac-proxy" not found Jul 06 20:49:57.061477 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.061448 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:57.161983 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.161958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:57.266262 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.266188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:57.379409 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.379387 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:57.617222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.617127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:57.719413 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.719376 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:57.848995 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:57.848970 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vcn6" Jul 06 20:49:58.418338 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:58.418311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:58.808267 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:58.808147 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:59.215745 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:59.215715 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:59.406743 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:59.406715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") pod \"image-registry-86476bbd4c-gshm9\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:49:59.406916 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:59.406862 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:59.406916 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:59.406877 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86476bbd4c-gshm9: secret "image-registry-tls" not found Jul 06 20:49:59.407020 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:49:59.406928 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls podName:9ada4eca-8672-4e89-9358-72e6e30ac9c2 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:15.406914535 +0000 UTC m=+78.309331729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls") pod "image-registry-86476bbd4c-gshm9" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2") : secret "image-registry-tls" not found Jul 06 20:49:59.414531 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:59.414503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:59.806773 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:49:59.806743 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:00.534183 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:00.534152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:00.636572 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:00.636543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:00.702556 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:00.702508 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:00.831253 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:00.831160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:01.218795 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:01.218773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:01.387862 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:01.387830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:01.506355 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:01.506260 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:02.027275 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:02.027239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:02.617068 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:02.617036 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:02.800443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:02.800405 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:03.010954 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.010923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:03.261695 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.261592 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:03.336927 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.336889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:50:03.339790 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.339775 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:50:03.349689 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.349665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88c64e78-a89d-47e1-8694-755a2133c0cb-original-pull-secret\") pod \"global-pull-secret-syncer-m8fqq\" (UID: \"88c64e78-a89d-47e1-8694-755a2133c0cb\") " pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:50:03.437470 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.437447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:50:03.440463 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.440444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:50:03.447796 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:03.447777 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:50:03.447876 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:03.447841 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs podName:d88b54e9-ad7a-4289-8981-312cb84aac57 nodeName:}" failed. No retries permitted until 2026-07-06 20:51:07.447822342 +0000 UTC m=+130.350239535 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs") pod "network-metrics-daemon-rxwd5" (UID: "d88b54e9-ad7a-4289-8981-312cb84aac57") : secret "metrics-daemon-secret" not found Jul 06 20:50:03.480428 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.480410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8fqq" Jul 06 20:50:03.482372 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.482355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:03.538934 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.538802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:50:03.541962 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.541938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:50:03.552083 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.552056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:50:03.562841 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.562820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjvf\" (UniqueName: \"kubernetes.io/projected/fd8640b2-e59b-4157-b2bd-9cb7bf1e9514-kube-api-access-pzjvf\") pod \"network-check-target-99sk9\" (UID: \"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514\") " pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:50:03.603528 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.603502 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8fqq"] Jul 06 20:50:03.606365 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:03.606342 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c64e78_a89d_47e1_8694_755a2133c0cb.slice/crio-900cea3a45e77878abbb4240309e4a8615664fb69a62e29a6c5c282529b997ea WatchSource:0}: Error finding container 900cea3a45e77878abbb4240309e4a8615664fb69a62e29a6c5c282529b997ea: Status 404 returned error can't find the container with id 900cea3a45e77878abbb4240309e4a8615664fb69a62e29a6c5c282529b997ea Jul 06 20:50:03.788736 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.788675 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xtfpf\"" Jul 06 20:50:03.796949 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.796934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:50:03.922107 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.922071 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99sk9"] Jul 06 20:50:03.925829 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:03.925796 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8640b2_e59b_4157_b2bd_9cb7bf1e9514.slice/crio-89b84eda109ca56661de3d25ee26b7fec1749fc8b96b15d15f5e82d829b57eeb WatchSource:0}: Error finding container 89b84eda109ca56661de3d25ee26b7fec1749fc8b96b15d15f5e82d829b57eeb: Status 404 returned error can't find the container with id 89b84eda109ca56661de3d25ee26b7fec1749fc8b96b15d15f5e82d829b57eeb Jul 06 20:50:03.970603 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.970575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8fqq" event={"ID":"88c64e78-a89d-47e1-8694-755a2133c0cb","Type":"ContainerStarted","Data":"900cea3a45e77878abbb4240309e4a8615664fb69a62e29a6c5c282529b997ea"} Jul 06 20:50:03.971660 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:03.971635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99sk9" event={"ID":"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514","Type":"ContainerStarted","Data":"89b84eda109ca56661de3d25ee26b7fec1749fc8b96b15d15f5e82d829b57eeb"} Jul 06 20:50:04.005713 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:04.005685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:04.229510 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:04.229478 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:04.300672 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:04.300641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:04.420454 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:04.420423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:04.802458 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:04.802422 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:05.031050 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.031019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:05.054300 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.054238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:50:05.054300 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.054273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:50:05.054493 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:05.054384 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:05.054493 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:05.054448 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls podName:d42b0367-c24f-4dc7-807d-d9cd1bc028c9 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:21.054430974 +0000 UTC m=+83.956848188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvpd5" (UID: "d42b0367-c24f-4dc7-807d-d9cd1bc028c9") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:05.054901 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.054855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:50:05.211339 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.211263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:05.356523 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.356437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:50:05.360640 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.359426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ae3bdd5-5da5-4f44-8da2-b10d637b8c44-metrics-tls\") pod \"dns-default-gh27w\" (UID: \"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44\") " pod="openshift-dns/dns-default-gh27w" Jul 06 20:50:05.429768 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.429738 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:05.565215 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.565181 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cqvbv\"" Jul 06 20:50:05.573677 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.573653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gh27w" Jul 06 20:50:05.756047 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.756013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gh27w"] Jul 06 20:50:05.762518 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:05.762457 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae3bdd5_5da5_4f44_8da2_b10d637b8c44.slice/crio-e230dc2bfc383cc2c9438e088bd502215633f608d69347566331dac78cbb48b6 WatchSource:0}: Error finding container e230dc2bfc383cc2c9438e088bd502215633f608d69347566331dac78cbb48b6: Status 404 returned error can't find the container with id e230dc2bfc383cc2c9438e088bd502215633f608d69347566331dac78cbb48b6 Jul 06 20:50:05.806484 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.806407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:05.982018 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:05.981984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gh27w" event={"ID":"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44","Type":"ContainerStarted","Data":"e230dc2bfc383cc2c9438e088bd502215633f608d69347566331dac78cbb48b6"} Jul 06 20:50:06.212537 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:06.212496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:06.312353 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:06.312278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:06.415992 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:06.415953 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:06.502050 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:06.502012 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:06.814226 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:06.814187 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:06.924255 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:06.924218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.013942 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.013908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.209149 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.209107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.282038 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.282002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.397644 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.397594 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.470168 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.470097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.622933 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.622895 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:07.794124 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:07.794038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:08.195017 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:08.194989 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:08.295964 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:08.295929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:09.638430 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:09.638391 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:09.731868 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:09.731833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:11.006034 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.005990 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8fqq" event={"ID":"88c64e78-a89d-47e1-8694-755a2133c0cb","Type":"ContainerStarted","Data":"e36ed669212ab1f640883907485d69275e672e6ae011b02cb42095ff09805999"} Jul 06 20:50:11.007787 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.007761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gh27w" event={"ID":"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44","Type":"ContainerStarted","Data":"a832c9700206da61b666221ca1353f3de691676978e5fa8793693719af86adfc"} Jul 06 20:50:11.007927 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.007808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gh27w" event={"ID":"6ae3bdd5-5da5-4f44-8da2-b10d637b8c44","Type":"ContainerStarted","Data":"475987ffd6e0e9dd9cd0d98cf7feae69f1278f2be2ee4943ac986904cfa747e1"} Jul 06 20:50:11.007927 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.007890 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gh27w" Jul 06 20:50:11.009119 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.009102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99sk9" event={"ID":"fd8640b2-e59b-4157-b2bd-9cb7bf1e9514","Type":"ContainerStarted","Data":"61928ac48bbb407b436c6b08eef28fe078344a39eb18be6dd45b8ee81688520f"} Jul 06 20:50:11.009229 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.009215 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:50:11.057177 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.057140 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99sk9" podStartSLOduration=68.04793934 podStartE2EDuration="1m14.057129646s" totalImagesPullingTime="6.009190306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:11.055641139 +0000 UTC m=+73.958058346" watchObservedRunningTime="2026-07-06 20:50:11.057129646 +0000 UTC m=+73.959546860" Jul 06 20:50:11.058012 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.057974 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m8fqq" podStartSLOduration=67.71648436 podStartE2EDuration="1m14.057964442s" totalImagesPullingTime="6.341480082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:11.036770942 +0000 UTC m=+73.939188157" watchObservedRunningTime="2026-07-06 20:50:11.057964442 +0000 UTC m=+73.960381656" Jul 06 20:50:11.075897 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:11.075868 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gh27w" podStartSLOduration=33.896438012 podStartE2EDuration="38.075858313s" totalImagesPullingTime="4.179420301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:11.07566913 +0000 UTC m=+73.978086371" watchObservedRunningTime="2026-07-06 20:50:11.075858313 +0000 UTC m=+73.978275526" Jul 06 20:50:13.233117 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.233087 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk"] Jul 06 20:50:13.235138 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.235124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.239690 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.239674 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 20:50:13.240716 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.240694 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cb6f7\"" Jul 06 20:50:13.240821 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.240701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 20:50:13.240821 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.240706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 20:50:13.240916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.240843 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 20:50:13.300342 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.300318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk"] Jul 06 20:50:13.320538 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.320517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99b7021a-2a54-488c-9fe2-cb7d46149c1f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-747588f68d-zvnkk\" (UID: \"99b7021a-2a54-488c-9fe2-cb7d46149c1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.320662 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.320546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kh2z\" (UniqueName: \"kubernetes.io/projected/99b7021a-2a54-488c-9fe2-cb7d46149c1f-kube-api-access-5kh2z\") pod \"managed-serviceaccount-addon-agent-747588f68d-zvnkk\" (UID: \"99b7021a-2a54-488c-9fe2-cb7d46149c1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.342735 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.342715 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86476bbd4c-gshm9"] Jul 06 20:50:13.342890 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:13.342871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" podUID="9ada4eca-8672-4e89-9358-72e6e30ac9c2" Jul 06 20:50:13.420999 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.420976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99b7021a-2a54-488c-9fe2-cb7d46149c1f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-747588f68d-zvnkk\" (UID: \"99b7021a-2a54-488c-9fe2-cb7d46149c1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.421096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.421007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kh2z\" (UniqueName: \"kubernetes.io/projected/99b7021a-2a54-488c-9fe2-cb7d46149c1f-kube-api-access-5kh2z\") pod \"managed-serviceaccount-addon-agent-747588f68d-zvnkk\" (UID: \"99b7021a-2a54-488c-9fe2-cb7d46149c1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.423789 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.423763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99b7021a-2a54-488c-9fe2-cb7d46149c1f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-747588f68d-zvnkk\" (UID: \"99b7021a-2a54-488c-9fe2-cb7d46149c1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.433073 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.433054 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df5867f6d-8kw7d"] Jul 06 20:50:13.434984 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.434970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.441503 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:13.441481 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-5df5867f6d-8kw7d\" is forbidden: User \"system:node:ip-10-0-138-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-138-164.ec2.internal' and this object" podUID="419252cd-ba30-42f8-916c-ef299dea1500" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.446776 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.446760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kh2z\" (UniqueName: \"kubernetes.io/projected/99b7021a-2a54-488c-9fe2-cb7d46149c1f-kube-api-access-5kh2z\") pod \"managed-serviceaccount-addon-agent-747588f68d-zvnkk\" (UID: \"99b7021a-2a54-488c-9fe2-cb7d46149c1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.466097 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.466076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df5867f6d-8kw7d"] Jul 06 20:50:13.484604 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.484552 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:13.521752 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/419252cd-ba30-42f8-916c-ef299dea1500-image-registry-private-configuration\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521852 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/419252cd-ba30-42f8-916c-ef299dea1500-trusted-ca\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521852 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/419252cd-ba30-42f8-916c-ef299dea1500-ca-trust-extracted\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521852 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdnl2\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-kube-api-access-sdnl2\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521973 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/419252cd-ba30-42f8-916c-ef299dea1500-installation-pull-secrets\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521973 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-bound-sa-token\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521973 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-registry-tls\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.521973 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.521919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/419252cd-ba30-42f8-916c-ef299dea1500-registry-certificates\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.553033 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.553017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" Jul 06 20:50:13.623124 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-registry-tls\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623276 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/419252cd-ba30-42f8-916c-ef299dea1500-registry-certificates\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623276 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/419252cd-ba30-42f8-916c-ef299dea1500-image-registry-private-configuration\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623276 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/419252cd-ba30-42f8-916c-ef299dea1500-trusted-ca\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623276 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/419252cd-ba30-42f8-916c-ef299dea1500-ca-trust-extracted\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623496 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdnl2\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-kube-api-access-sdnl2\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623496 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/419252cd-ba30-42f8-916c-ef299dea1500-installation-pull-secrets\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.623496 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.623347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-bound-sa-token\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.624208 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.624020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/419252cd-ba30-42f8-916c-ef299dea1500-ca-trust-extracted\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.624208 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.624173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/419252cd-ba30-42f8-916c-ef299dea1500-registry-certificates\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.624588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.624567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/419252cd-ba30-42f8-916c-ef299dea1500-trusted-ca\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.626058 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.626032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/419252cd-ba30-42f8-916c-ef299dea1500-image-registry-private-configuration\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.626153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.626112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/419252cd-ba30-42f8-916c-ef299dea1500-installation-pull-secrets\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.626153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.626107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-registry-tls\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.633915 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.633894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-bound-sa-token\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.637366 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.637335 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:13.639404 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.639373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdnl2\" (UniqueName: \"kubernetes.io/projected/419252cd-ba30-42f8-916c-ef299dea1500-kube-api-access-sdnl2\") pod \"image-registry-5df5867f6d-8kw7d\" (UID: \"419252cd-ba30-42f8-916c-ef299dea1500\") " pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.687841 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.687806 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk"] Jul 06 20:50:13.691315 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:13.691279 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99b7021a_2a54_488c_9fe2_cb7d46149c1f.slice/crio-bd40ba259e783e6feee6e09734ff915fe26efa722c43203e083c2e42fe46525a WatchSource:0}: Error finding container bd40ba259e783e6feee6e09734ff915fe26efa722c43203e083c2e42fe46525a: Status 404 returned error can't find the container with id bd40ba259e783e6feee6e09734ff915fe26efa722c43203e083c2e42fe46525a Jul 06 20:50:13.739659 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.739586 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:13.747587 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.747571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2xps\"" Jul 06 20:50:13.753240 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.753226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:13.882829 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:13.882802 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df5867f6d-8kw7d"] Jul 06 20:50:13.887532 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:13.887505 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419252cd_ba30_42f8_916c_ef299dea1500.slice/crio-790d733785e7a1fc40df68ff42bd55f27befda6a611ad2d5a3c2e1bf4d77ce21 WatchSource:0}: Error finding container 790d733785e7a1fc40df68ff42bd55f27befda6a611ad2d5a3c2e1bf4d77ce21: Status 404 returned error can't find the container with id 790d733785e7a1fc40df68ff42bd55f27befda6a611ad2d5a3c2e1bf4d77ce21 Jul 06 20:50:14.020504 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.020434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" event={"ID":"99b7021a-2a54-488c-9fe2-cb7d46149c1f","Type":"ContainerStarted","Data":"bd40ba259e783e6feee6e09734ff915fe26efa722c43203e083c2e42fe46525a"} Jul 06 20:50:14.021991 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.021970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:50:14.022088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.022004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" event={"ID":"419252cd-ba30-42f8-916c-ef299dea1500","Type":"ContainerStarted","Data":"b6073b66b1dbe78a83889fcdde5fe7d236a7691bc9bbeb0f6a4446080f8f2e75"} Jul 06 20:50:14.022088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.022043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" event={"ID":"419252cd-ba30-42f8-916c-ef299dea1500","Type":"ContainerStarted","Data":"790d733785e7a1fc40df68ff42bd55f27befda6a611ad2d5a3c2e1bf4d77ce21"} Jul 06 20:50:14.022206 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.022090 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:14.027381 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.027364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:50:14.082796 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.082743 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" podStartSLOduration=1.082723223 podStartE2EDuration="1.082723223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:14.082161678 +0000 UTC m=+76.984578892" watchObservedRunningTime="2026-07-06 20:50:14.082723223 +0000 UTC m=+76.985140437" Jul 06 20:50:14.127798 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127776 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl5zp\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-kube-api-access-wl5zp\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.127943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-certificates\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.127943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127832 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-installation-pull-secrets\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.127943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-trusted-ca\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.127943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127879 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ada4eca-8672-4e89-9358-72e6e30ac9c2-ca-trust-extracted\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.127943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127918 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-bound-sa-token\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.128199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.127956 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-image-registry-private-configuration\") pod \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\" (UID: \"9ada4eca-8672-4e89-9358-72e6e30ac9c2\") " Jul 06 20:50:14.128199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.128142 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ada4eca-8672-4e89-9358-72e6e30ac9c2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:50:14.128305 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.128206 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:50:14.128305 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.128274 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:50:14.128412 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.128301 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-certificates\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:14.128412 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.128322 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ada4eca-8672-4e89-9358-72e6e30ac9c2-ca-trust-extracted\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:14.130727 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.130707 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:50:14.130835 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.130809 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:50:14.131064 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.131039 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:50:14.131148 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.131084 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-kube-api-access-wl5zp" (OuterVolumeSpecName: "kube-api-access-wl5zp") pod "9ada4eca-8672-4e89-9358-72e6e30ac9c2" (UID: "9ada4eca-8672-4e89-9358-72e6e30ac9c2"). InnerVolumeSpecName "kube-api-access-wl5zp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:50:14.229246 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.229213 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl5zp\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-kube-api-access-wl5zp\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:14.229246 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.229242 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-installation-pull-secrets\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:14.229246 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.229252 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ada4eca-8672-4e89-9358-72e6e30ac9c2-trusted-ca\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:14.229461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.229261 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-bound-sa-token\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:14.229461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:14.229269 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ada4eca-8672-4e89-9358-72e6e30ac9c2-image-registry-private-configuration\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:15.025150 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:15.025124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86476bbd4c-gshm9" Jul 06 20:50:15.063774 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:15.063741 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86476bbd4c-gshm9"] Jul 06 20:50:15.067607 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:15.067584 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86476bbd4c-gshm9"] Jul 06 20:50:15.137067 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:15.137042 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ada4eca-8672-4e89-9358-72e6e30ac9c2-registry-tls\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:50:15.672012 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:15.671967 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ada4eca-8672-4e89-9358-72e6e30ac9c2" path="/var/lib/kubelet/pods/9ada4eca-8672-4e89-9358-72e6e30ac9c2/volumes" Jul 06 20:50:16.253188 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:16.253126 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:16.328766 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:16.328744 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:19.297750 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:19.297583 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:19.399777 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:19.399744 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:19.515050 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:19.515020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:19.586437 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:19.586366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:19.723036 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:19.723003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:21.015582 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.015555 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gh27w" Jul 06 20:50:21.085128 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.085092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:50:21.087567 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.087524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42b0367-c24f-4dc7-807d-d9cd1bc028c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvpd5\" (UID: \"d42b0367-c24f-4dc7-807d-d9cd1bc028c9\") " pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:50:21.367729 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.367655 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8tr2s\"" Jul 06 20:50:21.375815 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.375796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvpd5" Jul 06 20:50:21.443574 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.443545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:21.522636 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:21.522591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvpd5"] Jul 06 20:50:22.053688 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:22.053648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvpd5" event={"ID":"d42b0367-c24f-4dc7-807d-d9cd1bc028c9","Type":"ContainerStarted","Data":"8388667b3a5d123f4969e890cf5d823d30ea8dbffb40cbaf6fb1e0664436dea7"} Jul 06 20:50:24.558297 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.558259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:24.617244 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.617211 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9"] Jul 06 20:50:24.619934 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.619913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.625203 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.625075 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 20:50:24.625203 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.625082 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:50:24.626214 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.626187 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:50:24.626312 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.626239 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 20:50:24.626312 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.626250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2cdzd\"" Jul 06 20:50:24.626391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.626187 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:50:24.639286 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.639265 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9"] Jul 06 20:50:24.650450 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.650427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:24.717071 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.717038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d52f372-7f79-42d0-b080-c84011bce854-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.717071 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.717075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d52f372-7f79-42d0-b080-c84011bce854-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.717272 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.717128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2hr\" (UniqueName: \"kubernetes.io/projected/6d52f372-7f79-42d0-b080-c84011bce854-kube-api-access-wk2hr\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.717272 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.717153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d52f372-7f79-42d0-b080-c84011bce854-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.793398 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.793352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:24.817520 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.817449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d52f372-7f79-42d0-b080-c84011bce854-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.817520 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.817488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d52f372-7f79-42d0-b080-c84011bce854-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.817754 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.817555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2hr\" (UniqueName: \"kubernetes.io/projected/6d52f372-7f79-42d0-b080-c84011bce854-kube-api-access-wk2hr\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.817754 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.817588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d52f372-7f79-42d0-b080-c84011bce854-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.818924 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.818897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d52f372-7f79-42d0-b080-c84011bce854-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.820267 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.820240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d52f372-7f79-42d0-b080-c84011bce854-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.820458 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.820433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d52f372-7f79-42d0-b080-c84011bce854-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.828980 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.828954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2hr\" (UniqueName: \"kubernetes.io/projected/6d52f372-7f79-42d0-b080-c84011bce854-kube-api-access-wk2hr\") pod \"prometheus-operator-567f7b8b7c-c58s9\" (UID: \"6d52f372-7f79-42d0-b080-c84011bce854\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.927890 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.927860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:24.931746 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.931717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" Jul 06 20:50:24.995077 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:24.995040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:25.680804 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:25.680776 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9"] Jul 06 20:50:25.683686 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:25.683662 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52f372_7f79_42d0_b080_c84011bce854.slice/crio-1f78c8035c2de52341b632817a99e4b8c6a2ae152503569c11cee84daea086be WatchSource:0}: Error finding container 1f78c8035c2de52341b632817a99e4b8c6a2ae152503569c11cee84daea086be: Status 404 returned error can't find the container with id 1f78c8035c2de52341b632817a99e4b8c6a2ae152503569c11cee84daea086be Jul 06 20:50:26.069889 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:26.069844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvpd5" event={"ID":"d42b0367-c24f-4dc7-807d-d9cd1bc028c9","Type":"ContainerStarted","Data":"f1018eff069d14551001cdf1df688e96075091d30738500a4b242217f80212ad"} Jul 06 20:50:26.070907 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:26.070886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" event={"ID":"6d52f372-7f79-42d0-b080-c84011bce854","Type":"ContainerStarted","Data":"1f78c8035c2de52341b632817a99e4b8c6a2ae152503569c11cee84daea086be"} Jul 06 20:50:26.072136 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:26.072119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" event={"ID":"99b7021a-2a54-488c-9fe2-cb7d46149c1f","Type":"ContainerStarted","Data":"c40b5c2def0180a8836d69c7a5bb57fc59f2929ecd3da09c98d77fef0effc7e1"} Jul 06 20:50:26.089414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:26.089379 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-747588f68d-zvnkk" podStartSLOduration=1.235922069 podStartE2EDuration="13.089366561s" totalImagesPullingTime="11.853444492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:26.088897772 +0000 UTC m=+88.991314987" watchObservedRunningTime="2026-07-06 20:50:26.089366561 +0000 UTC m=+88.991783775" Jul 06 20:50:27.079760 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:27.079381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvpd5" event={"ID":"d42b0367-c24f-4dc7-807d-d9cd1bc028c9","Type":"ContainerStarted","Data":"fc94f08ffb70e9352baf545cfb8ff260c5a9549267ae45602be2c8030fe94de8"} Jul 06 20:50:27.437561 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:27.437534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:27.542368 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:27.542337 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:27.666483 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:27.666447 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:28.084750 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:28.084671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" event={"ID":"6d52f372-7f79-42d0-b080-c84011bce854","Type":"ContainerStarted","Data":"59a1a1c3b0f063866a949616bb5c85e7a6f0cec1e54673eddd6d766b4ba9aced"} Jul 06 20:50:28.084750 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:28.084730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" event={"ID":"6d52f372-7f79-42d0-b080-c84011bce854","Type":"ContainerStarted","Data":"2f45e4386bc2f66db73e12c0b2d98b09951664818615309cfd60d44292a26947"} Jul 06 20:50:28.104361 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:28.104304 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c58s9" podStartSLOduration=2.445955402 podStartE2EDuration="4.104283561s" totalImagesPullingTime="1.658328159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:28.103747164 +0000 UTC m=+91.006164379" watchObservedRunningTime="2026-07-06 20:50:28.104283561 +0000 UTC m=+91.006700775" Jul 06 20:50:28.623495 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:28.623459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:28.721553 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:28.721522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:29.396859 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:29.396780 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:29.501163 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:29.501132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:29.596920 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:29.596886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:29.740950 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:29.740915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.093415 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.093334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvpd5" event={"ID":"d42b0367-c24f-4dc7-807d-d9cd1bc028c9","Type":"ContainerStarted","Data":"6ba5765df3060c0d068dfec47ad9ee683c1d48b252080ee046c823c7862cd505"} Jul 06 20:50:30.131932 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.131880 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tvpd5" podStartSLOduration=33.684141154 podStartE2EDuration="41.131860931s" totalImagesPullingTime="7.447719777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:49:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:30.131237663 +0000 UTC m=+93.033654903" watchObservedRunningTime="2026-07-06 20:50:30.131860931 +0000 UTC m=+93.034278148" Jul 06 20:50:30.175598 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.175564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.254778 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.254751 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44"] Jul 06 20:50:30.257648 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.257629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.265165 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.265132 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:50:30.265271 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.265167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qpvv4\"" Jul 06 20:50:30.265423 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.265401 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 20:50:30.285979 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.285955 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44"] Jul 06 20:50:30.300031 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.300003 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9"] Jul 06 20:50:30.302521 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.302507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.304948 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.304928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 20:50:30.305054 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.305038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wfn7l\"" Jul 06 20:50:30.305491 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.305467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:50:30.305580 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.305527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 20:50:30.323861 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.323840 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xlmkr"] Jul 06 20:50:30.324428 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.324400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.326646 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.326604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.330127 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.330049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9"] Jul 06 20:50:30.330241 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.330224 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:50:30.330313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.330254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:50:30.330777 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.330758 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:50:30.330907 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.330761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hcfvz\"" Jul 06 20:50:30.367304 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.367238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bc4d8ed-a8de-4f22-a307-65a0e5570091-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.367391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.367303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc4d8ed-a8de-4f22-a307-65a0e5570091-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.367433 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.367396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bc4d8ed-a8de-4f22-a307-65a0e5570091-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.367474 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.367457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4t9\" (UniqueName: \"kubernetes.io/projected/9bc4d8ed-a8de-4f22-a307-65a0e5570091-kube-api-access-bl4t9\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.467269 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.467233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.468311 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bc4d8ed-a8de-4f22-a307-65a0e5570091-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.468414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-sys\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-accelerators-collector-config\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.468642 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264g2\" (UniqueName: \"kubernetes.io/projected/7f52ca16-f468-4e0b-83f2-ea311e5bc904-kube-api-access-264g2\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468642 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc4d8ed-a8de-4f22-a307-65a0e5570091-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.468642 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-wtmp\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468642 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.468838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.468838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-root\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-textfile\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f52ca16-f468-4e0b-83f2-ea311e5bc904-metrics-client-ca\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.468838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bc4d8ed-a8de-4f22-a307-65a0e5570091-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.468838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d1211cd-2681-4cf7-9568-7c51d8b37a44-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.469112 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-tls\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.469112 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4t9\" (UniqueName: \"kubernetes.io/projected/9bc4d8ed-a8de-4f22-a307-65a0e5570091-kube-api-access-bl4t9\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.469112 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.468962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7d1211cd-2681-4cf7-9568-7c51d8b37a44-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.469112 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.469064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvgf\" (UniqueName: \"kubernetes.io/projected/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-api-access-pwvgf\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.469586 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.469502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc4d8ed-a8de-4f22-a307-65a0e5570091-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.471080 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.471059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bc4d8ed-a8de-4f22-a307-65a0e5570091-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.471244 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.471223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bc4d8ed-a8de-4f22-a307-65a0e5570091-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.488883 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.488858 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4t9\" (UniqueName: \"kubernetes.io/projected/9bc4d8ed-a8de-4f22-a307-65a0e5570091-kube-api-access-bl4t9\") pod \"openshift-state-metrics-54cf96dfcf-4mt44\" (UID: \"9bc4d8ed-a8de-4f22-a307-65a0e5570091\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.567964 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.567938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" Jul 06 20:50:30.569737 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.569837 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264g2\" (UniqueName: \"kubernetes.io/projected/7f52ca16-f468-4e0b-83f2-ea311e5bc904-kube-api-access-264g2\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.569837 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-wtmp\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.569956 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.569956 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.569956 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-root\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.569956 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-textfile\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f52ca16-f468-4e0b-83f2-ea311e5bc904-metrics-client-ca\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-wtmp\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.569999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d1211cd-2681-4cf7-9568-7c51d8b37a44-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-root\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-tls\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7d1211cd-2681-4cf7-9568-7c51d8b37a44-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.570173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvgf\" (UniqueName: \"kubernetes.io/projected/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-api-access-pwvgf\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-sys\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-accelerators-collector-config\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-textfile\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f52ca16-f468-4e0b-83f2-ea311e5bc904-metrics-client-ca\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d1211cd-2681-4cf7-9568-7c51d8b37a44-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.570908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f52ca16-f468-4e0b-83f2-ea311e5bc904-sys\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.571405 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.570931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7d1211cd-2681-4cf7-9568-7c51d8b37a44-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.571405 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.571158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-accelerators-collector-config\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.571671 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.571649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.572797 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.572773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.573202 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.573077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-tls\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.573202 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.573137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f52ca16-f468-4e0b-83f2-ea311e5bc904-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.573363 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.573336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.580295 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.580272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-264g2\" (UniqueName: \"kubernetes.io/projected/7f52ca16-f468-4e0b-83f2-ea311e5bc904-kube-api-access-264g2\") pod \"node-exporter-xlmkr\" (UID: \"7f52ca16-f468-4e0b-83f2-ea311e5bc904\") " pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.584264 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.584238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvgf\" (UniqueName: \"kubernetes.io/projected/7d1211cd-2681-4cf7-9568-7c51d8b37a44-kube-api-access-pwvgf\") pod \"kube-state-metrics-7c9dbb8b7d-ldmh9\" (UID: \"7d1211cd-2681-4cf7-9568-7c51d8b37a44\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.587879 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.587848 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.611795 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.611774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" Jul 06 20:50:30.638052 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.638022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xlmkr" Jul 06 20:50:30.649444 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:30.649414 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f52ca16_f468_4e0b_83f2_ea311e5bc904.slice/crio-755b606cbb780d979877a311875ba2bf769f0d7baad5dc1a52224d07e8af20d9 WatchSource:0}: Error finding container 755b606cbb780d979877a311875ba2bf769f0d7baad5dc1a52224d07e8af20d9: Status 404 returned error can't find the container with id 755b606cbb780d979877a311875ba2bf769f0d7baad5dc1a52224d07e8af20d9 Jul 06 20:50:30.686091 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.685976 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.719587 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.719553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44"] Jul 06 20:50:30.724072 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:30.724045 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc4d8ed_a8de_4f22_a307_65a0e5570091.slice/crio-00dbb27de80ee9a5427540e28cb6825f63f9290991ae6fd5529f0afc5fe15a2e WatchSource:0}: Error finding container 00dbb27de80ee9a5427540e28cb6825f63f9290991ae6fd5529f0afc5fe15a2e: Status 404 returned error can't find the container with id 00dbb27de80ee9a5427540e28cb6825f63f9290991ae6fd5529f0afc5fe15a2e Jul 06 20:50:30.770453 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.770430 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9"] Jul 06 20:50:30.773511 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:30.773476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1211cd_2681_4cf7_9568_7c51d8b37a44.slice/crio-eb07d6b78a6006b66f5b6f6c51f85de0d914c46695ba678eee72c0b9ebc5713b WatchSource:0}: Error finding container eb07d6b78a6006b66f5b6f6c51f85de0d914c46695ba678eee72c0b9ebc5713b: Status 404 returned error can't find the container with id eb07d6b78a6006b66f5b6f6c51f85de0d914c46695ba678eee72c0b9ebc5713b Jul 06 20:50:30.774274 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.774125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.858489 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.858464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:30.998787 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:30.998754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:31.087312 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.087284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:31.098455 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.098427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlmkr" event={"ID":"7f52ca16-f468-4e0b-83f2-ea311e5bc904","Type":"ContainerStarted","Data":"755b606cbb780d979877a311875ba2bf769f0d7baad5dc1a52224d07e8af20d9"} Jul 06 20:50:31.099634 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.099594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" event={"ID":"7d1211cd-2681-4cf7-9568-7c51d8b37a44","Type":"ContainerStarted","Data":"eb07d6b78a6006b66f5b6f6c51f85de0d914c46695ba678eee72c0b9ebc5713b"} Jul 06 20:50:31.101709 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.101679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" event={"ID":"9bc4d8ed-a8de-4f22-a307-65a0e5570091","Type":"ContainerStarted","Data":"bf519dc40825e2cf59cc5a6a2701dd318f38748893e1545e20c53afeee022b15"} Jul 06 20:50:31.101815 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.101740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" event={"ID":"9bc4d8ed-a8de-4f22-a307-65a0e5570091","Type":"ContainerStarted","Data":"e64e90fac7effab8a354277fc870faee1078a28bfec28d67c372ed22acc3478d"} Jul 06 20:50:31.101815 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.101761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" event={"ID":"9bc4d8ed-a8de-4f22-a307-65a0e5570091","Type":"ContainerStarted","Data":"00dbb27de80ee9a5427540e28cb6825f63f9290991ae6fd5529f0afc5fe15a2e"} Jul 06 20:50:31.125760 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.125735 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:50:31.128786 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.128768 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.131419 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:50:31.131573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqjlw\"" Jul 06 20:50:31.131875 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:50:31.131875 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131872 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:50:31.132038 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131848 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:50:31.132038 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131852 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:50:31.132038 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.131938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:50:31.132232 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.132211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:50:31.132320 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.132294 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:50:31.142499 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.142463 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:50:31.151515 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.151494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:50:31.185129 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.185100 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:31.277362 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277362 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277564 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277564 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277564 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277564 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc97c\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-kube-api-access-sc97c\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277564 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277564 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-web-config\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-config-out\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.277916 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.277733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378717 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378717 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc97c\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-kube-api-access-sc97c\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.378943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.379277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.378980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.379277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.379012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-web-config\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.379277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.379038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.379277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.379062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-config-out\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.379545 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.379519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.380721 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.379934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.380721 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:31.380108 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 20:50:31.380721 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:50:31.380175 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls podName:717a5538-08e8-408a-a684-e12e63a0a2fc nodeName:}" failed. No retries permitted until 2026-07-06 20:50:31.88015568 +0000 UTC m=+94.782572875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc") : secret "alertmanager-main-tls" not found Jul 06 20:50:31.381088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.381063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.381972 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.381927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-config-out\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.383777 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.383752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-web-config\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.384737 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.384670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.384737 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.384677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.384968 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.384950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.385135 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.385114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.385202 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.385114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.386139 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.386117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.389849 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.389829 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc97c\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-kube-api-access-sc97c\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.450262 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.450200 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:31.884444 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.884408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:31.888250 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:31.888200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:32.045500 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:32.045419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:32.107269 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:32.107230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlmkr" event={"ID":"7f52ca16-f468-4e0b-83f2-ea311e5bc904","Type":"ContainerStarted","Data":"50f352173a0370ce461b3df7fdce9919c639a36eaf35d2095c51cb6f650fd4b6"} Jul 06 20:50:32.607762 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:32.607737 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:50:32.612059 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:32.611556 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717a5538_08e8_408a_a684_e12e63a0a2fc.slice/crio-bcd9423c4a6dfe2b3bec6adada05787ab4023d6c8d0ff3c77882b1c4310b6efa WatchSource:0}: Error finding container bcd9423c4a6dfe2b3bec6adada05787ab4023d6c8d0ff3c77882b1c4310b6efa: Status 404 returned error can't find the container with id bcd9423c4a6dfe2b3bec6adada05787ab4023d6c8d0ff3c77882b1c4310b6efa Jul 06 20:50:33.051095 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.051056 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-584579dcfd-z79k6"] Jul 06 20:50:33.053922 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.053893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.057047 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.056921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-k7f5mfge6gvj\"" Jul 06 20:50:33.057047 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.057000 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:50:33.066019 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.058828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sg6vn\"" Jul 06 20:50:33.066019 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.059101 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:50:33.066019 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.059114 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:50:33.066019 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.059368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:50:33.066019 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.059393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:50:33.074688 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.074607 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584579dcfd-z79k6"] Jul 06 20:50:33.112655 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.112609 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f52ca16-f468-4e0b-83f2-ea311e5bc904" containerID="50f352173a0370ce461b3df7fdce9919c639a36eaf35d2095c51cb6f650fd4b6" exitCode=0 Jul 06 20:50:33.112755 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.112719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlmkr" event={"ID":"7f52ca16-f468-4e0b-83f2-ea311e5bc904","Type":"ContainerDied","Data":"50f352173a0370ce461b3df7fdce9919c639a36eaf35d2095c51cb6f650fd4b6"} Jul 06 20:50:33.115246 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.115220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" event={"ID":"7d1211cd-2681-4cf7-9568-7c51d8b37a44","Type":"ContainerStarted","Data":"a81add03784d462f55ed5703dfb5cc1f0f72428e0c403e0f983d8eac50d3aed9"} Jul 06 20:50:33.115543 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.115506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" event={"ID":"7d1211cd-2681-4cf7-9568-7c51d8b37a44","Type":"ContainerStarted","Data":"ee2d725e1b5679880af917b10b3ac208ff71537105903a789f33db252650b226"} Jul 06 20:50:33.115645 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.115550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" event={"ID":"7d1211cd-2681-4cf7-9568-7c51d8b37a44","Type":"ContainerStarted","Data":"def95ce8c5d6c857cae37b767c7cea693c3d65068f7909f2fca8e3cd2ad9107b"} Jul 06 20:50:33.119167 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.119136 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" event={"ID":"9bc4d8ed-a8de-4f22-a307-65a0e5570091","Type":"ContainerStarted","Data":"eb61c3c631590f53b78c5517727b2056628d373cb17d91aeea99aa75378df5f4"} Jul 06 20:50:33.120215 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.120195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"bcd9423c4a6dfe2b3bec6adada05787ab4023d6c8d0ff3c77882b1c4310b6efa"} Jul 06 20:50:33.165584 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.165558 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:33.188422 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.188345 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4mt44" podStartSLOduration=1.627562645 podStartE2EDuration="3.188326596s" totalImagesPullingTime="1.560763951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:33.187170632 +0000 UTC m=+96.089587847" watchObservedRunningTime="2026-07-06 20:50:33.188326596 +0000 UTC m=+96.090743810" Jul 06 20:50:33.196975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.196754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.196975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.196783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9f7c\" (UniqueName: \"kubernetes.io/projected/5dae97ad-46c8-4860-bd02-35a95ba79f4e-kube-api-access-c9f7c\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.196975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.196863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.196975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.196898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.196975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.196941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.197266 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.197004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-tls\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.197266 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.197142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dae97ad-46c8-4860-bd02-35a95ba79f4e-metrics-client-ca\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.197582 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.197561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-grpc-tls\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.226178 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.226130 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ldmh9" podStartSLOduration=1.5982910289999999 podStartE2EDuration="3.22611026s" totalImagesPullingTime="1.627819231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:33.224208635 +0000 UTC m=+96.126625871" watchObservedRunningTime="2026-07-06 20:50:33.22611026 +0000 UTC m=+96.128527475" Jul 06 20:50:33.270885 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.270854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:33.298098 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-grpc-tls\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298209 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298287 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9f7c\" (UniqueName: \"kubernetes.io/projected/5dae97ad-46c8-4860-bd02-35a95ba79f4e-kube-api-access-c9f7c\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298505 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298638 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-tls\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.298707 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.298635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dae97ad-46c8-4860-bd02-35a95ba79f4e-metrics-client-ca\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.299799 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.299772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dae97ad-46c8-4860-bd02-35a95ba79f4e-metrics-client-ca\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.301314 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.301246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.301447 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.301427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.301704 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.301681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.301704 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.301693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-tls\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.301843 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.301693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.301843 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.301696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dae97ad-46c8-4860-bd02-35a95ba79f4e-secret-grpc-tls\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.309954 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.309937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9f7c\" (UniqueName: \"kubernetes.io/projected/5dae97ad-46c8-4860-bd02-35a95ba79f4e-kube-api-access-c9f7c\") pod \"thanos-querier-584579dcfd-z79k6\" (UID: \"5dae97ad-46c8-4860-bd02-35a95ba79f4e\") " pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.364754 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.364730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:33.376751 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.376730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:33.566390 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:33.566300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584579dcfd-z79k6"] Jul 06 20:50:33.572579 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:50:33.572556 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dae97ad_46c8_4860_bd02_35a95ba79f4e.slice/crio-70c74e1e7c2cb82e2ba5a8a147055dd8322c6d13cd55460f82eda559eaa5c218 WatchSource:0}: Error finding container 70c74e1e7c2cb82e2ba5a8a147055dd8322c6d13cd55460f82eda559eaa5c218: Status 404 returned error can't find the container with id 70c74e1e7c2cb82e2ba5a8a147055dd8322c6d13cd55460f82eda559eaa5c218 Jul 06 20:50:34.102543 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.102513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:34.125182 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.125157 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b" exitCode=0 Jul 06 20:50:34.125277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.125228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b"} Jul 06 20:50:34.126446 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.126416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"70c74e1e7c2cb82e2ba5a8a147055dd8322c6d13cd55460f82eda559eaa5c218"} Jul 06 20:50:34.128779 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.128756 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlmkr" event={"ID":"7f52ca16-f468-4e0b-83f2-ea311e5bc904","Type":"ContainerStarted","Data":"797473ccf6c2c462b98ecca60f8946016fbd7f4480d4fe4b234092b4dfa4dc22"} Jul 06 20:50:34.128876 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.128806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlmkr" event={"ID":"7f52ca16-f468-4e0b-83f2-ea311e5bc904","Type":"ContainerStarted","Data":"6f943b7814bfd598f5d2e3524bf1c4d9afc0768ce96247f53ec71922507c016a"} Jul 06 20:50:34.224525 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.224482 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xlmkr" podStartSLOduration=3.047890101 podStartE2EDuration="4.224467627s" totalImagesPullingTime="1.095234665s" totalInitContainerRuntime="81.342861ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:34.22332849 +0000 UTC m=+97.125745703" watchObservedRunningTime="2026-07-06 20:50:34.224467627 +0000 UTC m=+97.126884840" Jul 06 20:50:34.254590 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.254527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:34.839233 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.839160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:34.989509 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:34.989466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:35.030709 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:35.030683 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5df5867f6d-8kw7d" Jul 06 20:50:35.091126 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:35.091055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:35.334789 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:35.334757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:35.518959 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:35.518916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:36.480414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:36.480306 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:36.637414 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:36.637339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:36.717058 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:36.716935 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:37.144087 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.143983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65"} Jul 06 20:50:37.144087 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.144086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e"} Jul 06 20:50:37.144393 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.144127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5"} Jul 06 20:50:37.144393 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.144153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce"} Jul 06 20:50:37.144393 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.144175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a"} Jul 06 20:50:37.146026 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.145998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"4c008757afc69efe53c7310563f97306daa1d8b2bdd3d3e5fb4efd4416901f23"} Jul 06 20:50:37.146136 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.146054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"c482f7263438fadb8978d1dcfed2b943aaddc6a6ec371d86211b4a5b3f25fdf9"} Jul 06 20:50:37.146136 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:37.146079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"9cb863dfe01c9638fde94e1887f0f3fa3c9e7a515a2ede8d631b6a534e04df77"} Jul 06 20:50:38.027227 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:38.027203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:38.152636 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:38.152584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerStarted","Data":"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567"} Jul 06 20:50:39.054461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:39.054428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:39.159881 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:39.159850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"2dea2a1fc8b74a4cf1c477a69df9afc9219eab9969a67ff6ed66f14f155a1365"} Jul 06 20:50:39.160046 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:39.159939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"2eac9e8586252aae2428f806a8a4e21b51641adeba8d38aad7a8cf6072930fbb"} Jul 06 20:50:39.160046 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:39.159968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" event={"ID":"5dae97ad-46c8-4860-bd02-35a95ba79f4e","Type":"ContainerStarted","Data":"b29b7f71d5ceab16c43b15e51ac0beaac5768c36e8480c7917e54916f95d01dc"} Jul 06 20:50:39.187958 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:39.187915 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" podStartSLOduration=1.963962918 podStartE2EDuration="6.187901702s" totalImagesPullingTime="4.223938784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:39.186626108 +0000 UTC m=+102.089043333" watchObservedRunningTime="2026-07-06 20:50:39.187901702 +0000 UTC m=+102.090318941" Jul 06 20:50:39.226772 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:39.226721 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.281095281 podStartE2EDuration="8.226707352s" totalImagesPullingTime="4.930314325s" totalInitContainerRuntime="15.297746ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:39.223561441 +0000 UTC m=+102.125978665" watchObservedRunningTime="2026-07-06 20:50:39.226707352 +0000 UTC m=+102.129124591" Jul 06 20:50:40.164963 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:40.164937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:41.174887 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:41.174860 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-584579dcfd-z79k6" Jul 06 20:50:42.016203 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:42.016178 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99sk9" Jul 06 20:50:42.384236 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:42.384152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:42.448922 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:42.448889 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:45.474715 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:45.474688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:45.574139 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:45.574116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:48.164738 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:48.164703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:48.265270 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:48.265239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:50.151287 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:50.151254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:50.226700 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:50.226667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:56.488598 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:56.488565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:56.588943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:56.588900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:56.663833 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:50:56.663805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:00.318876 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:00.318840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:00.420741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:00.420684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:01.253108 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:01.253075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:01.324976 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:01.324949 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:07.478116 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:07.478082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:51:07.480454 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:07.480434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88b54e9-ad7a-4289-8981-312cb84aac57-metrics-certs\") pod \"network-metrics-daemon-rxwd5\" (UID: \"d88b54e9-ad7a-4289-8981-312cb84aac57\") " pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:51:07.580333 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:07.580310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mg5p6\"" Jul 06 20:51:07.587902 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:07.587885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxwd5" Jul 06 20:51:07.743960 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:07.743931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxwd5"] Jul 06 20:51:07.744819 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:51:07.744795 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88b54e9_ad7a_4289_8981_312cb84aac57.slice/crio-77ce40d992737134bff8c8d2ccc107aa76d0debf37a762a43922af09b2f78007 WatchSource:0}: Error finding container 77ce40d992737134bff8c8d2ccc107aa76d0debf37a762a43922af09b2f78007: Status 404 returned error can't find the container with id 77ce40d992737134bff8c8d2ccc107aa76d0debf37a762a43922af09b2f78007 Jul 06 20:51:08.275426 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:08.275380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxwd5" event={"ID":"d88b54e9-ad7a-4289-8981-312cb84aac57","Type":"ContainerStarted","Data":"77ce40d992737134bff8c8d2ccc107aa76d0debf37a762a43922af09b2f78007"} Jul 06 20:51:09.282583 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:09.282486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxwd5" event={"ID":"d88b54e9-ad7a-4289-8981-312cb84aac57","Type":"ContainerStarted","Data":"2f3d6b3080a20a3bd6c00a2c4a2da312751d5485292cc79928baa9f0b5866c17"} Jul 06 20:51:09.282583 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:09.282548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxwd5" event={"ID":"d88b54e9-ad7a-4289-8981-312cb84aac57","Type":"ContainerStarted","Data":"ce1d26b62eaea366ca76a99abc124636525e60d2dfe320009ff821aca1b8d7ff"} Jul 06 20:51:09.300030 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:09.299988 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxwd5" podStartSLOduration=131.038104673 podStartE2EDuration="2m12.299975774s" totalImagesPullingTime="1.261871101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:51:09.298871226 +0000 UTC m=+132.201288439" watchObservedRunningTime="2026-07-06 20:51:09.299975774 +0000 UTC m=+132.202392987" Jul 06 20:51:09.402706 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:09.402668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:09.502296 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:09.502266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:13.300829 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:13.300797 2576 generic.go:356] "Generic (PLEG): container finished" podID="ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b" containerID="b85fb74dc6a2975c3a9f3a075497fcaf27227fccc54b4366d7233c3c31e6408a" exitCode=0 Jul 06 20:51:13.301313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:13.300879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" event={"ID":"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b","Type":"ContainerDied","Data":"b85fb74dc6a2975c3a9f3a075497fcaf27227fccc54b4366d7233c3c31e6408a"} Jul 06 20:51:13.301313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:13.301277 2576 scope.go:117] "RemoveContainer" containerID="b85fb74dc6a2975c3a9f3a075497fcaf27227fccc54b4366d7233c3c31e6408a" Jul 06 20:51:14.306203 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:14.306169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tlc5z" event={"ID":"ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b","Type":"ContainerStarted","Data":"433f213dc3e50c5f6b8f1fe9568224777bac49fe4b3bd5e5028ed09150e50d0e"} Jul 06 20:51:16.256573 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:16.256537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:16.317993 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:16.317959 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:44.581114 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:44.581074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:46.321188 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:46.321157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:46.421017 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:46.420983 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:50.647500 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647422 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:51:50.647928 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647708 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="alertmanager" containerID="cri-o://77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a" gracePeriod=120 Jul 06 20:51:50.647928 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647783 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-metric" containerID="cri-o://bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65" gracePeriod=120 Jul 06 20:51:50.647928 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647840 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="prom-label-proxy" containerID="cri-o://288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567" gracePeriod=120 Jul 06 20:51:50.647928 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647832 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy" containerID="cri-o://c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e" gracePeriod=120 Jul 06 20:51:50.647928 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647797 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-web" containerID="cri-o://438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5" gracePeriod=120 Jul 06 20:51:50.648173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:50.647945 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="config-reloader" containerID="cri-o://da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce" gracePeriod=120 Jul 06 20:51:51.456542 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456511 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567" exitCode=0 Jul 06 20:51:51.456542 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456538 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e" exitCode=0 Jul 06 20:51:51.456542 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456547 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce" exitCode=0 Jul 06 20:51:51.456542 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456556 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a" exitCode=0 Jul 06 20:51:51.456848 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567"} Jul 06 20:51:51.456848 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e"} Jul 06 20:51:51.456848 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce"} Jul 06 20:51:51.456848 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.456752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a"} Jul 06 20:51:51.897938 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:51.897907 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.021767 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.021688 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.021767 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.021722 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.021767 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.021747 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.021998 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.021938 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-main-db\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.021998 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.021989 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc97c\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-kube-api-access-sc97c\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022106 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022015 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-cluster-tls-config\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022106 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022044 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022118 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-metrics-client-ca\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-web-config\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-config-out\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022350 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022214 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-tls-assets\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022350 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022242 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-trusted-ca-bundle\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022350 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022266 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-config-volume\") pod \"717a5538-08e8-408a-a684-e12e63a0a2fc\" (UID: \"717a5538-08e8-408a-a684-e12e63a0a2fc\") " Jul 06 20:51:52.022350 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022280 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:51:52.022773 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.022719 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-main-db\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.023677 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.023303 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:51:52.023777 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.023733 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:51:52.024707 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.024670 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.024979 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.024750 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.025462 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.025427 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-kube-api-access-sc97c" (OuterVolumeSpecName: "kube-api-access-sc97c") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "kube-api-access-sc97c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:51:52.026226 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.026184 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.026323 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.026280 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:51:52.026323 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.026294 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-config-volume" (OuterVolumeSpecName: "config-volume") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.026723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.026591 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-config-out" (OuterVolumeSpecName: "config-out") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:51:52.026806 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.026741 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.030062 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.029909 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.036864 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.036843 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-web-config" (OuterVolumeSpecName: "web-config") pod "717a5538-08e8-408a-a684-e12e63a0a2fc" (UID: "717a5538-08e8-408a-a684-e12e63a0a2fc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:52.123374 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123347 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-metrics-client-ca\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123374 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123372 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-web-config\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123385 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717a5538-08e8-408a-a684-e12e63a0a2fc-config-out\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123398 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-tls-assets\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123409 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717a5538-08e8-408a-a684-e12e63a0a2fc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123421 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-config-volume\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123433 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-main-tls\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123445 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123459 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123471 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc97c\" (UniqueName: \"kubernetes.io/projected/717a5538-08e8-408a-a684-e12e63a0a2fc-kube-api-access-sc97c\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123484 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-cluster-tls-config\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.123534 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.123496 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717a5538-08e8-408a-a684-e12e63a0a2fc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:51:52.463332 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463300 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65" exitCode=0 Jul 06 20:51:52.463332 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463330 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerID="438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5" exitCode=0 Jul 06 20:51:52.463530 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463376 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.463530 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65"} Jul 06 20:51:52.463530 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5"} Jul 06 20:51:52.463530 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"717a5538-08e8-408a-a684-e12e63a0a2fc","Type":"ContainerDied","Data":"bcd9423c4a6dfe2b3bec6adada05787ab4023d6c8d0ff3c77882b1c4310b6efa"} Jul 06 20:51:52.463675 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.463541 2576 scope.go:117] "RemoveContainer" containerID="288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567" Jul 06 20:51:52.474533 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.474509 2576 scope.go:117] "RemoveContainer" containerID="bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65" Jul 06 20:51:52.482457 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.482438 2576 scope.go:117] "RemoveContainer" containerID="c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e" Jul 06 20:51:52.489694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.489662 2576 scope.go:117] "RemoveContainer" containerID="438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5" Jul 06 20:51:52.492695 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.492673 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:51:52.497411 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.497394 2576 scope.go:117] "RemoveContainer" containerID="da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce" Jul 06 20:51:52.499179 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.499158 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:51:52.504294 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.504276 2576 scope.go:117] "RemoveContainer" containerID="77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a" Jul 06 20:51:52.510931 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.510915 2576 scope.go:117] "RemoveContainer" containerID="979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b" Jul 06 20:51:52.517467 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.517453 2576 scope.go:117] "RemoveContainer" containerID="288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567" Jul 06 20:51:52.517752 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.517725 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567\": container with ID starting with 288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567 not found: ID does not exist" containerID="288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567" Jul 06 20:51:52.517810 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.517759 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567"} err="failed to get container status \"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567\": rpc error: code = NotFound desc = could not find container \"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567\": container with ID starting with 288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567 not found: ID does not exist" Jul 06 20:51:52.517810 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.517792 2576 scope.go:117] "RemoveContainer" containerID="bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65" Jul 06 20:51:52.518041 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.518022 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65\": container with ID starting with bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65 not found: ID does not exist" containerID="bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65" Jul 06 20:51:52.518120 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518046 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65"} err="failed to get container status \"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65\": rpc error: code = NotFound desc = could not find container \"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65\": container with ID starting with bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65 not found: ID does not exist" Jul 06 20:51:52.518120 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518067 2576 scope.go:117] "RemoveContainer" containerID="c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e" Jul 06 20:51:52.518291 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.518279 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e\": container with ID starting with c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e not found: ID does not exist" containerID="c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e" Jul 06 20:51:52.518326 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518294 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e"} err="failed to get container status \"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e\": rpc error: code = NotFound desc = could not find container \"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e\": container with ID starting with c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e not found: ID does not exist" Jul 06 20:51:52.518326 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518309 2576 scope.go:117] "RemoveContainer" containerID="438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5" Jul 06 20:51:52.518501 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.518484 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5\": container with ID starting with 438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5 not found: ID does not exist" containerID="438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5" Jul 06 20:51:52.518544 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518507 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5"} err="failed to get container status \"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5\": rpc error: code = NotFound desc = could not find container \"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5\": container with ID starting with 438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5 not found: ID does not exist" Jul 06 20:51:52.518544 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518523 2576 scope.go:117] "RemoveContainer" containerID="da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce" Jul 06 20:51:52.518737 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.518722 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce\": container with ID starting with da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce not found: ID does not exist" containerID="da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce" Jul 06 20:51:52.518783 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518742 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce"} err="failed to get container status \"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce\": rpc error: code = NotFound desc = could not find container \"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce\": container with ID starting with da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce not found: ID does not exist" Jul 06 20:51:52.518783 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518755 2576 scope.go:117] "RemoveContainer" containerID="77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a" Jul 06 20:51:52.518967 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.518952 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a\": container with ID starting with 77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a not found: ID does not exist" containerID="77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a" Jul 06 20:51:52.519006 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518971 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a"} err="failed to get container status \"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a\": rpc error: code = NotFound desc = could not find container \"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a\": container with ID starting with 77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a not found: ID does not exist" Jul 06 20:51:52.519006 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.518983 2576 scope.go:117] "RemoveContainer" containerID="979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b" Jul 06 20:51:52.519205 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:51:52.519190 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b\": container with ID starting with 979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b not found: ID does not exist" containerID="979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b" Jul 06 20:51:52.519252 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519206 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b"} err="failed to get container status \"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b\": rpc error: code = NotFound desc = could not find container \"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b\": container with ID starting with 979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b not found: ID does not exist" Jul 06 20:51:52.519252 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519218 2576 scope.go:117] "RemoveContainer" containerID="288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567" Jul 06 20:51:52.519400 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519380 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567"} err="failed to get container status \"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567\": rpc error: code = NotFound desc = could not find container \"288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567\": container with ID starting with 288c44e5da2e5fb85d0c126a50e1829b3db14ac5ac8bc8c609329e83d92f8567 not found: ID does not exist" Jul 06 20:51:52.519440 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519402 2576 scope.go:117] "RemoveContainer" containerID="bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65" Jul 06 20:51:52.519577 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519562 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65"} err="failed to get container status \"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65\": rpc error: code = NotFound desc = could not find container \"bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65\": container with ID starting with bfefeb7e15730e596ee3afa9e3c7cb0e6112b21012f1c2bb952c8eb8e5056d65 not found: ID does not exist" Jul 06 20:51:52.519638 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519577 2576 scope.go:117] "RemoveContainer" containerID="c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e" Jul 06 20:51:52.519870 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519845 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e"} err="failed to get container status \"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e\": rpc error: code = NotFound desc = could not find container \"c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e\": container with ID starting with c1f55f7843857169232a88e328c445cac03d9de9f6bb3f7b1ef424cec97bcd6e not found: ID does not exist" Jul 06 20:51:52.519870 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.519866 2576 scope.go:117] "RemoveContainer" containerID="438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5" Jul 06 20:51:52.520125 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520105 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5"} err="failed to get container status \"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5\": rpc error: code = NotFound desc = could not find container \"438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5\": container with ID starting with 438752edd87813eb954d57ce76012e29832fd3c9fe3981e2f975f0d674dfdfa5 not found: ID does not exist" Jul 06 20:51:52.520192 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520127 2576 scope.go:117] "RemoveContainer" containerID="da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce" Jul 06 20:51:52.520451 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520422 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce"} err="failed to get container status \"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce\": rpc error: code = NotFound desc = could not find container \"da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce\": container with ID starting with da6b0adefe684f295ea1d2e9fc4c910a51de190a060a1945f8e15637aebbffce not found: ID does not exist" Jul 06 20:51:52.520540 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520451 2576 scope.go:117] "RemoveContainer" containerID="77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a" Jul 06 20:51:52.520724 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520704 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a"} err="failed to get container status \"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a\": rpc error: code = NotFound desc = could not find container \"77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a\": container with ID starting with 77c74f4bf1c4478bbd3c3289ae5c6010d49c61ea76281fa88eaeccb67f61111a not found: ID does not exist" Jul 06 20:51:52.520724 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520724 2576 scope.go:117] "RemoveContainer" containerID="979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b" Jul 06 20:51:52.520941 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.520927 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b"} err="failed to get container status \"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b\": rpc error: code = NotFound desc = could not find container \"979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b\": container with ID starting with 979118a240dc76e83bd7950ca8736bd2493154e7ebf15776812b57ba005d060b not found: ID does not exist" Jul 06 20:51:52.530085 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530065 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:51:52.530371 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530358 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="init-config-reloader" Jul 06 20:51:52.530416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530374 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="init-config-reloader" Jul 06 20:51:52.530416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530382 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="prom-label-proxy" Jul 06 20:51:52.530416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530387 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="prom-label-proxy" Jul 06 20:51:52.530416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530400 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="alertmanager" Jul 06 20:51:52.530416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530406 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="alertmanager" Jul 06 20:51:52.530416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530413 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-web" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530419 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-web" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530430 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530438 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530448 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="config-reloader" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530453 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="config-reloader" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530458 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-metric" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530463 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-metric" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530520 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="prom-label-proxy" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530528 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530534 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-metric" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530540 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="kube-rbac-proxy-web" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530545 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="config-reloader" Jul 06 20:51:52.530588 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.530550 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" containerName="alertmanager" Jul 06 20:51:52.535565 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.535550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.538059 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538039 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:51:52.538126 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538092 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqjlw\"" Jul 06 20:51:52.538181 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538039 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:51:52.538575 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538555 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:51:52.538679 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:51:52.538801 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:51:52.538869 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538843 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:51:52.538869 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538858 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:51:52.539003 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.538940 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:51:52.545954 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.545936 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:51:52.551204 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.551187 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:51:52.627068 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627068 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-config-out\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-web-config\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627222 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2k6n\" (UniqueName: \"kubernetes.io/projected/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-kube-api-access-g2k6n\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.627391 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.627375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-config-volume\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728162 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-config-volume\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728492 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728492 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728492 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-config-out\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728492 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-web-config\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728492 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728492 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728798 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.728798 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.728577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2k6n\" (UniqueName: \"kubernetes.io/projected/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-kube-api-access-g2k6n\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.730060 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.729069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.730060 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.729354 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.730342 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.730316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.731719 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.731447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.731719 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.731597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-config-volume\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.731882 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.731722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-web-config\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.731882 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.731752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.732096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.732078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.732160 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.732130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.732518 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.732500 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.732986 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.732965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.733381 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.733365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-config-out\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.739347 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.739327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2k6n\" (UniqueName: \"kubernetes.io/projected/7208c8f8-efe0-4d89-b2c8-55ec2ef26c68-kube-api-access-g2k6n\") pod \"alertmanager-main-0\" (UID: \"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.845455 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.845436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:51:52.986416 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:52.986314 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:51:52.989003 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:51:52.988983 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7208c8f8_efe0_4d89_b2c8_55ec2ef26c68.slice/crio-ad5f111194bd72fe6dd36de25c937bf35ec605588a50a61ffcf8898a64a88c4e WatchSource:0}: Error finding container ad5f111194bd72fe6dd36de25c937bf35ec605588a50a61ffcf8898a64a88c4e: Status 404 returned error can't find the container with id ad5f111194bd72fe6dd36de25c937bf35ec605588a50a61ffcf8898a64a88c4e Jul 06 20:51:53.468428 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:53.468398 2576 generic.go:356] "Generic (PLEG): container finished" podID="7208c8f8-efe0-4d89-b2c8-55ec2ef26c68" containerID="5515f5436aa31da2ff8132438256341da4c09d9e8f8f6737a46534c59e1b626a" exitCode=0 Jul 06 20:51:53.468601 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:53.468491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerDied","Data":"5515f5436aa31da2ff8132438256341da4c09d9e8f8f6737a46534c59e1b626a"} Jul 06 20:51:53.468694 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:53.468609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"ad5f111194bd72fe6dd36de25c937bf35ec605588a50a61ffcf8898a64a88c4e"} Jul 06 20:51:53.674333 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:53.674307 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717a5538-08e8-408a-a684-e12e63a0a2fc" path="/var/lib/kubelet/pods/717a5538-08e8-408a-a684-e12e63a0a2fc/volumes" Jul 06 20:51:54.477239 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.477205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"d8dee7b3d89b64e1ffff0efae1e5546d8ee802ae8b6b34a4b0f166502058097d"} Jul 06 20:51:54.477595 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.477286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"4bf76afcf14e592f6b2231049126aba4e6ef1e9629554164f7f88f6c253c0e7a"} Jul 06 20:51:54.477595 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.477327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"02af006f1e7696aabe80cbd0b11a622423e242ff28dafe186bff1ff36bc5ce65"} Jul 06 20:51:54.477595 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.477371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"dc56b98d0a966cca902cf2859b312e76a80c3654ef2d3cb03069c07988cc2342"} Jul 06 20:51:54.477595 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.477407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"0ad0c6d018670b20fe8fcb1f8b727dd964e340209f9b692d474ddc6b8a9a33d1"} Jul 06 20:51:54.477595 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.477441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7208c8f8-efe0-4d89-b2c8-55ec2ef26c68","Type":"ContainerStarted","Data":"0e47b3fd932822c270e22fbc49e55b541b893ef382d99eee828d33c4ac2960cc"} Jul 06 20:51:54.512828 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:54.512776 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.497309282 podStartE2EDuration="2.512756326s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.447044ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:51:54.510941654 +0000 UTC m=+177.413358886" watchObservedRunningTime="2026-07-06 20:51:54.512756326 +0000 UTC m=+177.415173542" Jul 06 20:51:58.248761 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:58.248713 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:58.309403 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:51:58.309377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:01.256951 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:01.256917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:01.357093 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:01.357063 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:01.419798 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:01.419759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:06.401113 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:06.401080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:06.476650 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:06.476587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:16.825843 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:16.825782 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:16.927202 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:16.927174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:16.991082 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:16.991058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:45.278337 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:45.278292 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:52:45.340840 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:52:45.340816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:22.363160 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:22.363055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:47.279574 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:47.279542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:47.435637 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:47.435588 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:47.622975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:47.622889 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:47.720210 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:47.720181 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:47.823185 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:47.823157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:57.545584 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:57.545553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:53:57.550410 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:57.550390 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:53:57.561302 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:53:57.561278 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:54:13.073754 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:13.073717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:14.156633 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:14.156576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:48.506408 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:48.506330 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:48.636105 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:48.636071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:57.815908 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:57.815872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:58.086593 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:58.086509 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:58.528054 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:58.528010 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:58.663051 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:58.663020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:58.908723 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:58.908682 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:59.033305 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:59.033277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:59.132277 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:59.132242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:59.350214 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:59.350127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:59.635810 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:59.635712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:59.717406 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:59.717372 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:54:59.783325 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:54:59.783297 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:07.426935 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:07.426904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:07.503171 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:07.503138 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:08.506497 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.506458 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:08.603191 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.603141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:08.630499 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.630473 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-z9hcq"] Jul 06 20:56:08.633680 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.633659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.638014 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.637993 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 20:56:08.638123 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.638013 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zjrgd\"" Jul 06 20:56:08.638932 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.638906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 20:56:08.639084 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.639047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 20:56:08.644372 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.644329 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-z9hcq"] Jul 06 20:56:08.688555 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.688534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htt7j\" (UniqueName: \"kubernetes.io/projected/aa2eaca0-d190-4196-afc1-db14d0efa5aa-kube-api-access-htt7j\") pod \"seaweedfs-64568bcd49-z9hcq\" (UID: \"aa2eaca0-d190-4196-afc1-db14d0efa5aa\") " pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.688663 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.688573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa2eaca0-d190-4196-afc1-db14d0efa5aa-data\") pod \"seaweedfs-64568bcd49-z9hcq\" (UID: \"aa2eaca0-d190-4196-afc1-db14d0efa5aa\") " pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.691640 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.691603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:08.789297 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.789245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa2eaca0-d190-4196-afc1-db14d0efa5aa-data\") pod \"seaweedfs-64568bcd49-z9hcq\" (UID: \"aa2eaca0-d190-4196-afc1-db14d0efa5aa\") " pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.789390 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.789305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htt7j\" (UniqueName: \"kubernetes.io/projected/aa2eaca0-d190-4196-afc1-db14d0efa5aa-kube-api-access-htt7j\") pod \"seaweedfs-64568bcd49-z9hcq\" (UID: \"aa2eaca0-d190-4196-afc1-db14d0efa5aa\") " pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.789645 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.789600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa2eaca0-d190-4196-afc1-db14d0efa5aa-data\") pod \"seaweedfs-64568bcd49-z9hcq\" (UID: \"aa2eaca0-d190-4196-afc1-db14d0efa5aa\") " pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.794199 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.794180 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:08.798491 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.798469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htt7j\" (UniqueName: \"kubernetes.io/projected/aa2eaca0-d190-4196-afc1-db14d0efa5aa-kube-api-access-htt7j\") pod \"seaweedfs-64568bcd49-z9hcq\" (UID: \"aa2eaca0-d190-4196-afc1-db14d0efa5aa\") " pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:08.943923 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:08.943893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:09.067735 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:09.067676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-z9hcq"] Jul 06 20:56:09.070458 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:56:09.070418 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2eaca0_d190_4196_afc1_db14d0efa5aa.slice/crio-d4581887c13799b815bffa033a84984615cd48c839c40c8caf4d087a5a887f7e WatchSource:0}: Error finding container d4581887c13799b815bffa033a84984615cd48c839c40c8caf4d087a5a887f7e: Status 404 returned error can't find the container with id d4581887c13799b815bffa033a84984615cd48c839c40c8caf4d087a5a887f7e Jul 06 20:56:09.072075 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:09.072057 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:56:09.440717 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:09.440687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-z9hcq" event={"ID":"aa2eaca0-d190-4196-afc1-db14d0efa5aa","Type":"ContainerStarted","Data":"d4581887c13799b815bffa033a84984615cd48c839c40c8caf4d087a5a887f7e"} Jul 06 20:56:09.553165 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:09.553137 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:09.654279 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:09.654236 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:10.390193 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:10.390152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:10.483640 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:10.483581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:12.456954 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:12.456924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-z9hcq" event={"ID":"aa2eaca0-d190-4196-afc1-db14d0efa5aa","Type":"ContainerStarted","Data":"e3aea0d1c6fbb2ada769bbda2a4fc337765e4d3e5ae52059f448771dc817f1a3"} Jul 06 20:56:12.457319 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:12.457054 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:12.475765 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:12.475722 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-z9hcq" podStartSLOduration=1.970820212 podStartE2EDuration="4.475709443s" totalImagesPullingTime="2.504889231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:56:12.474954107 +0000 UTC m=+435.377371322" watchObservedRunningTime="2026-07-06 20:56:12.475709443 +0000 UTC m=+435.378126657" Jul 06 20:56:18.463871 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:18.463792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-z9hcq" Jul 06 20:56:18.721458 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:18.721377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:18.823093 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:18.823062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:18.879881 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:18.879855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:30.463078 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:56:30.463043 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:19.389359 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.389311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:19.446243 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.446210 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-n249q"] Jul 06 20:57:19.448481 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.448461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:19.452466 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.452449 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 06 20:57:19.452724 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.452706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-qb5ht\"" Jul 06 20:57:19.463066 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.463045 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-n249q"] Jul 06 20:57:19.466797 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.466777 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-2pfdl"] Jul 06 20:57:19.469197 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.469180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.471737 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.471716 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 06 20:57:19.472647 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.472610 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-kpqjz\"" Jul 06 20:57:19.480809 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.480791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-2pfdl"] Jul 06 20:57:19.498423 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.498400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:19.513884 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.513859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f389143-c02e-47aa-bba9-d2cb1e2cbfc7-cert\") pod \"odh-model-controller-84b54b7f97-2pfdl\" (UID: \"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7\") " pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.513975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.513904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a6680f-9b52-4883-8ed2-43410d0b4cbd-tls-certs\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:19.513975 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.513929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dft\" (UniqueName: \"kubernetes.io/projected/7f389143-c02e-47aa-bba9-d2cb1e2cbfc7-kube-api-access-b5dft\") pod \"odh-model-controller-84b54b7f97-2pfdl\" (UID: \"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7\") " pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.514088 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.514018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7gc\" (UniqueName: \"kubernetes.io/projected/28a6680f-9b52-4883-8ed2-43410d0b4cbd-kube-api-access-hs7gc\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:19.615238 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.615209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f389143-c02e-47aa-bba9-d2cb1e2cbfc7-cert\") pod \"odh-model-controller-84b54b7f97-2pfdl\" (UID: \"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7\") " pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.615376 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.615244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a6680f-9b52-4883-8ed2-43410d0b4cbd-tls-certs\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:19.615376 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.615264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dft\" (UniqueName: \"kubernetes.io/projected/7f389143-c02e-47aa-bba9-d2cb1e2cbfc7-kube-api-access-b5dft\") pod \"odh-model-controller-84b54b7f97-2pfdl\" (UID: \"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7\") " pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.615376 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.615309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7gc\" (UniqueName: \"kubernetes.io/projected/28a6680f-9b52-4883-8ed2-43410d0b4cbd-kube-api-access-hs7gc\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:19.615525 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:57:19.615373 2576 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 20:57:19.615525 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:57:19.615437 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a6680f-9b52-4883-8ed2-43410d0b4cbd-tls-certs podName:28a6680f-9b52-4883-8ed2-43410d0b4cbd nodeName:}" failed. No retries permitted until 2026-07-06 20:57:20.115419618 +0000 UTC m=+503.017836812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/28a6680f-9b52-4883-8ed2-43410d0b4cbd-tls-certs") pod "model-serving-api-fd65d7d6-n249q" (UID: "28a6680f-9b52-4883-8ed2-43410d0b4cbd") : secret "model-serving-api-tls" not found Jul 06 20:57:19.617889 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.617863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f389143-c02e-47aa-bba9-d2cb1e2cbfc7-cert\") pod \"odh-model-controller-84b54b7f97-2pfdl\" (UID: \"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7\") " pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.627036 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.627012 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7gc\" (UniqueName: \"kubernetes.io/projected/28a6680f-9b52-4883-8ed2-43410d0b4cbd-kube-api-access-hs7gc\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:19.628368 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.628341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:19.630079 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.630057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dft\" (UniqueName: \"kubernetes.io/projected/7f389143-c02e-47aa-bba9-d2cb1e2cbfc7-kube-api-access-b5dft\") pod \"odh-model-controller-84b54b7f97-2pfdl\" (UID: \"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7\") " pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.780266 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.780239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:19.910364 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:19.910336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-2pfdl"] Jul 06 20:57:19.914886 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:57:19.914859 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f389143_c02e_47aa_bba9_d2cb1e2cbfc7.slice/crio-91d37a09e4bc03ceff04ec14afd96d3b66c46ad28bf910e783bdc5858d8aa609 WatchSource:0}: Error finding container 91d37a09e4bc03ceff04ec14afd96d3b66c46ad28bf910e783bdc5858d8aa609: Status 404 returned error can't find the container with id 91d37a09e4bc03ceff04ec14afd96d3b66c46ad28bf910e783bdc5858d8aa609 Jul 06 20:57:20.035188 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.035116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:20.120302 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.120274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a6680f-9b52-4883-8ed2-43410d0b4cbd-tls-certs\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:20.122693 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.122673 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a6680f-9b52-4883-8ed2-43410d0b4cbd-tls-certs\") pod \"model-serving-api-fd65d7d6-n249q\" (UID: \"28a6680f-9b52-4883-8ed2-43410d0b4cbd\") " pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:20.141249 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.141222 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:20.205273 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.205252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:20.359513 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.359425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:20.486944 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.486916 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-n249q"] Jul 06 20:57:20.489356 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:57:20.489327 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a6680f_9b52_4883_8ed2_43410d0b4cbd.slice/crio-cca82fbe4083b322a8d266cb5912a10e57253112a1396768843920b3c0415d79 WatchSource:0}: Error finding container cca82fbe4083b322a8d266cb5912a10e57253112a1396768843920b3c0415d79: Status 404 returned error can't find the container with id cca82fbe4083b322a8d266cb5912a10e57253112a1396768843920b3c0415d79 Jul 06 20:57:20.723038 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.722999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" event={"ID":"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7","Type":"ContainerStarted","Data":"91d37a09e4bc03ceff04ec14afd96d3b66c46ad28bf910e783bdc5858d8aa609"} Jul 06 20:57:20.724254 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:20.724214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-n249q" event={"ID":"28a6680f-9b52-4883-8ed2-43410d0b4cbd","Type":"ContainerStarted","Data":"cca82fbe4083b322a8d266cb5912a10e57253112a1396768843920b3c0415d79"} Jul 06 20:57:24.745738 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:24.745705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" event={"ID":"7f389143-c02e-47aa-bba9-d2cb1e2cbfc7","Type":"ContainerStarted","Data":"292e856d0da2d5666da3c8bd25dcfc3dff4f0cbbea4751cafb0a80eff00d9842"} Jul 06 20:57:24.746188 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:24.745789 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:24.747186 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:24.747163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-n249q" event={"ID":"28a6680f-9b52-4883-8ed2-43410d0b4cbd","Type":"ContainerStarted","Data":"9e7c57a143df2f615aa0cd0c68afbc103f3718fe5426abb1e00e77ea9c9d9447"} Jul 06 20:57:24.747332 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:24.747314 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:24.782138 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:24.782090 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" podStartSLOduration=1.9575178800000002 podStartE2EDuration="5.782077722s" totalImagesPullingTime="3.824559842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:57:24.780102814 +0000 UTC m=+507.682520028" watchObservedRunningTime="2026-07-06 20:57:24.782077722 +0000 UTC m=+507.684494936" Jul 06 20:57:24.820562 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:24.820516 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-n249q" podStartSLOduration=2.5344663990000003 podStartE2EDuration="5.820503691s" totalImagesPullingTime="3.286037292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:57:24.818752599 +0000 UTC m=+507.721169814" watchObservedRunningTime="2026-07-06 20:57:24.820503691 +0000 UTC m=+507.722920948" Jul 06 20:57:35.753545 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:35.753518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-2pfdl" Jul 06 20:57:35.755550 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:35.755532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-n249q" Jul 06 20:57:36.591443 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.591406 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-vpcfx"] Jul 06 20:57:36.594160 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.594142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.604434 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.604412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-vpcfx"] Jul 06 20:57:36.643741 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.643719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6495d4e-1a89-49e0-b090-5aba96efd976-model-cache\") pod \"s3-init-vpcfx\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.643839 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.643776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-426tw\" (UniqueName: \"kubernetes.io/projected/f6495d4e-1a89-49e0-b090-5aba96efd976-kube-api-access-426tw\") pod \"s3-init-vpcfx\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.744191 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.744148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6495d4e-1a89-49e0-b090-5aba96efd976-model-cache\") pod \"s3-init-vpcfx\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.744348 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.744260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-426tw\" (UniqueName: \"kubernetes.io/projected/f6495d4e-1a89-49e0-b090-5aba96efd976-kube-api-access-426tw\") pod \"s3-init-vpcfx\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.744545 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.744526 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6495d4e-1a89-49e0-b090-5aba96efd976-model-cache\") pod \"s3-init-vpcfx\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.752487 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.752462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-426tw\" (UniqueName: \"kubernetes.io/projected/f6495d4e-1a89-49e0-b090-5aba96efd976-kube-api-access-426tw\") pod \"s3-init-vpcfx\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " pod="kserve/s3-init-vpcfx" Jul 06 20:57:36.903496 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:36.903437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vpcfx" Jul 06 20:57:37.027943 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:37.027917 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-vpcfx"] Jul 06 20:57:37.029762 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:57:37.029739 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6495d4e_1a89_49e0_b090_5aba96efd976.slice/crio-7af8d4a5dfd16c1e8226cdc08aab81498c756232d7f7c6d6befe8308c5b581ce WatchSource:0}: Error finding container 7af8d4a5dfd16c1e8226cdc08aab81498c756232d7f7c6d6befe8308c5b581ce: Status 404 returned error can't find the container with id 7af8d4a5dfd16c1e8226cdc08aab81498c756232d7f7c6d6befe8308c5b581ce Jul 06 20:57:37.799896 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:37.799865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vpcfx" event={"ID":"f6495d4e-1a89-49e0-b090-5aba96efd976","Type":"ContainerStarted","Data":"7af8d4a5dfd16c1e8226cdc08aab81498c756232d7f7c6d6befe8308c5b581ce"} Jul 06 20:57:41.819139 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:41.819105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vpcfx" event={"ID":"f6495d4e-1a89-49e0-b090-5aba96efd976","Type":"ContainerStarted","Data":"7a75b56250538329cb6475214e3ecf13c13e7434180a0cf1af7b66e39749cf9b"} Jul 06 20:57:43.829040 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:43.829001 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerID="7a75b56250538329cb6475214e3ecf13c13e7434180a0cf1af7b66e39749cf9b" exitCode=0 Jul 06 20:57:43.829382 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:43.829076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vpcfx" event={"ID":"f6495d4e-1a89-49e0-b090-5aba96efd976","Type":"ContainerDied","Data":"7a75b56250538329cb6475214e3ecf13c13e7434180a0cf1af7b66e39749cf9b"} Jul 06 20:57:48.854173 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:48.854082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vpcfx" event={"ID":"f6495d4e-1a89-49e0-b090-5aba96efd976","Type":"ContainerStarted","Data":"98b6efbba6ae40a99f777278f6a89daafbdeca44ffd7815486f35537e471b3c5"} Jul 06 20:57:48.883870 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:57:48.883809 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-vpcfx" podStartSLOduration=2.01486655 podStartE2EDuration="12.883792928s" totalImagesPullingTime="8.836485362s" totalInitContainerRuntime="2.032441016s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:57:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:57:48.88104757 +0000 UTC m=+531.783464787" watchObservedRunningTime="2026-07-06 20:57:48.883792928 +0000 UTC m=+531.786210142" Jul 06 20:58:54.112310 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:54.112273 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerID="98b6efbba6ae40a99f777278f6a89daafbdeca44ffd7815486f35537e471b3c5" exitCode=0 Jul 06 20:58:54.112733 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:54.112347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vpcfx" event={"ID":"f6495d4e-1a89-49e0-b090-5aba96efd976","Type":"ContainerDied","Data":"98b6efbba6ae40a99f777278f6a89daafbdeca44ffd7815486f35537e471b3c5"} Jul 06 20:58:55.245186 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.245160 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vpcfx" Jul 06 20:58:55.323587 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.323557 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-426tw\" (UniqueName: \"kubernetes.io/projected/f6495d4e-1a89-49e0-b090-5aba96efd976-kube-api-access-426tw\") pod \"f6495d4e-1a89-49e0-b090-5aba96efd976\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " Jul 06 20:58:55.323744 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.323694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6495d4e-1a89-49e0-b090-5aba96efd976-model-cache\") pod \"f6495d4e-1a89-49e0-b090-5aba96efd976\" (UID: \"f6495d4e-1a89-49e0-b090-5aba96efd976\") " Jul 06 20:58:55.325838 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.325818 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6495d4e-1a89-49e0-b090-5aba96efd976-kube-api-access-426tw" (OuterVolumeSpecName: "kube-api-access-426tw") pod "f6495d4e-1a89-49e0-b090-5aba96efd976" (UID: "f6495d4e-1a89-49e0-b090-5aba96efd976"). InnerVolumeSpecName "kube-api-access-426tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:58:55.342167 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.342146 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6495d4e-1a89-49e0-b090-5aba96efd976-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6495d4e-1a89-49e0-b090-5aba96efd976" (UID: "f6495d4e-1a89-49e0-b090-5aba96efd976"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:58:55.424509 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.424473 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6495d4e-1a89-49e0-b090-5aba96efd976-model-cache\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:58:55.424509 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:55.424508 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-426tw\" (UniqueName: \"kubernetes.io/projected/f6495d4e-1a89-49e0-b090-5aba96efd976-kube-api-access-426tw\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:58:56.122153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:56.122091 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vpcfx" Jul 06 20:58:56.122153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:56.122124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vpcfx" event={"ID":"f6495d4e-1a89-49e0-b090-5aba96efd976","Type":"ContainerDied","Data":"7af8d4a5dfd16c1e8226cdc08aab81498c756232d7f7c6d6befe8308c5b581ce"} Jul 06 20:58:56.122153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:56.122155 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7af8d4a5dfd16c1e8226cdc08aab81498c756232d7f7c6d6befe8308c5b581ce" Jul 06 20:58:56.674778 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:56.674746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:58:56.794423 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:56.794393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:58:57.575085 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:57.575060 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:58:57.586483 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:58:57.586463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vcn6_6acc2a15-00e8-4b53-bd31-0988fdb3dabc/ovn-acl-logging/0.log" Jul 06 20:59:08.924271 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.924238 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cr722/must-gather-8mnwc"] Jul 06 20:59:08.924687 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.924577 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerName="download-hf-model" Jul 06 20:59:08.924687 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.924588 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerName="download-hf-model" Jul 06 20:59:08.924687 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.924608 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerName="s3-init" Jul 06 20:59:08.924687 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.924630 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerName="s3-init" Jul 06 20:59:08.924687 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.924689 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6495d4e-1a89-49e0-b090-5aba96efd976" containerName="s3-init" Jul 06 20:59:08.926965 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.926950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:08.929681 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.929661 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cr722\"/\"kube-root-ca.crt\"" Jul 06 20:59:08.930785 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.930768 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cr722\"/\"openshift-service-ca.crt\"" Jul 06 20:59:08.930871 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.930768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cr722\"/\"default-dockercfg-nx9j4\"" Jul 06 20:59:08.941444 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.941417 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:08.942276 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:08.942258 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cr722/must-gather-8mnwc"] Jul 06 20:59:09.009906 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.009883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:09.030682 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.030658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2f5\" (UniqueName: \"kubernetes.io/projected/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-kube-api-access-vl2f5\") pod \"must-gather-8mnwc\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.030770 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.030746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-must-gather-output\") pod \"must-gather-8mnwc\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.131868 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.131847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-must-gather-output\") pod \"must-gather-8mnwc\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.131988 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.131915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2f5\" (UniqueName: \"kubernetes.io/projected/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-kube-api-access-vl2f5\") pod \"must-gather-8mnwc\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.132220 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.132201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-must-gather-output\") pod \"must-gather-8mnwc\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.143415 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.143388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2f5\" (UniqueName: \"kubernetes.io/projected/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-kube-api-access-vl2f5\") pod \"must-gather-8mnwc\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.236678 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.236609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:09.370439 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:09.370411 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cr722/must-gather-8mnwc"] Jul 06 20:59:09.373437 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:59:09.373412 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfd175ea_6c87_4500_ab24_ca6dc1dfd05f.slice/crio-a1c3391798f8879aeb5fa2068a2d6f7c7ef232af6fc7a117267514b3df5a33b1 WatchSource:0}: Error finding container a1c3391798f8879aeb5fa2068a2d6f7c7ef232af6fc7a117267514b3df5a33b1: Status 404 returned error can't find the container with id a1c3391798f8879aeb5fa2068a2d6f7c7ef232af6fc7a117267514b3df5a33b1 Jul 06 20:59:10.181558 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:10.181518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cr722/must-gather-8mnwc" event={"ID":"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f","Type":"ContainerStarted","Data":"a1c3391798f8879aeb5fa2068a2d6f7c7ef232af6fc7a117267514b3df5a33b1"} Jul 06 20:59:16.217732 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:16.217691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cr722/must-gather-8mnwc" event={"ID":"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f","Type":"ContainerStarted","Data":"8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586"} Jul 06 20:59:16.217732 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:16.217738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cr722/must-gather-8mnwc" event={"ID":"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f","Type":"ContainerStarted","Data":"d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f"} Jul 06 20:59:16.235893 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:16.235833 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cr722/must-gather-8mnwc" podStartSLOduration=2.119225301 podStartE2EDuration="8.235813994s" totalImagesPullingTime="6.116588693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:16.234059379 +0000 UTC m=+619.136476615" watchObservedRunningTime="2026-07-06 20:59:16.235813994 +0000 UTC m=+619.138231209" Jul 06 20:59:17.712187 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:17.712113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:27.943970 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:27.943934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:35.318377 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:35.318346 2576 generic.go:356] "Generic (PLEG): container finished" podID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerID="d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f" exitCode=0 Jul 06 20:59:35.318792 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:35.318400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cr722/must-gather-8mnwc" event={"ID":"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f","Type":"ContainerDied","Data":"d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f"} Jul 06 20:59:35.318792 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:35.318680 2576 scope.go:117] "RemoveContainer" containerID="d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f" Jul 06 20:59:35.542696 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:35.542674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-cr722_must-gather-8mnwc_cfd175ea-6c87-4500-ab24-ca6dc1dfd05f/gather/0.log" Jul 06 20:59:35.926143 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:35.926105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:36.140003 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:36.139930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:36.228508 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:36.228480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:38.884952 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:38.884925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m8fqq_88c64e78-a89d-47e1-8694-755a2133c0cb/global-pull-secret-syncer/0.log" Jul 06 20:59:39.074482 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:39.074454 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" Jul 06 20:59:39.403381 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:39.403340 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-164.ec2.internal_ea14a54407f26f0ae00b311aa4745e29/haproxy/0.log" Jul 06 20:59:40.904399 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:40.904369 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-cr722/must-gather-8mnwc"] Jul 06 20:59:40.904817 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:40.904527 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-cr722/must-gather-8mnwc" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="copy" containerID="cri-o://8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586" gracePeriod=2 Jul 06 20:59:40.914578 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:59:40.914326 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-cr722\"/\"must-gather-8mnwc\": pods \"must-gather-8mnwc\" not found" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:40.914795 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:40.914770 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-cr722/must-gather-8mnwc"] Jul 06 20:59:41.136113 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.136093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-cr722_must-gather-8mnwc_cfd175ea-6c87-4500-ab24-ca6dc1dfd05f/copy/0.log" Jul 06 20:59:41.137813 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.137800 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:41.140360 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:59:41.140340 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8mnwc\" is forbidden: User \"system:node:ip-10-0-138-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cr722\": no relationship found between node 'ip-10-0-138-164.ec2.internal' and this object" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:41.209951 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.209926 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-must-gather-output\") pod \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " Jul 06 20:59:41.210049 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.209957 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl2f5\" (UniqueName: \"kubernetes.io/projected/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-kube-api-access-vl2f5\") pod \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\" (UID: \"cfd175ea-6c87-4500-ab24-ca6dc1dfd05f\") " Jul 06 20:59:41.211029 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.211001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" (UID: "cfd175ea-6c87-4500-ab24-ca6dc1dfd05f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:59:41.212344 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.212321 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-kube-api-access-vl2f5" (OuterVolumeSpecName: "kube-api-access-vl2f5") pod "cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" (UID: "cfd175ea-6c87-4500-ab24-ca6dc1dfd05f"). InnerVolumeSpecName "kube-api-access-vl2f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:59:41.310461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.310440 2576 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-must-gather-output\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:59:41.310461 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.310461 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl2f5\" (UniqueName: \"kubernetes.io/projected/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f-kube-api-access-vl2f5\") on node \"ip-10-0-138-164.ec2.internal\" DevicePath \"\"" Jul 06 20:59:41.342772 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.342756 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-cr722_must-gather-8mnwc_cfd175ea-6c87-4500-ab24-ca6dc1dfd05f/copy/0.log" Jul 06 20:59:41.343092 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.343071 2576 generic.go:356] "Generic (PLEG): container finished" podID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerID="8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586" exitCode=143 Jul 06 20:59:41.343151 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.343118 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:41.343188 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.343163 2576 scope.go:117] "RemoveContainer" containerID="8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586" Jul 06 20:59:41.348908 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:59:41.348875 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8mnwc\" is forbidden: User \"system:node:ip-10-0-138-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cr722\": no relationship found between node 'ip-10-0-138-164.ec2.internal' and this object" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:41.351394 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.351372 2576 scope.go:117] "RemoveContainer" containerID="d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f" Jul 06 20:59:41.352770 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:59:41.352749 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8mnwc\" is forbidden: User \"system:node:ip-10-0-138-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cr722\": no relationship found between node 'ip-10-0-138-164.ec2.internal' and this object" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" pod="openshift-must-gather-cr722/must-gather-8mnwc" Jul 06 20:59:41.363982 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.363966 2576 scope.go:117] "RemoveContainer" containerID="8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586" Jul 06 20:59:41.364224 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:59:41.364204 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586\": container with ID starting with 8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586 not found: ID does not exist" containerID="8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586" Jul 06 20:59:41.364296 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.364236 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586"} err="failed to get container status \"8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586\": rpc error: code = NotFound desc = could not find container \"8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586\": container with ID starting with 8382a0f9bf82ca153108f55f94d50d9c6eee5edfe11f21aff55ff3e536a0c586 not found: ID does not exist" Jul 06 20:59:41.364296 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.364261 2576 scope.go:117] "RemoveContainer" containerID="d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f" Jul 06 20:59:41.364515 ip-10-0-138-164 kubenswrapper[2576]: E0706 20:59:41.364498 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f\": container with ID starting with d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f not found: ID does not exist" containerID="d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f" Jul 06 20:59:41.364554 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.364520 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f"} err="failed to get container status \"d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f\": rpc error: code = NotFound desc = could not find container \"d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f\": container with ID starting with d32fd97d3cc49ac6dfd628cf9ee76d6c012940805a08980dd4d9deb417ec1e2f not found: ID does not exist" Jul 06 20:59:41.674909 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.674880 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" path="/var/lib/kubelet/pods/cfd175ea-6c87-4500-ab24-ca6dc1dfd05f/volumes" Jul 06 20:59:41.791909 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.791875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:41.858680 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:41.858653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk8g9_05fac989-aecb-447d-96b6-34a10fa109ae/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:43.419525 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.419500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/alertmanager/0.log" Jul 06 20:59:43.464858 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.464837 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/config-reloader/0.log" Jul 06 20:59:43.509205 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.509182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/kube-rbac-proxy-web/0.log" Jul 06 20:59:43.562171 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.562148 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/kube-rbac-proxy/0.log" Jul 06 20:59:43.608658 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.608639 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/kube-rbac-proxy-metric/0.log" Jul 06 20:59:43.661239 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.661220 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/prom-label-proxy/0.log" Jul 06 20:59:43.741959 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.741893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7208c8f8-efe0-4d89-b2c8-55ec2ef26c68/init-config-reloader/0.log" Jul 06 20:59:43.885994 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.885971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ldmh9_7d1211cd-2681-4cf7-9568-7c51d8b37a44/kube-state-metrics/0.log" Jul 06 20:59:43.926930 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.926904 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ldmh9_7d1211cd-2681-4cf7-9568-7c51d8b37a44/kube-rbac-proxy-main/0.log" Jul 06 20:59:43.994805 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:43.994750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ldmh9_7d1211cd-2681-4cf7-9568-7c51d8b37a44/kube-rbac-proxy-self/0.log" Jul 06 20:59:44.831101 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:44.831073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xlmkr_7f52ca16-f468-4e0b-83f2-ea311e5bc904/node-exporter/0.log" Jul 06 20:59:44.888239 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:44.888218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xlmkr_7f52ca16-f468-4e0b-83f2-ea311e5bc904/kube-rbac-proxy/0.log" Jul 06 20:59:44.940352 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:44.940328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xlmkr_7f52ca16-f468-4e0b-83f2-ea311e5bc904/init-textfile/0.log" Jul 06 20:59:45.007629 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.007587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4mt44_9bc4d8ed-a8de-4f22-a307-65a0e5570091/kube-rbac-proxy-main/0.log" Jul 06 20:59:45.071860 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.071842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4mt44_9bc4d8ed-a8de-4f22-a307-65a0e5570091/kube-rbac-proxy-self/0.log" Jul 06 20:59:45.128715 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.128665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4mt44_9bc4d8ed-a8de-4f22-a307-65a0e5570091/openshift-state-metrics/0.log" Jul 06 20:59:45.549817 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.549797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c58s9_6d52f372-7f79-42d0-b080-c84011bce854/prometheus-operator/0.log" Jul 06 20:59:45.603993 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.603970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c58s9_6d52f372-7f79-42d0-b080-c84011bce854/kube-rbac-proxy/0.log" Jul 06 20:59:45.832096 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.832033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584579dcfd-z79k6_5dae97ad-46c8-4860-bd02-35a95ba79f4e/thanos-query/0.log" Jul 06 20:59:45.864792 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.864771 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584579dcfd-z79k6_5dae97ad-46c8-4860-bd02-35a95ba79f4e/kube-rbac-proxy-web/0.log" Jul 06 20:59:45.899809 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.899789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584579dcfd-z79k6_5dae97ad-46c8-4860-bd02-35a95ba79f4e/kube-rbac-proxy/0.log" Jul 06 20:59:45.949705 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:45.949686 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584579dcfd-z79k6_5dae97ad-46c8-4860-bd02-35a95ba79f4e/prom-label-proxy/0.log" Jul 06 20:59:46.008253 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.008234 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584579dcfd-z79k6_5dae97ad-46c8-4860-bd02-35a95ba79f4e/kube-rbac-proxy-rules/0.log" Jul 06 20:59:46.072385 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.072368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584579dcfd-z79k6_5dae97ad-46c8-4860-bd02-35a95ba79f4e/kube-rbac-proxy-metrics/0.log" Jul 06 20:59:46.763459 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763429 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s"] Jul 06 20:59:46.763854 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763837 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="gather" Jul 06 20:59:46.763948 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763855 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="gather" Jul 06 20:59:46.763948 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763880 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="copy" Jul 06 20:59:46.763948 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763888 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="copy" Jul 06 20:59:46.764103 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763965 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="copy" Jul 06 20:59:46.764103 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.763982 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd175ea-6c87-4500-ab24-ca6dc1dfd05f" containerName="gather" Jul 06 20:59:46.767867 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.767848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.770557 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.770541 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pgp8d\"/\"default-dockercfg-ckw7h\"" Jul 06 20:59:46.771558 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.771545 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pgp8d\"/\"kube-root-ca.crt\"" Jul 06 20:59:46.772073 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.772060 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pgp8d\"/\"openshift-service-ca.crt\"" Jul 06 20:59:46.802889 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.802864 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s"] Jul 06 20:59:46.853033 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.853011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-lib-modules\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.853313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.853049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-proc\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.853313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.853085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-sys\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.853313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.853123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-podres\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.853313 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.853155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kp4g\" (UniqueName: \"kubernetes.io/projected/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-kube-api-access-7kp4g\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.953954 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.953932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-proc\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954049 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.953967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-sys\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954049 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.953988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-podres\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954049 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.954027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kp4g\" (UniqueName: \"kubernetes.io/projected/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-kube-api-access-7kp4g\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.954055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-proc\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.954064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-sys\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.954067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-lib-modules\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.954134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-podres\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.954153 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.954144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-lib-modules\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:46.963563 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:46.963546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kp4g\" (UniqueName: \"kubernetes.io/projected/3b7aaf45-f761-42bc-83cc-61ed8bba4ef4-kube-api-access-7kp4g\") pod \"perf-node-gather-daemonset-4248s\" (UID: \"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4\") " pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:47.077312 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:47.077258 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:47.234947 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:47.234920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s"] Jul 06 20:59:47.236631 ip-10-0-138-164 kubenswrapper[2576]: W0706 20:59:47.236595 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b7aaf45_f761_42bc_83cc_61ed8bba4ef4.slice/crio-9796e1b1543c2a80aee8b09fc2b0090c502bce0a56b6eb7caf0e12efcfc2ec01 WatchSource:0}: Error finding container 9796e1b1543c2a80aee8b09fc2b0090c502bce0a56b6eb7caf0e12efcfc2ec01: Status 404 returned error can't find the container with id 9796e1b1543c2a80aee8b09fc2b0090c502bce0a56b6eb7caf0e12efcfc2ec01 Jul 06 20:59:47.370068 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:47.370016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" event={"ID":"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4","Type":"ContainerStarted","Data":"869a325ccb3ecfc5913642d42d053524907c5337b1066af2c95578bc9f3cd425"} Jul 06 20:59:47.370068 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:47.370062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" event={"ID":"3b7aaf45-f761-42bc-83cc-61ed8bba4ef4","Type":"ContainerStarted","Data":"9796e1b1543c2a80aee8b09fc2b0090c502bce0a56b6eb7caf0e12efcfc2ec01"} Jul 06 20:59:47.370209 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:47.370124 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:47.413533 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:47.413495 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" podStartSLOduration=1.413483456 podStartE2EDuration="1.413483456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:47.413115749 +0000 UTC m=+650.315532964" watchObservedRunningTime="2026-07-06 20:59:47.413483456 +0000 UTC m=+650.315900669" Jul 06 20:59:49.377929 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:49.377902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-t29v8_c16c93f1-c5f3-45fd-a51f-8b9e7090b5b1/volume-data-source-validator/0.log" Jul 06 20:59:50.494832 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:50.494792 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gh27w_6ae3bdd5-5da5-4f44-8da2-b10d637b8c44/dns/0.log" Jul 06 20:59:50.522608 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:50.522585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gh27w_6ae3bdd5-5da5-4f44-8da2-b10d637b8c44/kube-rbac-proxy/0.log" Jul 06 20:59:50.584986 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:50.584966 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktp2g_67b00bfb-db02-4134-b663-7aad9217abe2/dns-node-resolver/0.log" Jul 06 20:59:51.087473 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:51.087428 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5df5867f6d-8kw7d_419252cd-ba30-42f8-916c-ef299dea1500/registry/0.log" Jul 06 20:59:51.176331 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:51.176303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x2gsk_637895eb-a57a-4aff-8148-6226bbf552c8/node-ca/0.log" Jul 06 20:59:52.395007 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:52.394980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9jqrw_3cde5ee0-abcd-42de-8f5f-0332734aa7af/serve-healthcheck-canary/0.log" Jul 06 20:59:53.385082 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:53.385056 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pgp8d/perf-node-gather-daemonset-4248s" Jul 06 20:59:53.411464 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:53.411444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvpd5_d42b0367-c24f-4dc7-807d-d9cd1bc028c9/kube-rbac-proxy/0.log" Jul 06 20:59:53.456710 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:53.456685 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvpd5_d42b0367-c24f-4dc7-807d-d9cd1bc028c9/exporter/0.log" Jul 06 20:59:53.482930 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:53.482899 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvpd5_d42b0367-c24f-4dc7-807d-d9cd1bc028c9/extractor/0.log" Jul 06 20:59:55.953338 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:55.953315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-n249q_28a6680f-9b52-4883-8ed2-43410d0b4cbd/server/0.log" Jul 06 20:59:55.997253 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:55.997228 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-2pfdl_7f389143-c02e-47aa-bba9-d2cb1e2cbfc7/manager/0.log" Jul 06 20:59:56.035257 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:56.035232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-vpcfx_f6495d4e-1a89-49e0-b090-5aba96efd976/s3-init/0.log" Jul 06 20:59:56.058576 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:56.058554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-vpcfx_f6495d4e-1a89-49e0-b090-5aba96efd976/download-hf-model/0.log" Jul 06 20:59:56.113504 ip-10-0-138-164 kubenswrapper[2576]: I0706 20:59:56.113484 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-z9hcq_aa2eaca0-d190-4196-afc1-db14d0efa5aa/seaweedfs/0.log" Jul 06 21:00:00.786043 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:00.786019 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5rzk6_bd5bc2d3-cd57-4048-8974-e0339d6eb73f/migrator/0.log" Jul 06 21:00:00.855968 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:00.855939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5rzk6_bd5bc2d3-cd57-4048-8974-e0339d6eb73f/graceful-termination/0.log" Jul 06 21:00:01.265578 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:01.265551 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tlc5z_ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b/kube-storage-version-migrator-operator/1.log" Jul 06 21:00:01.266463 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:01.266449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tlc5z_ae5aa2bb-46cb-4de9-b6a4-d5b0e3042c9b/kube-storage-version-migrator-operator/0.log" Jul 06 21:00:02.314317 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.314290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/kube-multus-additional-cni-plugins/0.log" Jul 06 21:00:02.352424 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.352399 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/egress-router-binary-copy/0.log" Jul 06 21:00:02.386602 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.386583 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/cni-plugins/0.log" Jul 06 21:00:02.416926 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.416909 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/bond-cni-plugin/0.log" Jul 06 21:00:02.449130 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.449109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/routeoverride-cni/0.log" Jul 06 21:00:02.481356 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.481335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/whereabouts-cni-bincopy/0.log" Jul 06 21:00:02.510309 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:02.510284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshnd_1c6b0565-8357-41d5-96d6-45fdab333c88/whereabouts-cni/0.log" Jul 06 21:00:03.300455 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:03.300423 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpl6w_82b59cfb-2fd1-4d35-84e7-2f48c1a1f6e2/kube-multus/0.log" Jul 06 21:00:03.481360 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:03.481334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxwd5_d88b54e9-ad7a-4289-8981-312cb84aac57/network-metrics-daemon/0.log" Jul 06 21:00:03.508912 ip-10-0-138-164 kubenswrapper[2576]: I0706 21:00:03.508892 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxwd5_d88b54e9-ad7a-4289-8981-312cb84aac57/kube-rbac-proxy/0.log"