Jul 10 18:40:25.603730 ip-10-0-129-211 systemd[1]: Starting Kubernetes Kubelet... Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.924875 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930016 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930028 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930032 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930035 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930038 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930041 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930044 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:26.003574 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930047 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:25.988781 ip-10-0-129-211 systemd[1]: Started Kubernetes Kubelet. Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930050 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930053 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930058 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930063 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930066 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930069 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930077 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930094 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930097 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930100 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930103 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930106 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930109 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930111 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930114 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930117 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930120 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930130 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:26.004900 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930133 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930136 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930139 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930142 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930145 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930147 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930150 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930153 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930155 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930158 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930160 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930163 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930165 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930168 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930171 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930173 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930176 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930178 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930181 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930184 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:26.005961 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930187 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930189 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930192 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930194 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930197 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930199 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930202 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930205 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930207 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930210 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930214 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930217 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930219 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930222 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930225 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930227 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930229 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930232 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930234 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930237 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:26.007006 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930240 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930242 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930247 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930249 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930252 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930254 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930257 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930259 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930262 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930265 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930268 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930271 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930273 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930276 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930279 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930281 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930284 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930286 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930289 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:26.009366 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930292 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930296 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930299 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930303 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930305 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930308 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930311 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930313 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930316 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930318 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930320 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930323 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930325 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.930328 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931018 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931024 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931027 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931030 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931033 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931035 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:26.010637 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931039 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931042 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931044 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931047 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931050 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931053 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931055 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931058 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931068 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931070 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931073 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931076 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931079 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931097 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931100 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931103 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931106 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931109 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931112 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:26.011924 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931114 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931117 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931120 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931122 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931125 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931127 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931130 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931132 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931135 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931137 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931140 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931142 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931145 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931148 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931150 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931154 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931156 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931159 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931162 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931165 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:26.012983 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931167 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931170 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931174 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931176 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931179 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931182 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931184 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931187 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931190 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931193 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931197 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931201 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931204 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931207 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931210 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931213 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931215 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931218 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931220 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:26.020835 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931224 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931228 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931231 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931234 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931236 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931239 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931243 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931246 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931249 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931253 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931256 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931259 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931262 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931264 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931267 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931270 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931272 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931275 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931278 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931280 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:26.021842 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931283 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931286 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931289 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931291 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931294 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931296 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931299 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931301 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931304 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931306 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931308 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931311 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931313 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931316 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931318 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931673 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931678 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931681 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931684 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931687 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:26.023462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931690 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931693 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931696 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931703 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931706 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931709 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931712 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931714 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931717 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931720 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931723 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931725 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931728 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931730 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931733 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931735 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931739 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931743 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:26.024435 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931746 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931748 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931751 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931754 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931756 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931759 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931762 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931764 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931767 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931769 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931772 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931775 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931778 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931781 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931784 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931787 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931789 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931794 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931798 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931801 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:26.025879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931804 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931806 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931808 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931811 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931814 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931816 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931819 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931821 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931824 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931827 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931829 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931831 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931834 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931836 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931839 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931841 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931843 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931847 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931850 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931853 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:26.026766 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931856 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931859 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931862 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931865 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931868 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931870 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931872 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931875 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931878 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931882 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931885 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931888 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931891 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931893 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931896 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931898 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931901 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931904 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931906 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931909 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:26.028690 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931911 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931914 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931916 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931919 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931921 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931924 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931926 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931928 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931931 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931933 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931936 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931938 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931941 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931943 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931946 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.931948 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932024 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932038 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932048 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932054 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932060 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 18:40:26.029584 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932067 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932075 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932079 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932096 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932099 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932102 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932106 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932108 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932112 2575 flags.go:64] FLAG: --cgroup-root="" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932115 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932118 2575 flags.go:64] FLAG: --client-ca-file="" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932121 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932123 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932128 2575 flags.go:64] FLAG: --cluster-domain="" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932130 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932133 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932136 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932140 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932146 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932149 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932152 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932155 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932159 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932161 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 18:40:26.031708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932164 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932167 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932170 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932174 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932177 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932180 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932183 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932186 2575 flags.go:64] FLAG: --enable-server="true" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932190 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932196 2575 flags.go:64] FLAG: --event-burst="100" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932199 2575 flags.go:64] FLAG: --event-qps="50" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932202 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932204 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932207 2575 flags.go:64] FLAG: --eviction-hard="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932211 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932214 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932217 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932220 2575 flags.go:64] FLAG: --eviction-soft="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932223 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932226 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932229 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932232 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932235 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932238 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932241 2575 flags.go:64] FLAG: --feature-gates="" Jul 10 18:40:26.032811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932244 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932247 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932250 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932253 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932256 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932259 2575 flags.go:64] FLAG: --help="false" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932262 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932265 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932268 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932271 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932274 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932277 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932280 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932283 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932286 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932290 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932295 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932298 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932301 2575 flags.go:64] FLAG: --kube-reserved="" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932304 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932306 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932309 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932312 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932315 2575 flags.go:64] FLAG: --lock-file="" Jul 10 18:40:26.035396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932318 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932322 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932325 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932331 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932334 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932336 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932339 2575 flags.go:64] FLAG: --logging-format="text" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932342 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932345 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932347 2575 flags.go:64] FLAG: --manifest-url="" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932350 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932354 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932357 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932361 2575 flags.go:64] FLAG: --max-pods="110" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932364 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932367 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932370 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932373 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932375 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932378 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932381 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932389 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932391 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932397 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 18:40:26.036486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932401 2575 flags.go:64] FLAG: --pod-cidr="" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932404 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932409 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932412 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932415 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932418 2575 flags.go:64] FLAG: --port="10250" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932421 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932424 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d2b79487281df173" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932427 2575 flags.go:64] FLAG: --qos-reserved="" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932430 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932433 2575 flags.go:64] FLAG: --register-node="true" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932436 2575 flags.go:64] FLAG: --register-with-taints="" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932439 2575 flags.go:64] FLAG: --registry-burst="10" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932442 2575 flags.go:64] FLAG: --registry-qps="5" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932445 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932448 2575 flags.go:64] FLAG: --reserved-memory="" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932451 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932454 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932457 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932460 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932463 2575 flags.go:64] FLAG: --runonce="false" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932465 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932468 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932471 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932474 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 18:40:26.039686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932477 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932480 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932483 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932486 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932489 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932492 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932495 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932502 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932505 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932508 2575 flags.go:64] FLAG: --system-cgroups="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932511 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932516 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932519 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932521 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932525 2575 flags.go:64] FLAG: --tls-min-version="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932528 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932531 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932533 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932537 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932540 2575 flags.go:64] FLAG: --v="2" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932544 2575 flags.go:64] FLAG: --version="false" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932548 2575 flags.go:64] FLAG: --vmodule="" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932551 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932554 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 18:40:26.040763 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932670 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932675 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932678 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932681 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932684 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932686 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932689 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932692 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932694 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932697 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932699 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932702 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932704 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932707 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932709 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932715 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932718 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932720 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932723 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:26.220043 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932726 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932728 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932731 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932734 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932737 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932739 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932742 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932744 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932747 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932751 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932753 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932756 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932758 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932761 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932763 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932766 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932768 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932771 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932773 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932776 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:26.241371 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932778 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932781 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932784 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932788 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932790 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932793 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932796 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932799 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932804 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932807 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932810 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932813 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932816 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932818 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932821 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932824 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932828 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932831 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932833 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:26.242163 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932836 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932840 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932843 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932846 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932849 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932851 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932854 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932857 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932860 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932864 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932867 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932869 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932872 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932875 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932877 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932880 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932882 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932885 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932887 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932890 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:26.242755 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932892 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932898 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932900 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932903 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932905 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932908 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932910 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932913 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932916 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932918 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932920 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932923 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932926 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932928 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932931 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932934 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932937 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932939 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932942 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:26.243445 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932944 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.932948 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.932957 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.939707 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.939722 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.939741 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.939747 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939798 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939803 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939807 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939810 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939813 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939817 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939820 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939823 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:26.243964 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939826 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939828 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939831 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939834 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939837 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939840 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939843 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939845 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939849 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939853 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939857 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939860 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939862 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939865 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939870 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939872 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939875 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939877 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939881 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:26.244630 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939883 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939886 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939889 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939892 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939895 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939897 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939900 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939902 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939905 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939907 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939910 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939913 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939916 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939918 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939921 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939923 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939926 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939929 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939931 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939933 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:26.245187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939936 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939939 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939941 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939944 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939946 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939949 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939952 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939956 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939959 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939961 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939964 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939967 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939969 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939972 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939974 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939977 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939980 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939982 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939985 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:26.245925 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939987 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939990 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939992 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939995 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.939997 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940000 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940002 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940004 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940007 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940009 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940012 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940014 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940017 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940021 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940025 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940027 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940030 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940033 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940035 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:26.246713 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940040 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940044 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940047 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940049 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940052 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940055 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940059 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940062 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940065 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940068 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940071 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940074 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940077 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940094 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.940099 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:40:26.248658 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940202 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940206 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940209 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940212 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940215 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940217 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940221 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940224 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940227 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940229 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940232 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940235 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940237 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940240 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940242 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940245 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940247 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940250 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940255 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:26.249474 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940257 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940260 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940263 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940265 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940269 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940273 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940276 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940279 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940281 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940285 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940288 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940291 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940293 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940296 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940298 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940301 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940303 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940306 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940309 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:26.251415 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940311 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940314 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940316 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940319 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940322 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940324 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940326 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940329 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940332 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940334 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940337 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940339 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940345 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940347 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940350 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940352 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940355 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940357 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940360 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940362 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:26.252220 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940365 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940367 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940370 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940373 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940376 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940378 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940381 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940383 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940386 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940388 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940391 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940393 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940395 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940398 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940400 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940403 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940405 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940408 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940410 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940413 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:26.461878 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940415 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940418 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940421 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940423 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940427 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940430 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940434 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940437 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940440 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940443 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940446 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940449 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940452 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940455 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940457 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940460 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940463 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940466 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940469 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:26.463039 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940471 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:25.940473 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.940478 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.940570 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.942544 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.943667 2575 server.go:1019] "Starting client certificate rotation" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.943767 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.943797 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.945771 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.946835 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.955595 2575 log.go:25] "Validated CRI v1 runtime API" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.959194 2575 log.go:25] "Validated CRI v1 image API" Jul 10 18:40:26.466507 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.961312 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 18:40:26.467115 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.963402 2575 fs.go:135] Filesystem UUIDs: map[228f59ab-0048-42da-b1c6-fdac4a13926f:/dev/nvme0n1p4 250bc38d-c217-48ab-970c-9e6aecd7d449:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 10 18:40:26.467115 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.963420 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.969158 2575 manager.go:216] Machine: {Timestamp:2026-07-10 18:40:25.96793087 +0000 UTC m=+0.267451083 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098983 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f99d02a31751c9c66a72d83a86da8 SystemUUID:ec2f99d0-2a31-751c-9c66-a72d83a86da8 BootID:a927d65b-3d13-4b5a-9180-9cd3306b8e5a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:e8:c0:ae:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:e8:c0:ae:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:4f:2d:5d:2d:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.969263 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.969353 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.971790 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.971820 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.972506 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.972518 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.972528 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.973712 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.974916 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978146 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978593 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978704 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978730 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978740 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978758 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 18:40:26.469401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978767 2575 kubelet.go:398] "Adding apiserver pod source" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.978777 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.979158 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.979173 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.981571 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983284 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983311 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983448 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983460 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983465 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983486 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983499 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983507 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983858 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983865 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983872 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983878 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983891 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.983899 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.984464 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.984472 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.988018 2575 server.go:1268] "Started kubelet" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.988103 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.988167 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.988245 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.989286 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.990230 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.994315 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.994383 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.994499 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.994846 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.994855 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995259 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.995488 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995581 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995589 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995893 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995967 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995979 2575 factory.go:55] Registering systemd factory Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.995989 2575 factory.go:223] Registration of the systemd container factory successfully Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.996016 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.996234 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.996428 2575 factory.go:153] Registering CRI-O factory Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.996444 2575 factory.go:223] Registration of the crio container factory successfully Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.996465 2575 factory.go:103] Registering Raw factory Jul 10 18:40:26.470198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.996479 2575 manager.go:1196] Started watching for new ooms in manager Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.996272 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-211.ec2.internal.18c101ba0bbe402b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-211.ec2.internal,UID:ip-10-0-129-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-211.ec2.internal,},FirstTimestamp:2026-07-10 18:40:25.987989547 +0000 UTC m=+0.287509762,LastTimestamp:2026-07-10 18:40:25.987989547 +0000 UTC m=+0.287509762,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-211.ec2.internal,}" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:25.997364 2575 manager.go:349] Starting recovery of all containers Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.999254 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:25.999378 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.001735 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wxs4" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.010308 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wxs4" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.053607 2575 manager.go:354] Recovery completed Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.058531 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.061910 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.061935 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.061946 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.062443 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.062451 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.062459 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.062465 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.063236 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.063275 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.063287 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.063886 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-211.ec2.internal.18c101ba10265b43 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-211.ec2.internal,UID:ip-10-0-129-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-211.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-211.ec2.internal,},FirstTimestamp:2026-07-10 18:40:26.061921091 +0000 UTC m=+0.361441304,LastTimestamp:2026-07-10 18:40:26.061921091 +0000 UTC m=+0.361441304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-211.ec2.internal,}" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.064192 2575 policy_none.go:49] "None policy: Start" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.064204 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.064214 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.065998 2575 policy_none.go:47] "Start" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.094893 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102584 2575 manager.go:337] "Starting Device Plugin manager" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.102614 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102622 2575 server.go:87] "Starting device plugin registration server" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102818 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102829 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102910 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102975 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.102980 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 18:40:26.471993 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.103415 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.103460 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.182184 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.183200 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.183229 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.183250 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.183281 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.185783 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.203313 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.204098 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.204128 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.204141 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.204162 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.205128 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-211.ec2.internal\" not found" node="ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.209305 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.209322 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-211.ec2.internal\": node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.225717 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.283480 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal"] Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.283770 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.284677 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.284698 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.284792 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.286951 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.286954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287042 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287590 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287616 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287623 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287628 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287639 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.287653 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.289722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.289745 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.290325 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.290352 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.290365 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.297001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5cd24277ff6091c18d8b9f1eee6e8097-config\") pod \"kube-apiserver-proxy-ip-10-0-129-211.ec2.internal\" (UID: \"5cd24277ff6091c18d8b9f1eee6e8097\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.474359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.297026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1875b2cf2107fb103e1ce838a786f48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"e1875b2cf2107fb103e1ce838a786f48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.297043 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1875b2cf2107fb103e1ce838a786f48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"e1875b2cf2107fb103e1ce838a786f48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.308603 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-211.ec2.internal\" not found" node="ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.311567 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-211.ec2.internal\" not found" node="ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.325844 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.397611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1875b2cf2107fb103e1ce838a786f48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"e1875b2cf2107fb103e1ce838a786f48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.397640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1875b2cf2107fb103e1ce838a786f48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"e1875b2cf2107fb103e1ce838a786f48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.397655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5cd24277ff6091c18d8b9f1eee6e8097-config\") pod \"kube-apiserver-proxy-ip-10-0-129-211.ec2.internal\" (UID: \"5cd24277ff6091c18d8b9f1eee6e8097\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.397691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5cd24277ff6091c18d8b9f1eee6e8097-config\") pod \"kube-apiserver-proxy-ip-10-0-129-211.ec2.internal\" (UID: \"5cd24277ff6091c18d8b9f1eee6e8097\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.397716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1875b2cf2107fb103e1ce838a786f48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"e1875b2cf2107fb103e1ce838a786f48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.397721 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1875b2cf2107fb103e1ce838a786f48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"e1875b2cf2107fb103e1ce838a786f48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.475983 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.426682 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.671736 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.527295 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.671736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.610665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.671736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.613982 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jul 10 18:40:26.671736 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.627846 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.887946 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.728219 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.887946 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.828627 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.929122 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:26.929096 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:26.943252 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.943234 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 18:40:26.943409 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.943392 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 18:40:26.953260 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:26.953242 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:27.029367 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.029337 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:27.052454 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.052422 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:35:25 +0000 UTC" deadline="2028-03-17 05:03:18.327092208 +0000 UTC" Jul 10 18:40:27.052454 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.052450 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14770h22m51.274644991s" Jul 10 18:40:27.129955 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.129934 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:27.213020 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.212959 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:27.230974 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.230952 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:27.240047 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:27.240021 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd24277ff6091c18d8b9f1eee6e8097.slice/crio-a54ce74f4112f29b23481a564c4d1762a4eb119df4fdd57dfc5f411489fb7a94 WatchSource:0}: Error finding container a54ce74f4112f29b23481a564c4d1762a4eb119df4fdd57dfc5f411489fb7a94: Status 404 returned error can't find the container with id a54ce74f4112f29b23481a564c4d1762a4eb119df4fdd57dfc5f411489fb7a94 Jul 10 18:40:27.240556 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:27.240539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1875b2cf2107fb103e1ce838a786f48.slice/crio-b24956bb71ec8093664bc0282c913d121be86bb29f78829b340c0a319991ba55 WatchSource:0}: Error finding container b24956bb71ec8093664bc0282c913d121be86bb29f78829b340c0a319991ba55: Status 404 returned error can't find the container with id b24956bb71ec8093664bc0282c913d121be86bb29f78829b340c0a319991ba55 Jul 10 18:40:27.244911 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.244899 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:40:27.331181 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.331144 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:27.431512 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.431482 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:27.532093 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.532014 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jul 10 18:40:27.544333 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.544316 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:27.595154 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.595130 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jul 10 18:40:27.607157 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.607133 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:40:27.607943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.607929 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jul 10 18:40:27.615629 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.615608 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:40:27.979720 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.979651 2575 apiserver.go:52] "Watching apiserver" Jul 10 18:40:27.987502 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.987480 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 18:40:27.989277 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.989249 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z","openshift-dns/node-resolver-g4mpc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal","openshift-multus/multus-additional-cni-plugins-mxvz9","openshift-multus/network-metrics-daemon-sh7h8","openshift-network-operator/iptables-alerter-gtwv5","openshift-ovn-kubernetes/ovnkube-node-p2pms","kube-system/global-pull-secret-syncer-x6g4x","kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7sjt7","openshift-image-registry/node-ca-xvjm9","openshift-multus/multus-hd5s6","openshift-network-diagnostics/network-check-target-cwwx2","kube-system/konnectivity-agent-6b4sb"] Jul 10 18:40:27.991567 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.991542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:27.993603 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.993582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:27.993706 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:27.993649 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:27.994056 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.994039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 18:40:27.994056 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.994046 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 18:40:27.994223 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.994039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 18:40:27.994223 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.994113 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 18:40:27.994352 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.994341 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 18:40:27.996108 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.995299 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 18:40:27.996108 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.995383 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4c4jp\"" Jul 10 18:40:27.996108 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.995565 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 18:40:27.996108 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.995615 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:27.999468 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.999451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:27.999916 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.999896 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 18:40:28.000017 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.999922 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9vdrs\"" Jul 10 18:40:28.000017 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:27.999928 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 18:40:28.000495 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.000288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.000495 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.000431 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:28.002226 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.002206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4jf28\"" Jul 10 18:40:28.002338 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.002269 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 18:40:28.002338 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.002306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 18:40:28.002575 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.002539 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 18:40:28.002758 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.002743 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 18:40:28.002946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.002932 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 18:40:28.003871 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.003855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.004680 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-ovn\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004773 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-cni-bin\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004773 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d9a6410-eabb-4a5d-9d98-8dc774709785-agent-certs\") pod \"konnectivity-agent-6b4sb\" (UID: \"7d9a6410-eabb-4a5d-9d98-8dc774709785\") " pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.004773 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-systemd-units\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004773 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-cni-netd\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-ovnkube-script-lib\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-kubelet\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-run-netns\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-var-lib-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.004960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-env-overrides\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.004964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vthln\" (UniqueName: \"kubernetes.io/projected/95c2ffa6-dda7-485a-969a-375a2ae85241-kube-api-access-vthln\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-slash\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-node-log\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-log-socket\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-ovnkube-config\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95c2ffa6-dda7-485a-969a-375a2ae85241-ovn-node-metrics-cert\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d9a6410-eabb-4a5d-9d98-8dc774709785-konnectivity-ca\") pod \"konnectivity-agent-6b4sb\" (UID: \"7d9a6410-eabb-4a5d-9d98-8dc774709785\") " pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-systemd\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-etc-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.005862 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.005843 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:40:28.006033 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.006016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.006142 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.006099 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:28.006208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.006157 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 18:40:28.006417 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.006364 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:40:28.006417 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.006371 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 18:40:28.006417 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.006407 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wlccj\"" Jul 10 18:40:28.008338 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.008321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.011003 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.010539 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.011003 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.010855 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 18:40:28.011003 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.010854 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 18:40:28.011003 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.010902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sjcsf\"" Jul 10 18:40:28.011003 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.010924 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 18:40:28.012803 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.012786 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.013244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.013225 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4pcpt\"" Jul 10 18:40:28.013244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.013225 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 18:40:28.013391 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.013297 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 18:40:28.015069 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.015053 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b8889\"" Jul 10 18:40:28.015188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.015119 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 18:40:28.015309 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.015293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.015572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.015448 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:40:28.017588 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.017476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.017854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.017706 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 18:40:28.017854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.017707 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 18:40:28.017854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.017774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r6t5t\"" Jul 10 18:40:28.018035 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.017969 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 18:40:28.020696 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.020463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tq8lp\"" Jul 10 18:40:28.020696 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.020470 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 18:40:28.023094 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.023061 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:28.028004 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.027966 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-znm4n" Jul 10 18:40:28.036624 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.036604 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-znm4n" Jul 10 18:40:28.096075 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.096049 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 18:40:28.105509 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-etc-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.105657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-cnibin\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.105657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105534 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-kubernetes\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.105657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f371b76-9c91-4668-af94-96ae07d3d130-dbus\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.105657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-cnibin\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.105657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-etc-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.105657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-cni-bin\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.105943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-ovnkube-script-lib\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.105943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-var-lib-kubelet\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.105943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f371b76-9c91-4668-af94-96ae07d3d130-kubelet-config\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.105943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eef46a16-6cf7-43b1-b015-06a7a7c688fa-hosts-file\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.105943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-conf-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.105943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-etc-kubernetes\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.105955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysconfig\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-var-lib-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106125 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-var-lib-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrt8l\" (UniqueName: \"kubernetes.io/projected/68cae9d4-2bde-43a8-adf9-6bcfa511585d-kube-api-access-rrt8l\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.106224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-sys-fs\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-cni-multus\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-log-socket\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-ovnkube-config\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95c2ffa6-dda7-485a-969a-375a2ae85241-ovn-node-metrics-cert\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-log-socket\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-ovnkube-script-lib\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-cni-binary-copy\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-device-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-modprobe-d\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-host\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-cni-bin\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5aaf044d-3291-4235-b262-fcfd91af532b-host\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.106524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl4rf\" (UniqueName: \"kubernetes.io/projected/eef46a16-6cf7-43b1-b015-06a7a7c688fa-kube-api-access-zl4rf\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-daemon-config\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-multus-certs\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-systemd-units\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cae9d4-2bde-43a8-adf9-6bcfa511585d-host-slash\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysctl-conf\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106657 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-sys\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106658 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d872580-31d5-484e-8858-71b1f497fee5-etc-tuned\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-ovnkube-config\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106701 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-systemd-units\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5aaf044d-3291-4235-b262-fcfd91af532b-serviceca\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-cni-bin\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26br\" (UniqueName: \"kubernetes.io/projected/5aaf044d-3291-4235-b262-fcfd91af532b-kube-api-access-k26br\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef46a16-6cf7-43b1-b015-06a7a7c688fa-tmp-dir\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dts\" (UniqueName: \"kubernetes.io/projected/77b27729-1834-4b4f-9fd0-a7691aed9f7f-kube-api-access-59dts\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-systemd\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.106946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jw2k\" (UniqueName: \"kubernetes.io/projected/3d872580-31d5-484e-8858-71b1f497fee5-kube-api-access-8jw2k\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-node-log\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d9a6410-eabb-4a5d-9d98-8dc774709785-konnectivity-ca\") pod \"konnectivity-agent-6b4sb\" (UID: \"7d9a6410-eabb-4a5d-9d98-8dc774709785\") " pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-run\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-node-log\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-socket-dir-parent\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-ovn\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.106983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-ovn\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysctl-d\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-lib-modules\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-cni-netd\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-cni-netd\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-registration-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.107613 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rbm8\" (UniqueName: \"kubernetes.io/projected/93213c21-5f94-4369-b219-53584b6ca21a-kube-api-access-4rbm8\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-k8s-cni-cncf-io\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-kubelet\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-env-overrides\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-os-release\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbksn\" (UniqueName: \"kubernetes.io/projected/1c3f90b4-212a-4972-9e18-949717cf8a26-kube-api-access-sbksn\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107321 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-kubelet\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d872580-31d5-484e-8858-71b1f497fee5-tmp\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d9a6410-eabb-4a5d-9d98-8dc774709785-konnectivity-ca\") pod \"konnectivity-agent-6b4sb\" (UID: \"7d9a6410-eabb-4a5d-9d98-8dc774709785\") " pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-kubelet\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdtz\" (UniqueName: \"kubernetes.io/projected/5f2ea91f-2379-4915-ad7e-6b605dd96817-kube-api-access-2hdtz\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-systemd\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d9a6410-eabb-4a5d-9d98-8dc774709785-agent-certs\") pod \"konnectivity-agent-6b4sb\" (UID: \"7d9a6410-eabb-4a5d-9d98-8dc774709785\") " pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-system-cni-dir\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107519 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-systemd\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-run-openvswitch\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.108416 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68cae9d4-2bde-43a8-adf9-6bcfa511585d-iptables-alerter-script\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-cni-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f2ea91f-2379-4915-ad7e-6b605dd96817-cni-binary-copy\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-run-netns\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vthln\" (UniqueName: \"kubernetes.io/projected/95c2ffa6-dda7-485a-969a-375a2ae85241-kube-api-access-vthln\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107686 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-run-netns\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95c2ffa6-dda7-485a-969a-375a2ae85241-env-overrides\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-system-cni-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-os-release\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-netns\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-slash\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.107985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.108002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-socket-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.109273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.108002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c2ffa6-dda7-485a-969a-375a2ae85241-host-slash\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.110023 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.108015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-hostroot\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.110482 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.110465 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95c2ffa6-dda7-485a-969a-375a2ae85241-ovn-node-metrics-cert\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.110647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.110620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d9a6410-eabb-4a5d-9d98-8dc774709785-agent-certs\") pod \"konnectivity-agent-6b4sb\" (UID: \"7d9a6410-eabb-4a5d-9d98-8dc774709785\") " pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.112621 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.112600 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:28.112621 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.112625 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:28.112736 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.112637 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:28.112736 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.112693 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:28.612675215 +0000 UTC m=+2.912195441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:28.115989 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.115967 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vthln\" (UniqueName: \"kubernetes.io/projected/95c2ffa6-dda7-485a-969a-375a2ae85241-kube-api-access-vthln\") pod \"ovnkube-node-p2pms\" (UID: \"95c2ffa6-dda7-485a-969a-375a2ae85241\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.188215 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.188132 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" event={"ID":"e1875b2cf2107fb103e1ce838a786f48","Type":"ContainerStarted","Data":"b24956bb71ec8093664bc0282c913d121be86bb29f78829b340c0a319991ba55"} Jul 10 18:40:28.189369 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.189331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" event={"ID":"5cd24277ff6091c18d8b9f1eee6e8097","Type":"ContainerStarted","Data":"a54ce74f4112f29b23481a564c4d1762a4eb119df4fdd57dfc5f411489fb7a94"} Jul 10 18:40:28.208917 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.208854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.208917 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.208928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysctl-d\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.208951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-lib-modules\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.208990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-registration-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rbm8\" (UniqueName: \"kubernetes.io/projected/93213c21-5f94-4369-b219-53584b6ca21a-kube-api-access-4rbm8\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-k8s-cni-cncf-io\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-os-release\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbksn\" (UniqueName: \"kubernetes.io/projected/1c3f90b4-212a-4972-9e18-949717cf8a26-kube-api-access-sbksn\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d872580-31d5-484e-8858-71b1f497fee5-tmp\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysctl-d\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.209188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209168 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209226 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-kubelet\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-os-release\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-k8s-cni-cncf-io\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.209289 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209351 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-registration-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-lib-modules\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.209435 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:40:28.709415015 +0000 UTC m=+3.008935228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-kubelet\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.209652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdtz\" (UniqueName: \"kubernetes.io/projected/5f2ea91f-2379-4915-ad7e-6b605dd96817-kube-api-access-2hdtz\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209670 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-system-cni-dir\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68cae9d4-2bde-43a8-adf9-6bcfa511585d-iptables-alerter-script\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-cni-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-system-cni-dir\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f2ea91f-2379-4915-ad7e-6b605dd96817-cni-binary-copy\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.209857 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.209917 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:28.709897182 +0000 UTC m=+3.009417395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209926 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-cni-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.209996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-system-cni-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-os-release\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-netns\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210108 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-system-cni-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-socket-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210157 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-hostroot\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-cnibin\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210235 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-netns\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210243 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c3f90b4-212a-4972-9e18-949717cf8a26-cnibin\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-kubernetes\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-hostroot\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f371b76-9c91-4668-af94-96ae07d3d130-dbus\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210171 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-cnibin\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210338 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-cni-bin\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f2ea91f-2379-4915-ad7e-6b605dd96817-cni-binary-copy\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-var-lib-kubelet\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-socket-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.210835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f371b76-9c91-4668-af94-96ae07d3d130-kubelet-config\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68cae9d4-2bde-43a8-adf9-6bcfa511585d-iptables-alerter-script\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-kubernetes\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eef46a16-6cf7-43b1-b015-06a7a7c688fa-hosts-file\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-os-release\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f371b76-9c91-4668-af94-96ae07d3d130-kubelet-config\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210471 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eef46a16-6cf7-43b1-b015-06a7a7c688fa-hosts-file\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-conf-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210482 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-cni-bin\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-etc-kubernetes\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-conf-dir\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysconfig\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f371b76-9c91-4668-af94-96ae07d3d130-dbus\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-var-lib-kubelet\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-etc-kubernetes\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrt8l\" (UniqueName: \"kubernetes.io/projected/68cae9d4-2bde-43a8-adf9-6bcfa511585d-kube-api-access-rrt8l\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysconfig\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210512 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-cnibin\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.211380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-sys-fs\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210653 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-cni-multus\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-cni-binary-copy\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-sys-fs\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-device-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-modprobe-d\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-host\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-var-lib-cni-multus\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5aaf044d-3291-4235-b262-fcfd91af532b-host\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210759 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93213c21-5f94-4369-b219-53584b6ca21a-device-dir\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl4rf\" (UniqueName: \"kubernetes.io/projected/eef46a16-6cf7-43b1-b015-06a7a7c688fa-kube-api-access-zl4rf\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-host\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5aaf044d-3291-4235-b262-fcfd91af532b-host\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-modprobe-d\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.210956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-daemon-config\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.212078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211218 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-multus-certs\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c3f90b4-212a-4972-9e18-949717cf8a26-cni-binary-copy\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cae9d4-2bde-43a8-adf9-6bcfa511585d-host-slash\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysctl-conf\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-host-run-multus-certs\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-sys\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cae9d4-2bde-43a8-adf9-6bcfa511585d-host-slash\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d872580-31d5-484e-8858-71b1f497fee5-etc-tuned\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5aaf044d-3291-4235-b262-fcfd91af532b-serviceca\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26br\" (UniqueName: \"kubernetes.io/projected/5aaf044d-3291-4235-b262-fcfd91af532b-kube-api-access-k26br\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-sysctl-conf\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef46a16-6cf7-43b1-b015-06a7a7c688fa-tmp-dir\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dts\" (UniqueName: \"kubernetes.io/projected/77b27729-1834-4b4f-9fd0-a7691aed9f7f-kube-api-access-59dts\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-systemd\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-daemon-config\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jw2k\" (UniqueName: \"kubernetes.io/projected/3d872580-31d5-484e-8858-71b1f497fee5-kube-api-access-8jw2k\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-run\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-socket-dir-parent\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.212772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f2ea91f-2379-4915-ad7e-6b605dd96817-multus-socket-dir-parent\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.213617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211755 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef46a16-6cf7-43b1-b015-06a7a7c688fa-tmp-dir\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.213617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5aaf044d-3291-4235-b262-fcfd91af532b-serviceca\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.213617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.211970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-run\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.213617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.212008 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-sys\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.213617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.212026 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d872580-31d5-484e-8858-71b1f497fee5-etc-systemd\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.213850 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.213833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d872580-31d5-484e-8858-71b1f497fee5-tmp\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.213907 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.213891 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d872580-31d5-484e-8858-71b1f497fee5-etc-tuned\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.222865 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.222749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dts\" (UniqueName: \"kubernetes.io/projected/77b27729-1834-4b4f-9fd0-a7691aed9f7f-kube-api-access-59dts\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.222989 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.222896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl4rf\" (UniqueName: \"kubernetes.io/projected/eef46a16-6cf7-43b1-b015-06a7a7c688fa-kube-api-access-zl4rf\") pod \"node-resolver-g4mpc\" (UID: \"eef46a16-6cf7-43b1-b015-06a7a7c688fa\") " pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.224042 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.223993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26br\" (UniqueName: \"kubernetes.io/projected/5aaf044d-3291-4235-b262-fcfd91af532b-kube-api-access-k26br\") pod \"node-ca-xvjm9\" (UID: \"5aaf044d-3291-4235-b262-fcfd91af532b\") " pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.224042 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.224035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jw2k\" (UniqueName: \"kubernetes.io/projected/3d872580-31d5-484e-8858-71b1f497fee5-kube-api-access-8jw2k\") pod \"tuned-7sjt7\" (UID: \"3d872580-31d5-484e-8858-71b1f497fee5\") " pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.224232 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.224040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdtz\" (UniqueName: \"kubernetes.io/projected/5f2ea91f-2379-4915-ad7e-6b605dd96817-kube-api-access-2hdtz\") pod \"multus-hd5s6\" (UID: \"5f2ea91f-2379-4915-ad7e-6b605dd96817\") " pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.224232 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.224043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rbm8\" (UniqueName: \"kubernetes.io/projected/93213c21-5f94-4369-b219-53584b6ca21a-kube-api-access-4rbm8\") pod \"aws-ebs-csi-driver-node-hjl9z\" (UID: \"93213c21-5f94-4369-b219-53584b6ca21a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.224908 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.224863 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbksn\" (UniqueName: \"kubernetes.io/projected/1c3f90b4-212a-4972-9e18-949717cf8a26-kube-api-access-sbksn\") pod \"multus-additional-cni-plugins-mxvz9\" (UID: \"1c3f90b4-212a-4972-9e18-949717cf8a26\") " pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.225055 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.225032 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrt8l\" (UniqueName: \"kubernetes.io/projected/68cae9d4-2bde-43a8-adf9-6bcfa511585d-kube-api-access-rrt8l\") pod \"iptables-alerter-gtwv5\" (UID: \"68cae9d4-2bde-43a8-adf9-6bcfa511585d\") " pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.307887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.307809 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:28.313431 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.313408 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:28.323057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.323028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" Jul 10 18:40:28.328754 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.328733 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gtwv5" Jul 10 18:40:28.335514 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.335494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" Jul 10 18:40:28.342148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.342129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g4mpc" Jul 10 18:40:28.355206 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.355185 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" Jul 10 18:40:28.362905 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.362846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvjm9" Jul 10 18:40:28.368510 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.368490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hd5s6" Jul 10 18:40:28.613733 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.613645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:28.613861 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.613812 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:28.613861 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.613832 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:28.613861 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.613841 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:28.613980 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.613903 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:29.613886194 +0000 UTC m=+3.913406401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:28.714367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.714328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:28.714521 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:28.714380 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:28.714521 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.714486 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:28.714637 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.714543 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:29.714526875 +0000 UTC m=+4.014047073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:28.714637 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.714486 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:28.714731 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:28.714656 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:40:29.714631986 +0000 UTC m=+4.014152200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:29.040200 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.040043 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:35:28 +0000 UTC" deadline="2028-03-27 12:39:06.97978498 +0000 UTC" Jul 10 18:40:29.040200 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.040139 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15017h58m37.939650781s" Jul 10 18:40:29.148360 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.148279 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93213c21_5f94_4369_b219_53584b6ca21a.slice/crio-4223fe9c386039262ae51f8967070ff18e3da273fd43e26f7321a093d5975147 WatchSource:0}: Error finding container 4223fe9c386039262ae51f8967070ff18e3da273fd43e26f7321a093d5975147: Status 404 returned error can't find the container with id 4223fe9c386039262ae51f8967070ff18e3da273fd43e26f7321a093d5975147 Jul 10 18:40:29.149008 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.148904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cae9d4_2bde_43a8_adf9_6bcfa511585d.slice/crio-44a470f004f031b62165df5b4ba177b056531a46c87bf9ffd6afe469a1f31ff2 WatchSource:0}: Error finding container 44a470f004f031b62165df5b4ba177b056531a46c87bf9ffd6afe469a1f31ff2: Status 404 returned error can't find the container with id 44a470f004f031b62165df5b4ba177b056531a46c87bf9ffd6afe469a1f31ff2 Jul 10 18:40:29.152700 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.152636 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3f90b4_212a_4972_9e18_949717cf8a26.slice/crio-4a4f139d33be83f354e9e7a80e9f4598deaca196bd75a5fdea06078bec8fa358 WatchSource:0}: Error finding container 4a4f139d33be83f354e9e7a80e9f4598deaca196bd75a5fdea06078bec8fa358: Status 404 returned error can't find the container with id 4a4f139d33be83f354e9e7a80e9f4598deaca196bd75a5fdea06078bec8fa358 Jul 10 18:40:29.154187 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.154156 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9a6410_eabb_4a5d_9d98_8dc774709785.slice/crio-644fe8a132136a22b102a26af13c3349dc99707795b0535264c8a139ae2285ff WatchSource:0}: Error finding container 644fe8a132136a22b102a26af13c3349dc99707795b0535264c8a139ae2285ff: Status 404 returned error can't find the container with id 644fe8a132136a22b102a26af13c3349dc99707795b0535264c8a139ae2285ff Jul 10 18:40:29.154635 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.154583 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaf044d_3291_4235_b262_fcfd91af532b.slice/crio-b639df7c45dcdbbc5de896ed90b61c6b5b92d38963a57c230139eac4d9cfe872 WatchSource:0}: Error finding container b639df7c45dcdbbc5de896ed90b61c6b5b92d38963a57c230139eac4d9cfe872: Status 404 returned error can't find the container with id b639df7c45dcdbbc5de896ed90b61c6b5b92d38963a57c230139eac4d9cfe872 Jul 10 18:40:29.157264 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.156072 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d872580_31d5_484e_8858_71b1f497fee5.slice/crio-ad65ea0543bbc28d9bc716f44229675840fe2333195213039ac20917fbc9771e WatchSource:0}: Error finding container ad65ea0543bbc28d9bc716f44229675840fe2333195213039ac20917fbc9771e: Status 404 returned error can't find the container with id ad65ea0543bbc28d9bc716f44229675840fe2333195213039ac20917fbc9771e Jul 10 18:40:29.157264 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.157253 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c2ffa6_dda7_485a_969a_375a2ae85241.slice/crio-8928cc2e63ef192bde38095eb87b632e9ef34c9fcd2599a3e273febaee0879f7 WatchSource:0}: Error finding container 8928cc2e63ef192bde38095eb87b632e9ef34c9fcd2599a3e273febaee0879f7: Status 404 returned error can't find the container with id 8928cc2e63ef192bde38095eb87b632e9ef34c9fcd2599a3e273febaee0879f7 Jul 10 18:40:29.184239 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.184208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:29.184385 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.184308 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:29.184385 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.184338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:29.184463 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.184386 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:29.187121 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.187074 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef46a16_6cf7_43b1_b015_06a7a7c688fa.slice/crio-d21232a4f289477daebcc61756229706525a9ef46d533ab0592eff4effcdfed0 WatchSource:0}: Error finding container d21232a4f289477daebcc61756229706525a9ef46d533ab0592eff4effcdfed0: Status 404 returned error can't find the container with id d21232a4f289477daebcc61756229706525a9ef46d533ab0592eff4effcdfed0 Jul 10 18:40:29.188480 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:40:29.188457 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2ea91f_2379_4915_ad7e_6b605dd96817.slice/crio-d64bd47737a6af797d9e84712e077ca3c230980d812661209e67db3495e46487 WatchSource:0}: Error finding container d64bd47737a6af797d9e84712e077ca3c230980d812661209e67db3495e46487: Status 404 returned error can't find the container with id d64bd47737a6af797d9e84712e077ca3c230980d812661209e67db3495e46487 Jul 10 18:40:29.191535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.191508 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"8928cc2e63ef192bde38095eb87b632e9ef34c9fcd2599a3e273febaee0879f7"} Jul 10 18:40:29.192720 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.192683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" event={"ID":"3d872580-31d5-484e-8858-71b1f497fee5","Type":"ContainerStarted","Data":"ad65ea0543bbc28d9bc716f44229675840fe2333195213039ac20917fbc9771e"} Jul 10 18:40:29.193790 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.193760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hd5s6" event={"ID":"5f2ea91f-2379-4915-ad7e-6b605dd96817","Type":"ContainerStarted","Data":"d64bd47737a6af797d9e84712e077ca3c230980d812661209e67db3495e46487"} Jul 10 18:40:29.194829 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.194772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerStarted","Data":"4a4f139d33be83f354e9e7a80e9f4598deaca196bd75a5fdea06078bec8fa358"} Jul 10 18:40:29.195870 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.195842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" event={"ID":"93213c21-5f94-4369-b219-53584b6ca21a","Type":"ContainerStarted","Data":"4223fe9c386039262ae51f8967070ff18e3da273fd43e26f7321a093d5975147"} Jul 10 18:40:29.196917 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.196897 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6b4sb" event={"ID":"7d9a6410-eabb-4a5d-9d98-8dc774709785","Type":"ContainerStarted","Data":"644fe8a132136a22b102a26af13c3349dc99707795b0535264c8a139ae2285ff"} Jul 10 18:40:29.197941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.197923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g4mpc" event={"ID":"eef46a16-6cf7-43b1-b015-06a7a7c688fa","Type":"ContainerStarted","Data":"d21232a4f289477daebcc61756229706525a9ef46d533ab0592eff4effcdfed0"} Jul 10 18:40:29.198903 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.198884 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvjm9" event={"ID":"5aaf044d-3291-4235-b262-fcfd91af532b","Type":"ContainerStarted","Data":"b639df7c45dcdbbc5de896ed90b61c6b5b92d38963a57c230139eac4d9cfe872"} Jul 10 18:40:29.199853 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.199835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gtwv5" event={"ID":"68cae9d4-2bde-43a8-adf9-6bcfa511585d","Type":"ContainerStarted","Data":"44a470f004f031b62165df5b4ba177b056531a46c87bf9ffd6afe469a1f31ff2"} Jul 10 18:40:29.621572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.621260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:29.621572 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.621553 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:29.621784 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.621582 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:29.621784 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.621595 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:29.621784 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.621660 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:31.621641667 +0000 UTC m=+5.921161868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:29.722931 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.722258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:29.722931 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:29.722310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:29.722931 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.722438 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:29.722931 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.722497 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:31.722476469 +0000 UTC m=+6.021996674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:29.722931 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.722857 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:29.722931 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:29.722899 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:40:31.722885507 +0000 UTC m=+6.022405712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:30.040921 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.040874 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:35:28 +0000 UTC" deadline="2028-01-07 14:07:48.174717367 +0000 UTC" Jul 10 18:40:30.040921 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.040917 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13099h27m18.133804889s" Jul 10 18:40:30.192220 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.191646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:30.192220 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:30.191785 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:30.216797 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.216762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" event={"ID":"5cd24277ff6091c18d8b9f1eee6e8097","Type":"ContainerStarted","Data":"264d1162b5509714751376fbc66a75d7cb2db3e96c3deffc589d797a21957e5d"} Jul 10 18:40:30.230610 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.230571 2575 generic.go:356] "Generic (PLEG): container finished" podID="e1875b2cf2107fb103e1ce838a786f48" containerID="27176fa85f4f5f4b305f9f42205fce08ba39fde65975c89dd429bc81ff3de425" exitCode=0 Jul 10 18:40:30.230724 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.230625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" event={"ID":"e1875b2cf2107fb103e1ce838a786f48","Type":"ContainerDied","Data":"27176fa85f4f5f4b305f9f42205fce08ba39fde65975c89dd429bc81ff3de425"} Jul 10 18:40:30.237991 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:30.237413 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" podStartSLOduration=3.237394738 podStartE2EDuration="3.237394738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:30.236621399 +0000 UTC m=+4.536141640" watchObservedRunningTime="2026-07-10 18:40:30.237394738 +0000 UTC m=+4.536914962" Jul 10 18:40:31.184314 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:31.184273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:31.184818 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.184415 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:31.184818 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:31.184797 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:31.184932 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.184889 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:31.259281 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:31.259198 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" event={"ID":"e1875b2cf2107fb103e1ce838a786f48","Type":"ContainerStarted","Data":"3725071af2512654d6ca039322b039dab965e0e43aeec7b9dbc1696b3c55b311"} Jul 10 18:40:31.642857 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:31.642140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:31.642857 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.642366 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:31.642857 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.642388 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:31.642857 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.642401 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:31.642857 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.642456 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:35.642438404 +0000 UTC m=+9.941958609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:31.743806 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:31.743102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:31.743806 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:31.743193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:31.743806 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.743307 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:31.743806 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.743366 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:40:35.743347546 +0000 UTC m=+10.042867746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:31.743806 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.743727 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:31.743806 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:31.743774 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:35.743758162 +0000 UTC m=+10.043278374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:32.186784 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:32.186747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:32.187240 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:32.186882 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:33.183734 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:33.183701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:33.183896 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:33.183756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:33.183896 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:33.183848 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:33.184016 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:33.183990 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:34.184463 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:34.184388 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:34.185017 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:34.184522 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:35.184210 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:35.184170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:35.184210 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:35.184192 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:35.184434 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.184303 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:35.184434 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.184385 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:35.674279 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:35.674195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:35.674430 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.674398 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:35.674430 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.674422 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:35.674527 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.674435 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:35.674527 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.674491 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:43.674472967 +0000 UTC m=+17.973993172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:35.775207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:35.775176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:35.775373 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:35.775226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:35.775373 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.775339 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:35.775486 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.775381 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:35.775486 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.775405 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:40:43.775383771 +0000 UTC m=+18.074903972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:35.775486 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:35.775429 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:43.775413962 +0000 UTC m=+18.074934168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:36.184901 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:36.184869 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:36.185442 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:36.184997 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:37.184133 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:37.183495 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:37.184133 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:37.183619 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:37.184133 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:37.183984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:37.184133 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:37.184078 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:38.183817 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:38.183779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:38.184311 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:38.183939 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:39.183795 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:39.183759 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:39.183795 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:39.183779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:39.184316 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:39.183888 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:39.184316 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:39.184015 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:40.183676 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:40.183588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:40.183828 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:40.183729 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:41.183968 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:41.183929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:41.184427 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:41.184064 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:41.184427 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:41.184123 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:41.184427 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:41.184252 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:42.184412 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:42.184377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:42.184856 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:42.184519 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:43.183477 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:43.183443 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:43.183477 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:43.183477 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:43.183751 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.183565 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:43.183751 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.183663 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:43.735906 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:43.735878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:43.736325 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.736098 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:43.736325 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.736128 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:43.736325 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.736142 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:43.736325 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.736203 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:59.73618459 +0000 UTC m=+34.035704797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:43.837145 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:43.837108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:43.837297 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:43.837214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:43.837297 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.837251 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:43.837403 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.837318 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:59.83730247 +0000 UTC m=+34.136822670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:43.837403 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.837319 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:43.837403 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:43.837379 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:40:59.837360495 +0000 UTC m=+34.136880697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:44.184194 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:44.184166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:44.184307 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:44.184273 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:45.184219 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:45.184185 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:45.184219 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:45.184221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:45.184653 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:45.184300 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:45.184653 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:45.184456 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:46.184817 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:46.184793 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:46.185237 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:46.184881 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:47.184267 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:47.184229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:47.184434 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:47.184229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:47.184434 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:47.184355 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:47.184534 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:47.184458 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:48.186055 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.183850 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:48.186055 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:48.183984 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:48.295890 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.295612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" event={"ID":"3d872580-31d5-484e-8858-71b1f497fee5","Type":"ContainerStarted","Data":"290d214bf9e2f879faaee280b72ac1aeb913478a095098df21be5abba21c8c14"} Jul 10 18:40:48.300250 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.299724 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hd5s6" event={"ID":"5f2ea91f-2379-4915-ad7e-6b605dd96817","Type":"ContainerStarted","Data":"3184437e5192a0f9d430778ad86451b72b96c56fc7a897c7787ad9cb4d477c0f"} Jul 10 18:40:48.304332 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.304264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerStarted","Data":"96c33dbf2fc2b2604c96563c7f347cde59c5cdf1a40aa754f99e4ff950926412"} Jul 10 18:40:48.312527 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.312405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6b4sb" event={"ID":"7d9a6410-eabb-4a5d-9d98-8dc774709785","Type":"ContainerStarted","Data":"64b5a3346b11d3010c6067b2050bf741e0a883b7bfe336241d331581baa5d6fa"} Jul 10 18:40:48.317716 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.316823 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" podStartSLOduration=21.316806082 podStartE2EDuration="21.316806082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:31.276593593 +0000 UTC m=+5.576113816" watchObservedRunningTime="2026-07-10 18:40:48.316806082 +0000 UTC m=+22.616326307" Jul 10 18:40:48.317716 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.317435 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7sjt7" podStartSLOduration=3.365032878 podStartE2EDuration="22.317421628s" totalImagesPullingTime="18.95238875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:48.317131217 +0000 UTC m=+22.616651439" watchObservedRunningTime="2026-07-10 18:40:48.317421628 +0000 UTC m=+22.616941852" Jul 10 18:40:48.320552 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.320523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"d074716c50b660774d3d34ed1d1270779d2524510e984584e721fba6425bab04"} Jul 10 18:40:48.332275 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.332161 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g4mpc" podStartSLOduration=3.422173523 podStartE2EDuration="22.332142721s" totalImagesPullingTime="18.909969198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:48.331844716 +0000 UTC m=+22.631364939" watchObservedRunningTime="2026-07-10 18:40:48.332142721 +0000 UTC m=+22.631662945" Jul 10 18:40:48.350296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.350252 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hd5s6" podStartSLOduration=3.373781083 podStartE2EDuration="22.350235131s" totalImagesPullingTime="18.976454048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:48.349887782 +0000 UTC m=+22.649408025" watchObservedRunningTime="2026-07-10 18:40:48.350235131 +0000 UTC m=+22.649755354" Jul 10 18:40:48.367250 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.367208 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6b4sb" podStartSLOduration=7.348813406 podStartE2EDuration="22.367193865s" totalImagesPullingTime="15.018380459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:48.367183945 +0000 UTC m=+22.666704166" watchObservedRunningTime="2026-07-10 18:40:48.367193865 +0000 UTC m=+22.666714087" Jul 10 18:40:48.411849 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.411794 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xvjm9" podStartSLOduration=3.469144284 podStartE2EDuration="22.41177489s" totalImagesPullingTime="18.942630606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:48.411287798 +0000 UTC m=+22.710808020" watchObservedRunningTime="2026-07-10 18:40:48.41177489 +0000 UTC m=+22.711295113" Jul 10 18:40:48.530512 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.530486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:48.606919 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:48.606895 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:49.183714 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.183535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:49.183908 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.183551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:49.183908 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:49.183798 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:49.183908 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:49.183858 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:49.324066 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.324036 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c3f90b4-212a-4972-9e18-949717cf8a26" containerID="96c33dbf2fc2b2604c96563c7f347cde59c5cdf1a40aa754f99e4ff950926412" exitCode=0 Jul 10 18:40:49.324844 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.324192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerDied","Data":"96c33dbf2fc2b2604c96563c7f347cde59c5cdf1a40aa754f99e4ff950926412"} Jul 10 18:40:49.325781 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.325760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" event={"ID":"93213c21-5f94-4369-b219-53584b6ca21a","Type":"ContainerStarted","Data":"525a4b811cb07e024eabcb725124fd2849af01681497e483254f2f2959a0dd81"} Jul 10 18:40:49.327047 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.326997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g4mpc" event={"ID":"eef46a16-6cf7-43b1-b015-06a7a7c688fa","Type":"ContainerStarted","Data":"5ca2979d58a38c237196d6ce92079b10c670418dc7ae2aef48806bf51e214b4e"} Jul 10 18:40:49.328404 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.328379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvjm9" event={"ID":"5aaf044d-3291-4235-b262-fcfd91af532b","Type":"ContainerStarted","Data":"280a0008ced3f1cb0b83f65dcb71b50acc01bdf1816effd03b94456bec343a71"} Jul 10 18:40:49.331329 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331311 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:40:49.331632 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331615 2575 generic.go:356] "Generic (PLEG): container finished" podID="95c2ffa6-dda7-485a-969a-375a2ae85241" containerID="df5cd3ec6fd5f5d58085b60c3da89a02a8cd57459b70610c221f6f76d1319b93" exitCode=1 Jul 10 18:40:49.331725 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331706 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"65e2c794a1df80758bf24c2230a905619d794fc065ac611510d079bd86421704"} Jul 10 18:40:49.331801 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"b4bbb87c68cc3d866243982b079ba4a5744d3a019f79f16c812d11495af370da"} Jul 10 18:40:49.331858 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"9409a074c416538d4759e6fa6ca1230583396943c3465e52989e55dafaf8626b"} Jul 10 18:40:49.331915 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"b1a98c68588e0d4ce37cddf7a56caed66e0ae1b4d3e8158c5e7d46779966b432"} Jul 10 18:40:49.331971 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.331946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerDied","Data":"df5cd3ec6fd5f5d58085b60c3da89a02a8cd57459b70610c221f6f76d1319b93"} Jul 10 18:40:49.379052 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:49.378996 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 18:40:50.114222 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.114047 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:40:49.379011818Z","UUID":"577cab04-8ea2-449b-9849-6242ecef328f","Handler":null,"Name":"","Endpoint":""} Jul 10 18:40:50.115738 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.115719 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 18:40:50.115879 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.115752 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 18:40:50.183605 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.183569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:50.183783 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:50.183692 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:50.335872 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.335792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gtwv5" event={"ID":"68cae9d4-2bde-43a8-adf9-6bcfa511585d","Type":"ContainerStarted","Data":"54d82494fc6474cbdb88368be261aa8c4ebe1ecf8d73445de3d430c747284b66"} Jul 10 18:40:50.337926 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.337902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" event={"ID":"93213c21-5f94-4369-b219-53584b6ca21a","Type":"ContainerStarted","Data":"8c30a3b26285f6db786f371d11d1992c91a600042a52914d8c1182f8b42471e6"} Jul 10 18:40:50.352383 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.352330 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gtwv5" podStartSLOduration=5.404900331 podStartE2EDuration="24.352310457s" totalImagesPullingTime="18.947410126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:50.352136214 +0000 UTC m=+24.651656433" watchObservedRunningTime="2026-07-10 18:40:50.352310457 +0000 UTC m=+24.651830680" Jul 10 18:40:50.471484 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.471395 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:50.534187 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:50.534130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:51.184347 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.184307 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:51.184600 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.184316 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:51.184600 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:51.184451 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:51.184600 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:51.184547 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:51.344924 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.344894 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:40:51.345532 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.345505 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"11afb6e4108516e2c7bb42cab27cb1758f8b61b851a8c134414b155e5ae09a78"} Jul 10 18:40:51.670728 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.670503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:51.742015 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.741934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:51.779940 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.779909 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:51.780430 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:51.780410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:52.183737 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:52.183644 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:52.183929 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:52.183788 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:52.350912 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:52.350876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" event={"ID":"93213c21-5f94-4369-b219-53584b6ca21a","Type":"ContainerStarted","Data":"1cc3ce413419d42d5dfecd1d1d3263e440e4dcb73f5f0f584b22d34d70f2200c"} Jul 10 18:40:52.351533 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:52.351191 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:52.351723 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:52.351705 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6b4sb" Jul 10 18:40:52.375299 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:52.375242 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjl9z" podStartSLOduration=4.424765825 podStartE2EDuration="26.375220629s" totalImagesPullingTime="21.950454804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:52.374509254 +0000 UTC m=+26.674029490" watchObservedRunningTime="2026-07-10 18:40:52.375220629 +0000 UTC m=+26.674740852" Jul 10 18:40:52.441208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:52.441117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:53.183769 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:53.183739 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:53.183937 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:53.183739 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:53.183937 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:53.183856 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:53.184047 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:53.183964 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:53.973739 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:53.973562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:54.184473 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.184438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:54.184614 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:54.184553 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:54.355909 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.355826 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c3f90b4-212a-4972-9e18-949717cf8a26" containerID="79b991c66cde9a197303330360b644f65c3ba476dd4e00a276abfdd9df8d3c55" exitCode=0 Jul 10 18:40:54.356078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.355912 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerDied","Data":"79b991c66cde9a197303330360b644f65c3ba476dd4e00a276abfdd9df8d3c55"} Jul 10 18:40:54.359276 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.359256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:40:54.359661 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.359623 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"852511c8cc85dfac6cb692b082d7ac9f3ec9ae7505c65c3ee3dd9f5dd1b6c11c"} Jul 10 18:40:54.360152 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.360135 2575 scope.go:117] "RemoveContainer" containerID="df5cd3ec6fd5f5d58085b60c3da89a02a8cd57459b70610c221f6f76d1319b93" Jul 10 18:40:54.404043 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.404016 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:54.514296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.514257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:54.608689 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.608596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:54.689181 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:54.689141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:55.183922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.183885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:55.184485 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.183887 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:55.184485 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:55.184030 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:55.184485 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:55.184062 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:55.367436 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.367407 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:40:55.367867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.367833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" event={"ID":"95c2ffa6-dda7-485a-969a-375a2ae85241","Type":"ContainerStarted","Data":"120469bcb0d4493775fdd59fc88e81ed0c4401c2e2a4a69b852c40b978cbff2a"} Jul 10 18:40:55.368480 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.368294 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:55.368480 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.368375 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:55.368480 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.368423 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:55.386622 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.386591 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:55.386762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.386741 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:40:55.398119 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.398050 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" podStartSLOduration=10.387259697 podStartE2EDuration="29.398035025s" totalImagesPullingTime="19.010775328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:55.396482523 +0000 UTC m=+29.696002770" watchObservedRunningTime="2026-07-10 18:40:55.398035025 +0000 UTC m=+29.697555247" Jul 10 18:40:55.523006 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.522974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sh7h8"] Jul 10 18:40:55.523464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.523186 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:55.523464 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:55.523308 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:55.527505 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.527478 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cwwx2"] Jul 10 18:40:55.527624 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.527585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:55.527694 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:55.527664 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:55.528316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.528113 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6g4x"] Jul 10 18:40:55.528316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:55.528205 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:55.528316 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:55.528284 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:56.345162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:56.344965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:56.372316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:56.372287 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c3f90b4-212a-4972-9e18-949717cf8a26" containerID="7a75a0a506606aba2548b6d7785a35ad5d71eae5389684622b8332287b987112" exitCode=0 Jul 10 18:40:56.372474 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:56.372363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerDied","Data":"7a75a0a506606aba2548b6d7785a35ad5d71eae5389684622b8332287b987112"} Jul 10 18:40:56.422067 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:56.422037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:56.585270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:56.585238 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:56.684836 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:56.684804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:57.012530 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:57.012446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:57.127149 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:57.127105 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:57.184322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:57.184289 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:57.184322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:57.184303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:57.184547 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:57.184392 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:57.184547 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:57.184466 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:57.184547 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:57.184491 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:57.184646 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:57.184593 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:57.213851 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:57.213818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:58.379768 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:58.379731 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c3f90b4-212a-4972-9e18-949717cf8a26" containerID="632336f1697f5c5111ec916f30d90ca114f55ddc45647a63e0d29f45c0cdce28" exitCode=0 Jul 10 18:40:58.380407 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:58.379802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerDied","Data":"632336f1697f5c5111ec916f30d90ca114f55ddc45647a63e0d29f45c0cdce28"} Jul 10 18:40:58.748823 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:58.748792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:58.850215 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:58.850181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:59.062701 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.062624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:59.183998 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.183963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:59.184197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.184008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:59.184197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.184008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:59.184197 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.184106 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:40:59.184197 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.184187 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:40:59.184400 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.184323 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:40:59.185395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.185376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:59.506337 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.506307 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g4mpc_eef46a16-6cf7-43b1-b015-06a7a7c688fa/dns-node-resolver/0.log" Jul 10 18:40:59.756656 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.756506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:40:59.756656 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.756651 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:59.756903 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.756671 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:59.756903 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.756680 2575 projected.go:196] Error preparing data for projected volume kube-api-access-86h2n for pod openshift-network-diagnostics/network-check-target-cwwx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:59.756903 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.756739 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n podName:908bdb08-3e7e-481e-a6a6-10436d5e6812 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:31.756719979 +0000 UTC m=+66.056240190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-86h2n" (UniqueName: "kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n") pod "network-check-target-cwwx2" (UID: "908bdb08-3e7e-481e-a6a6-10436d5e6812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:59.857816 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.857784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:40:59.857816 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.857824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:40:59.858069 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.857935 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:59.858069 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.857941 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:59.858069 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.857988 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret podName:1f371b76-9c91-4668-af94-96ae07d3d130 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:31.857975328 +0000 UTC m=+66.157495528 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret") pod "global-pull-secret-syncer-x6g4x" (UID: "1f371b76-9c91-4668-af94-96ae07d3d130") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:59.858069 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:40:59.858001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs podName:77b27729-1834-4b4f-9fd0-a7691aed9f7f nodeName:}" failed. No retries permitted until 2026-07-10 18:41:31.857994898 +0000 UTC m=+66.157515097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs") pod "network-metrics-daemon-sh7h8" (UID: "77b27729-1834-4b4f-9fd0-a7691aed9f7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:59.869348 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:40:59.869320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:00.707483 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:00.707456 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvjm9_5aaf044d-3291-4235-b262-fcfd91af532b/node-ca/0.log" Jul 10 18:41:01.183953 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:01.183917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:01.184143 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:01.183917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:01.184143 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:01.184043 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:01.184143 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:01.183936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:01.184143 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:01.184130 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:01.184321 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:01.184188 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:02.850123 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:02.850094 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:03.115484 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.115383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:03.183660 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.183637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:03.183787 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.183633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:03.183787 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:03.183754 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:03.183853 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.183633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:03.183853 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:03.183809 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:03.183915 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:03.183863 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:03.252376 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.252339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:03.321151 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.321125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:03.397839 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.397771 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c3f90b4-212a-4972-9e18-949717cf8a26" containerID="20e7e43d017ee7ba1613425383f31dfe31430484d4b4c9ba4e95f25af3dc9bf2" exitCode=0 Jul 10 18:41:03.397839 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.397815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerDied","Data":"20e7e43d017ee7ba1613425383f31dfe31430484d4b4c9ba4e95f25af3dc9bf2"} Jul 10 18:41:03.602715 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.602682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:03.702683 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.702644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:03.850144 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:03.850114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:04.403010 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:04.402977 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c3f90b4-212a-4972-9e18-949717cf8a26" containerID="d4362d01aff860e7f8e47b38ffc8f16376b2e085d55535f7eac859f49ab4fa7b" exitCode=0 Jul 10 18:41:04.403170 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:04.403026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerDied","Data":"d4362d01aff860e7f8e47b38ffc8f16376b2e085d55535f7eac859f49ab4fa7b"} Jul 10 18:41:04.631212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:04.630976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:05.021646 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.021620 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:05.183824 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.183791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:05.183995 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.183792 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:05.183995 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:05.183893 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:05.183995 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.183908 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:05.184115 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:05.183999 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:05.184115 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:05.184061 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:05.407719 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.407641 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" event={"ID":"1c3f90b4-212a-4972-9e18-949717cf8a26","Type":"ContainerStarted","Data":"ae73ed87f93ad45dcc64eb40cbe5eedf5a4a3ae0c881beec95831393d46b0ee3"} Jul 10 18:41:05.437762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.437712 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mxvz9" podStartSLOduration=10.272920212 podStartE2EDuration="39.437696628s" totalImagesPullingTime="29.164776416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:05.437416493 +0000 UTC m=+39.736936716" watchObservedRunningTime="2026-07-10 18:41:05.437696628 +0000 UTC m=+39.737216850" Jul 10 18:41:05.478878 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.478848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:05.842146 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.842115 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:05.993505 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:05.993471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:06.080632 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:06.080600 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:06.211639 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:06.211613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:06.825950 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:06.825912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:07.068148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.068114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:07.183480 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.183456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:07.183848 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.183456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:07.183848 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:07.183574 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:07.183848 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:07.183619 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:07.183848 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.183455 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:07.183848 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:07.183678 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:07.470470 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.470391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:07.635582 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.635547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:07.846967 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.846891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:07.975354 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:07.975323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:08.074847 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:08.074802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:08.260427 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:08.260397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:08.679282 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:08.679252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:09.033675 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.033597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:09.183553 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.183516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:09.183714 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.183611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:09.183714 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:09.183615 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:09.183714 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.183637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:09.183895 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:09.183711 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:09.183895 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:09.183809 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:09.331981 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.331892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:09.617657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.617561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:09.818683 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.818633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:09.886687 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:09.886582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:10.041689 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:10.041652 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:10.212009 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:10.211982 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:11.184231 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.184193 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:11.184644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.184211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:11.184644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.184321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:11.184644 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:11.184316 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:11.184644 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:11.184448 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:11.184644 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:11.184503 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:11.223764 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.223718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:11.421440 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.421400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:11.691464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.691412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:11.837816 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:11.837781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:12.030486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:12.030417 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:12.436456 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:12.436395 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:12.830882 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:12.830805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:13.183932 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:13.183906 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:13.184111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:13.183936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:13.184111 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:13.184015 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:13.184111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:13.184047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:13.184253 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:13.184128 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:13.184253 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:13.184190 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:13.421684 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:13.421648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:13.646903 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:13.646826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:13.819414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:13.819385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:15.184138 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:15.184079 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:15.184138 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:15.184131 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:15.184630 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:15.184220 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:15.184630 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:15.184271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:15.184630 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:15.184390 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:15.184630 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:15.184466 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:15.747989 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:15.747956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:15.824600 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:15.824571 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:17.183547 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.183508 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:17.183944 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.183556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:17.183944 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.183607 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:17.183944 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:17.183627 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:17.183944 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:17.183686 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:17.183944 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:17.183745 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:17.318549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.318517 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:17.419729 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.419697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:17.816831 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.816801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:17.897298 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:17.897270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:18.004868 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:18.004831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:18.078779 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:18.078712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:18.402881 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:18.402802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:18.465920 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:18.465895 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:19.022437 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.022405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:19.183617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.183584 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:19.183861 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:19.183679 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:19.183861 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.183584 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:19.183861 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.183723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:19.183861 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:19.183798 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:19.184075 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:19.183874 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:19.215284 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.215257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:19.400794 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.400721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:19.497953 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:19.497924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:21.094577 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.094549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:21.183942 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.183913 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:21.184117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.184008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:21.184117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.184018 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:21.184117 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:21.184015 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwwx2" podUID="908bdb08-3e7e-481e-a6a6-10436d5e6812" Jul 10 18:41:21.184228 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:21.184120 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6g4x" podUID="1f371b76-9c91-4668-af94-96ae07d3d130" Jul 10 18:41:21.184228 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:21.184187 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sh7h8" podUID="77b27729-1834-4b4f-9fd0-a7691aed9f7f" Jul 10 18:41:21.281070 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.281039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:21.388220 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.388153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:21.960958 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.960939 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeReady" Jul 10 18:41:21.961173 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.961045 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 18:41:21.961596 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:21.961576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:22.028626 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.028596 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8sdk4"] Jul 10 18:41:22.030399 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.030383 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-frwg7"] Jul 10 18:41:22.030486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.030468 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.032183 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.032164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.032957 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.032918 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 18:41:22.033075 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.033046 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 18:41:22.033075 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.033070 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 18:41:22.033303 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.033289 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pkb85\"" Jul 10 18:41:22.034943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.034929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 18:41:22.034989 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.034964 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-stn59\"" Jul 10 18:41:22.035071 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.035058 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 18:41:22.044251 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.044226 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8sdk4"] Jul 10 18:41:22.047759 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.047737 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frwg7"] Jul 10 18:41:22.122909 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.122874 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-84nwb"] Jul 10 18:41:22.123549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.123098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjll\" (UniqueName: \"kubernetes.io/projected/6a14600a-4843-4fab-8408-6d3175c49d1d-kube-api-access-hjjll\") pod \"ingress-canary-8sdk4\" (UID: \"6a14600a-4843-4fab-8408-6d3175c49d1d\") " pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.123549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.123125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae22d66-db44-4903-b591-c0550b43cf29-tmp-dir\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.123549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.123196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ae22d66-db44-4903-b591-c0550b43cf29-config-volume\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.123549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.123241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a14600a-4843-4fab-8408-6d3175c49d1d-cert\") pod \"ingress-canary-8sdk4\" (UID: \"6a14600a-4843-4fab-8408-6d3175c49d1d\") " pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.123549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.123280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ae22d66-db44-4903-b591-c0550b43cf29-metrics-tls\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.123549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.123296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qch8\" (UniqueName: \"kubernetes.io/projected/9ae22d66-db44-4903-b591-c0550b43cf29-kube-api-access-5qch8\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.124919 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.124901 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.128224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.128205 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 18:41:22.128474 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.128451 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 18:41:22.128672 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.128646 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 18:41:22.128758 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.128669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2ftqp\"" Jul 10 18:41:22.128758 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.128716 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 18:41:22.138871 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.138845 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84nwb"] Jul 10 18:41:22.223854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ae22d66-db44-4903-b591-c0550b43cf29-metrics-tls\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.223854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qch8\" (UniqueName: \"kubernetes.io/projected/9ae22d66-db44-4903-b591-c0550b43cf29-kube-api-access-5qch8\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.223854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0963365b-07b6-4b5a-acf2-aaf768e5761f-crio-socket\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0963365b-07b6-4b5a-acf2-aaf768e5761f-data-volume\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjll\" (UniqueName: \"kubernetes.io/projected/6a14600a-4843-4fab-8408-6d3175c49d1d-kube-api-access-hjjll\") pod \"ingress-canary-8sdk4\" (UID: \"6a14600a-4843-4fab-8408-6d3175c49d1d\") " pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223924 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0963365b-07b6-4b5a-acf2-aaf768e5761f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae22d66-db44-4903-b591-c0550b43cf29-tmp-dir\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.223970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0963365b-07b6-4b5a-acf2-aaf768e5761f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.224014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvtgk\" (UniqueName: \"kubernetes.io/projected/0963365b-07b6-4b5a-acf2-aaf768e5761f-kube-api-access-cvtgk\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.224040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ae22d66-db44-4903-b591-c0550b43cf29-config-volume\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.224111 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.224068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a14600a-4843-4fab-8408-6d3175c49d1d-cert\") pod \"ingress-canary-8sdk4\" (UID: \"6a14600a-4843-4fab-8408-6d3175c49d1d\") " pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.224377 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.224236 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae22d66-db44-4903-b591-c0550b43cf29-tmp-dir\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.224564 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.224541 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ae22d66-db44-4903-b591-c0550b43cf29-config-volume\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.227720 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.227697 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ae22d66-db44-4903-b591-c0550b43cf29-metrics-tls\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.227799 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.227731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a14600a-4843-4fab-8408-6d3175c49d1d-cert\") pod \"ingress-canary-8sdk4\" (UID: \"6a14600a-4843-4fab-8408-6d3175c49d1d\") " pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.231352 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.231320 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qch8\" (UniqueName: \"kubernetes.io/projected/9ae22d66-db44-4903-b591-c0550b43cf29-kube-api-access-5qch8\") pod \"dns-default-frwg7\" (UID: \"9ae22d66-db44-4903-b591-c0550b43cf29\") " pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.232382 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.232358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjll\" (UniqueName: \"kubernetes.io/projected/6a14600a-4843-4fab-8408-6d3175c49d1d-kube-api-access-hjjll\") pod \"ingress-canary-8sdk4\" (UID: \"6a14600a-4843-4fab-8408-6d3175c49d1d\") " pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.261042 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.261021 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:22.325264 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0963365b-07b6-4b5a-acf2-aaf768e5761f-crio-socket\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325264 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0963365b-07b6-4b5a-acf2-aaf768e5761f-data-volume\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0963365b-07b6-4b5a-acf2-aaf768e5761f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0963365b-07b6-4b5a-acf2-aaf768e5761f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0963365b-07b6-4b5a-acf2-aaf768e5761f-crio-socket\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325459 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvtgk\" (UniqueName: \"kubernetes.io/projected/0963365b-07b6-4b5a-acf2-aaf768e5761f-kube-api-access-cvtgk\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0963365b-07b6-4b5a-acf2-aaf768e5761f-data-volume\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.325897 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.325872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0963365b-07b6-4b5a-acf2-aaf768e5761f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.327541 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.327521 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0963365b-07b6-4b5a-acf2-aaf768e5761f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.334231 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.334214 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvtgk\" (UniqueName: \"kubernetes.io/projected/0963365b-07b6-4b5a-acf2-aaf768e5761f-kube-api-access-cvtgk\") pod \"insights-runtime-extractor-84nwb\" (UID: \"0963365b-07b6-4b5a-acf2-aaf768e5761f\") " pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.359549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.359519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:22.359944 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.359599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8sdk4" Jul 10 18:41:22.360499 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.360480 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:22.433859 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.433831 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84nwb" Jul 10 18:41:22.437359 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.436937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:22.501019 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.500761 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8sdk4"] Jul 10 18:41:22.505369 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:22.505343 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a14600a_4843_4fab_8408_6d3175c49d1d.slice/crio-85c9b0e550cfcf2b1329d7571ccffd7fe91a577fd8662a3d4ce36c94374c13e7 WatchSource:0}: Error finding container 85c9b0e550cfcf2b1329d7571ccffd7fe91a577fd8662a3d4ce36c94374c13e7: Status 404 returned error can't find the container with id 85c9b0e550cfcf2b1329d7571ccffd7fe91a577fd8662a3d4ce36c94374c13e7 Jul 10 18:41:22.522743 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.522718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frwg7"] Jul 10 18:41:22.526600 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:22.526577 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae22d66_db44_4903_b591_c0550b43cf29.slice/crio-c2592a04fa13e21adfde6f4ca0dc55c15ea92d6af0b53e3ad46e15464dd341f5 WatchSource:0}: Error finding container c2592a04fa13e21adfde6f4ca0dc55c15ea92d6af0b53e3ad46e15464dd341f5: Status 404 returned error can't find the container with id c2592a04fa13e21adfde6f4ca0dc55c15ea92d6af0b53e3ad46e15464dd341f5 Jul 10 18:41:22.570329 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:22.570304 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84nwb"] Jul 10 18:41:22.573410 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:22.573389 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0963365b_07b6_4b5a_acf2_aaf768e5761f.slice/crio-f7d4f119d14c1bf5acf415c64b57d680dbe564f3b10ffcf5f3f13f35452d217f WatchSource:0}: Error finding container f7d4f119d14c1bf5acf415c64b57d680dbe564f3b10ffcf5f3f13f35452d217f: Status 404 returned error can't find the container with id f7d4f119d14c1bf5acf415c64b57d680dbe564f3b10ffcf5f3f13f35452d217f Jul 10 18:41:23.184644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.183662 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:23.184644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.184159 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:23.184644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.184607 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:23.187536 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.187511 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:41:23.190270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.189136 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:41:23.190270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.189448 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v9r2k\"" Jul 10 18:41:23.190270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.189577 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p7x9n\"" Jul 10 18:41:23.190270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.189595 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:41:23.190270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.189745 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:41:23.452415 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.452331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8sdk4" event={"ID":"6a14600a-4843-4fab-8408-6d3175c49d1d","Type":"ContainerStarted","Data":"85c9b0e550cfcf2b1329d7571ccffd7fe91a577fd8662a3d4ce36c94374c13e7"} Jul 10 18:41:23.454501 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.454419 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frwg7" event={"ID":"9ae22d66-db44-4903-b591-c0550b43cf29","Type":"ContainerStarted","Data":"c2592a04fa13e21adfde6f4ca0dc55c15ea92d6af0b53e3ad46e15464dd341f5"} Jul 10 18:41:23.457316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:23.457238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84nwb" event={"ID":"0963365b-07b6-4b5a-acf2-aaf768e5761f","Type":"ContainerStarted","Data":"f7d4f119d14c1bf5acf415c64b57d680dbe564f3b10ffcf5f3f13f35452d217f"} Jul 10 18:41:26.952669 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:26.952617 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.031420 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:27.031389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.388698 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:27.388626 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2pms" Jul 10 18:41:27.554545 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:27.554510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.653900 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:27.653821 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:28.472250 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.472205 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8sdk4" event={"ID":"6a14600a-4843-4fab-8408-6d3175c49d1d","Type":"ContainerStarted","Data":"863e8861dc5f4a99e0a223cd0df6c3da765da2b7a51264eff22b089e19e8b73a"} Jul 10 18:41:28.473908 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.473882 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frwg7" event={"ID":"9ae22d66-db44-4903-b591-c0550b43cf29","Type":"ContainerStarted","Data":"b1c6566c3b52fcb1da2c3381a5740cc031d19a29c977d9768f9e40bb63b5cf02"} Jul 10 18:41:28.474030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.473927 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frwg7" event={"ID":"9ae22d66-db44-4903-b591-c0550b43cf29","Type":"ContainerStarted","Data":"85355956fc3122fef00e387d60ea6c32d7b220d8c821ec385719cd7f06a8ee88"} Jul 10 18:41:28.474030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.473955 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:28.475194 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.475172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84nwb" event={"ID":"0963365b-07b6-4b5a-acf2-aaf768e5761f","Type":"ContainerStarted","Data":"2f098e4aff0dee929c1adff559a5ec075d71850ff5857a7fbf3a4d1ee6e3f337"} Jul 10 18:41:28.527688 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.527633 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8sdk4" podStartSLOduration=1.494665105 podStartE2EDuration="6.527614879s" totalImagesPullingTime="5.032949774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:28.49412639 +0000 UTC m=+62.793646609" watchObservedRunningTime="2026-07-10 18:41:28.527614879 +0000 UTC m=+62.827135103" Jul 10 18:41:28.528248 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:28.528211 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-frwg7" podStartSLOduration=4.5461529160000005 podStartE2EDuration="6.528199551s" totalImagesPullingTime="1.982046635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:28.526282243 +0000 UTC m=+62.825802495" watchObservedRunningTime="2026-07-10 18:41:28.528199551 +0000 UTC m=+62.827719775" Jul 10 18:41:29.481015 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:29.480974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84nwb" event={"ID":"0963365b-07b6-4b5a-acf2-aaf768e5761f","Type":"ContainerStarted","Data":"c136f8dc0d399a92f2efdac4fce371e10f08fcd97f1704d9158b25a5b7ecc6fd"} Jul 10 18:41:30.821097 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:30.821043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:30.925326 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:30.925286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:31.018504 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.018466 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj"] Jul 10 18:41:31.021282 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.021262 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:31.021712 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.021689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:31.023948 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.023931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rtbpw\"" Jul 10 18:41:31.024380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.024364 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 18:41:31.033408 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.033385 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj"] Jul 10 18:41:31.096099 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.096054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f459005-f4c8-4cb6-9224-2d33fb6c06a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7nrqj\" (UID: \"4f459005-f4c8-4cb6-9224-2d33fb6c06a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:31.196644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.196604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f459005-f4c8-4cb6-9224-2d33fb6c06a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7nrqj\" (UID: \"4f459005-f4c8-4cb6-9224-2d33fb6c06a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:31.196819 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:31.196751 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 10 18:41:31.196819 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:31.196817 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f459005-f4c8-4cb6-9224-2d33fb6c06a9-tls-certificates podName:4f459005-f4c8-4cb6-9224-2d33fb6c06a9 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:31.696801375 +0000 UTC m=+65.996321578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4f459005-f4c8-4cb6-9224-2d33fb6c06a9-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-7nrqj" (UID: "4f459005-f4c8-4cb6-9224-2d33fb6c06a9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 10 18:41:31.318599 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.318567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:31.493912 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.493876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84nwb" event={"ID":"0963365b-07b6-4b5a-acf2-aaf768e5761f","Type":"ContainerStarted","Data":"62b7d84f43f4b2901fe330ff34e059f4e51ec6a6c4d5774949ecb874e90a52e7"} Jul 10 18:41:31.546149 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.546073 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-84nwb" podStartSLOduration=1.248442193 podStartE2EDuration="9.546056461s" totalImagesPullingTime="8.297614268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:41:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:31.545599222 +0000 UTC m=+65.845119444" watchObservedRunningTime="2026-07-10 18:41:31.546056461 +0000 UTC m=+65.845576680" Jul 10 18:41:31.700829 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.700796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f459005-f4c8-4cb6-9224-2d33fb6c06a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7nrqj\" (UID: \"4f459005-f4c8-4cb6-9224-2d33fb6c06a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:31.703136 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.703107 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f459005-f4c8-4cb6-9224-2d33fb6c06a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7nrqj\" (UID: \"4f459005-f4c8-4cb6-9224-2d33fb6c06a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:31.801523 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.801422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:31.805156 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.805136 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:41:31.815396 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.815375 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:41:31.825039 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.825019 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86h2n\" (UniqueName: \"kubernetes.io/projected/908bdb08-3e7e-481e-a6a6-10436d5e6812-kube-api-access-86h2n\") pod \"network-check-target-cwwx2\" (UID: \"908bdb08-3e7e-481e-a6a6-10436d5e6812\") " pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:31.902360 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.902302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:31.902360 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.902373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:31.906246 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.906228 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:41:31.906381 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.906366 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:41:31.911860 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.911840 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p7x9n\"" Jul 10 18:41:31.915058 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.915036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b27729-1834-4b4f-9fd0-a7691aed9f7f-metrics-certs\") pod \"network-metrics-daemon-sh7h8\" (UID: \"77b27729-1834-4b4f-9fd0-a7691aed9f7f\") " pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:31.915058 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.915057 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f371b76-9c91-4668-af94-96ae07d3d130-original-pull-secret\") pod \"global-pull-secret-syncer-x6g4x\" (UID: \"1f371b76-9c91-4668-af94-96ae07d3d130\") " pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:31.918159 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.918143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6g4x" Jul 10 18:41:31.920292 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.920273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:31.929345 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:31.929332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:32.063231 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.063161 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cwwx2"] Jul 10 18:41:32.067018 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:32.066984 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908bdb08_3e7e_481e_a6a6_10436d5e6812.slice/crio-61d1842b0fcb1a1c1bfbd32e623af13f81e119da7039c553f4e05d7bf4f9f657 WatchSource:0}: Error finding container 61d1842b0fcb1a1c1bfbd32e623af13f81e119da7039c553f4e05d7bf4f9f657: Status 404 returned error can't find the container with id 61d1842b0fcb1a1c1bfbd32e623af13f81e119da7039c553f4e05d7bf4f9f657 Jul 10 18:41:32.082768 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.082743 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6g4x"] Jul 10 18:41:32.086589 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:32.086569 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f371b76_9c91_4668_af94_96ae07d3d130.slice/crio-002dab26de9fb2ee73a643072d3920dda2943dd6acbafbe7cc93e8b02cfdd78a WatchSource:0}: Error finding container 002dab26de9fb2ee73a643072d3920dda2943dd6acbafbe7cc93e8b02cfdd78a: Status 404 returned error can't find the container with id 002dab26de9fb2ee73a643072d3920dda2943dd6acbafbe7cc93e8b02cfdd78a Jul 10 18:41:32.104785 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.104763 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj"] Jul 10 18:41:32.108462 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:32.108440 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f459005_f4c8_4cb6_9224_2d33fb6c06a9.slice/crio-0e4993d0c479a26b73e5236b1367aa4f041498630cb0df5b53f88d7097f3c2fd WatchSource:0}: Error finding container 0e4993d0c479a26b73e5236b1367aa4f041498630cb0df5b53f88d7097f3c2fd: Status 404 returned error can't find the container with id 0e4993d0c479a26b73e5236b1367aa4f041498630cb0df5b53f88d7097f3c2fd Jul 10 18:41:32.204183 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.204159 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v9r2k\"" Jul 10 18:41:32.211703 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.211676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sh7h8" Jul 10 18:41:32.337808 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.337737 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sh7h8"] Jul 10 18:41:32.340668 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:32.340645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b27729_1834_4b4f_9fd0_a7691aed9f7f.slice/crio-670eb8d2eac8ab68e0bee552bac9962519614583a0222b32752c1f97cb9c36fd WatchSource:0}: Error finding container 670eb8d2eac8ab68e0bee552bac9962519614583a0222b32752c1f97cb9c36fd: Status 404 returned error can't find the container with id 670eb8d2eac8ab68e0bee552bac9962519614583a0222b32752c1f97cb9c36fd Jul 10 18:41:32.498581 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.498548 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sh7h8" event={"ID":"77b27729-1834-4b4f-9fd0-a7691aed9f7f","Type":"ContainerStarted","Data":"670eb8d2eac8ab68e0bee552bac9962519614583a0222b32752c1f97cb9c36fd"} Jul 10 18:41:32.500221 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.500193 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" event={"ID":"4f459005-f4c8-4cb6-9224-2d33fb6c06a9","Type":"ContainerStarted","Data":"0e4993d0c479a26b73e5236b1367aa4f041498630cb0df5b53f88d7097f3c2fd"} Jul 10 18:41:32.501969 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.501938 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cwwx2" event={"ID":"908bdb08-3e7e-481e-a6a6-10436d5e6812","Type":"ContainerStarted","Data":"61d1842b0fcb1a1c1bfbd32e623af13f81e119da7039c553f4e05d7bf4f9f657"} Jul 10 18:41:32.503982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.503957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6g4x" event={"ID":"1f371b76-9c91-4668-af94-96ae07d3d130","Type":"ContainerStarted","Data":"002dab26de9fb2ee73a643072d3920dda2943dd6acbafbe7cc93e8b02cfdd78a"} Jul 10 18:41:32.849986 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.849932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:32.931878 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:32.931843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:33.688273 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.688243 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84fb58748d-tr69m"] Jul 10 18:41:33.698715 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.698689 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.702509 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.702489 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:41:33.702782 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.702756 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:41:33.703013 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.702943 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:41:33.703013 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.702996 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:41:33.703423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.703403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f24js\"" Jul 10 18:41:33.703655 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.703606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:41:33.703740 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.703689 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:41:33.703964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.703899 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:41:33.706566 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.706540 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fb58748d-tr69m"] Jul 10 18:41:33.816253 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.816229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58bjs\" (UniqueName: \"kubernetes.io/projected/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-kube-api-access-58bjs\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.816349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.816267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-oauth-config\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.816349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.816296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-config\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.816349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.816316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-oauth-serving-cert\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.816349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.816345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-serving-cert\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.816489 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.816366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-service-ca\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.917721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.917632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-config\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918192 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.917819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-oauth-serving-cert\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918192 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.917876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-serving-cert\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918192 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.917901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-service-ca\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918192 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.917925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58bjs\" (UniqueName: \"kubernetes.io/projected/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-kube-api-access-58bjs\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918192 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.917965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-oauth-config\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918801 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.918467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-config\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.918999 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.918976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-service-ca\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.919078 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.918999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-oauth-serving-cert\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.920872 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.920847 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-oauth-config\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.921681 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.921657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-serving-cert\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:33.937765 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:33.937714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58bjs\" (UniqueName: \"kubernetes.io/projected/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-kube-api-access-58bjs\") pod \"console-84fb58748d-tr69m\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:34.023202 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.023165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:34.026872 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.026841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:34.127219 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.127146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:34.201121 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.201073 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fb58748d-tr69m"] Jul 10 18:41:34.240767 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.240740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:34.342024 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.341983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:34.514149 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.514043 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sh7h8" event={"ID":"77b27729-1834-4b4f-9fd0-a7691aed9f7f","Type":"ContainerStarted","Data":"e8fbe1f93a809fa7350cb0b9aed27519622228872c32e04e2465279edeb6fe06"} Jul 10 18:41:34.514149 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.514138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sh7h8" event={"ID":"77b27729-1834-4b4f-9fd0-a7691aed9f7f","Type":"ContainerStarted","Data":"cfea6acb42f48aff9eb2808734eea6faebd2056dc7e3935feef6207ff07ff0b3"} Jul 10 18:41:34.516237 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.516209 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" event={"ID":"4f459005-f4c8-4cb6-9224-2d33fb6c06a9","Type":"ContainerStarted","Data":"a752f4d277e4530d7a72a2bbc06d40ce757fbd138cb643b00cfbc305baa5ca45"} Jul 10 18:41:34.516379 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.516338 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:34.517836 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.517811 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb58748d-tr69m" event={"ID":"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778","Type":"ContainerStarted","Data":"2d3baa1e18fd1570f418e80ee778676fcf3b08f9589a84f138bed15df4c96e22"} Jul 10 18:41:34.522127 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.522105 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" Jul 10 18:41:34.533583 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.533536 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sh7h8" podStartSLOduration=67.268483381 podStartE2EDuration="1m8.533519525s" totalImagesPullingTime="1.265036144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:34.53316619 +0000 UTC m=+68.832686414" watchObservedRunningTime="2026-07-10 18:41:34.533519525 +0000 UTC m=+68.833039748" Jul 10 18:41:34.555357 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.555316 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7nrqj" podStartSLOduration=3.061016693 podStartE2EDuration="4.555303087s" totalImagesPullingTime="1.494286394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:34.553810983 +0000 UTC m=+68.853331223" watchObservedRunningTime="2026-07-10 18:41:34.555303087 +0000 UTC m=+68.854823309" Jul 10 18:41:34.661858 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.661815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:34.761654 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:34.761623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:35.056441 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.056407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:35.125530 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.125498 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-tt746"] Jul 10 18:41:35.138670 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.138637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.140445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.140409 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-tt746"] Jul 10 18:41:35.143268 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.143244 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 18:41:35.144601 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.144578 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 18:41:35.144601 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.144594 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 18:41:35.144784 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.144578 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 18:41:35.144918 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.144888 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8s6cc\"" Jul 10 18:41:35.145066 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.145054 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 18:41:35.154663 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.154641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:35.227442 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.227402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec7160e-1188-4004-a4a9-dcf3d8074919-metrics-client-ca\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.227656 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.227480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.227656 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.227521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.227656 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.227545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqs2r\" (UniqueName: \"kubernetes.io/projected/2ec7160e-1188-4004-a4a9-dcf3d8074919-kube-api-access-fqs2r\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.328668 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.328599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.328668 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.328644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.328668 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.328664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqs2r\" (UniqueName: \"kubernetes.io/projected/2ec7160e-1188-4004-a4a9-dcf3d8074919-kube-api-access-fqs2r\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.328850 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.328696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec7160e-1188-4004-a4a9-dcf3d8074919-metrics-client-ca\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.328850 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:35.328760 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 10 18:41:35.328850 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:35.328839 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-tls podName:2ec7160e-1188-4004-a4a9-dcf3d8074919 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:35.828818031 +0000 UTC m=+70.128338234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-tls") pod "prometheus-operator-64785b6675-tt746" (UID: "2ec7160e-1188-4004-a4a9-dcf3d8074919") : secret "prometheus-operator-tls" not found Jul 10 18:41:35.329388 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.329370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec7160e-1188-4004-a4a9-dcf3d8074919-metrics-client-ca\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.330909 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.330883 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.340841 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.340815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqs2r\" (UniqueName: \"kubernetes.io/projected/2ec7160e-1188-4004-a4a9-dcf3d8074919-kube-api-access-fqs2r\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.424077 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.424042 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:35.532053 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.532006 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:35.832644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.832611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:35.835581 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:35.835554 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec7160e-1188-4004-a4a9-dcf3d8074919-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tt746\" (UID: \"2ec7160e-1188-4004-a4a9-dcf3d8074919\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:36.050652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:36.050611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" Jul 10 18:41:37.130876 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.130820 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-tt746"] Jul 10 18:41:37.531589 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.531553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cwwx2" event={"ID":"908bdb08-3e7e-481e-a6a6-10436d5e6812","Type":"ContainerStarted","Data":"afb6b05dc7cc49058194161ef55ac7636fb882b5b911067b3d10d94a57dfd92d"} Jul 10 18:41:37.531782 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.531674 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:41:37.533443 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.533412 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6g4x" event={"ID":"1f371b76-9c91-4668-af94-96ae07d3d130","Type":"ContainerStarted","Data":"710175c0431fa7bf066a82ef0e77e11f06a54a40d723139415781d363fe24d99"} Jul 10 18:41:37.548283 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.548233 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cwwx2" podStartSLOduration=66.620791525 podStartE2EDuration="1m11.54821873s" totalImagesPullingTime="4.927427205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:37.547413242 +0000 UTC m=+71.846933484" watchObservedRunningTime="2026-07-10 18:41:37.54821873 +0000 UTC m=+71.847738952" Jul 10 18:41:37.845863 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.845768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:37.953196 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:37.953143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:38.139357 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:38.139291 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec7160e_1188_4004_a4a9_dcf3d8074919.slice/crio-01b3b5b9fb71cf9ccd14b0912f7e398b54a9be2f5dd90eff9cbdbe2db59c3e01 WatchSource:0}: Error finding container 01b3b5b9fb71cf9ccd14b0912f7e398b54a9be2f5dd90eff9cbdbe2db59c3e01: Status 404 returned error can't find the container with id 01b3b5b9fb71cf9ccd14b0912f7e398b54a9be2f5dd90eff9cbdbe2db59c3e01 Jul 10 18:41:38.482689 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.482662 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-frwg7" Jul 10 18:41:38.502392 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.502342 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x6g4x" podStartSLOduration=67.587226862 podStartE2EDuration="1m12.502325923s" totalImagesPullingTime="4.915099061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:37.563332617 +0000 UTC m=+71.862852841" watchObservedRunningTime="2026-07-10 18:41:38.502325923 +0000 UTC m=+72.801846143" Jul 10 18:41:38.539267 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.539225 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb58748d-tr69m" event={"ID":"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778","Type":"ContainerStarted","Data":"b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5"} Jul 10 18:41:38.540748 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.540719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" event={"ID":"2ec7160e-1188-4004-a4a9-dcf3d8074919","Type":"ContainerStarted","Data":"01b3b5b9fb71cf9ccd14b0912f7e398b54a9be2f5dd90eff9cbdbe2db59c3e01"} Jul 10 18:41:38.559374 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.559313 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84fb58748d-tr69m" podStartSLOduration=1.580469124 podStartE2EDuration="5.559295322s" totalImagesPullingTime="3.978826198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:38.557971592 +0000 UTC m=+72.857491827" watchObservedRunningTime="2026-07-10 18:41:38.559295322 +0000 UTC m=+72.858815545" Jul 10 18:41:38.822159 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.822054 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-748c8878fb-fln92"] Jul 10 18:41:38.825374 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.825348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.836112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.835882 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 18:41:38.836597 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.836574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748c8878fb-fln92"] Jul 10 18:41:38.954972 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.954936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2skrr\" (UniqueName: \"kubernetes.io/projected/25bf746d-df45-43ed-a199-6d78b3f68b29-kube-api-access-2skrr\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.954972 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.954975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-service-ca\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.955238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.955004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-oauth-serving-cert\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.955238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.955101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-console-config\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.955238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.955144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-oauth-config\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.955238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.955185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-serving-cert\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:38.955238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:38.955232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-trusted-ca-bundle\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056482 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-service-ca\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056678 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-oauth-serving-cert\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056678 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056535 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-console-config\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056678 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-oauth-config\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056678 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-serving-cert\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056891 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-trusted-ca-bundle\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.056891 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.056793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2skrr\" (UniqueName: \"kubernetes.io/projected/25bf746d-df45-43ed-a199-6d78b3f68b29-kube-api-access-2skrr\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.057387 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.057354 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-service-ca\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.057684 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.057637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-oauth-serving-cert\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.057792 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.057770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-console-config\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.057954 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.057929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-trusted-ca-bundle\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.059439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.059412 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-oauth-config\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.059524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.059439 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-serving-cert\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.073196 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.073137 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2skrr\" (UniqueName: \"kubernetes.io/projected/25bf746d-df45-43ed-a199-6d78b3f68b29-kube-api-access-2skrr\") pod \"console-748c8878fb-fln92\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.136736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.136709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:39.315355 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.308205 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748c8878fb-fln92"] Jul 10 18:41:39.316837 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:39.316804 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bf746d_df45_43ed_a199_6d78b3f68b29.slice/crio-bf366f96526daf00502b4e950a4fe7652834b2056612342eba4fde97413fc860 WatchSource:0}: Error finding container bf366f96526daf00502b4e950a4fe7652834b2056612342eba4fde97413fc860: Status 404 returned error can't find the container with id bf366f96526daf00502b4e950a4fe7652834b2056612342eba4fde97413fc860 Jul 10 18:41:39.546606 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.546565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" event={"ID":"2ec7160e-1188-4004-a4a9-dcf3d8074919","Type":"ContainerStarted","Data":"214729e3d2962f1d3d2637d49d02a483d07b0d226e159045f80a1da37dd953d6"} Jul 10 18:41:39.546772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.546628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" event={"ID":"2ec7160e-1188-4004-a4a9-dcf3d8074919","Type":"ContainerStarted","Data":"8fb29126db8008d0a6f82cd71f33d1eca8cb7bce9bc478819545c074e931f9c7"} Jul 10 18:41:39.548123 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.548094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748c8878fb-fln92" event={"ID":"25bf746d-df45-43ed-a199-6d78b3f68b29","Type":"ContainerStarted","Data":"043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2"} Jul 10 18:41:39.548236 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.548137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748c8878fb-fln92" event={"ID":"25bf746d-df45-43ed-a199-6d78b3f68b29","Type":"ContainerStarted","Data":"bf366f96526daf00502b4e950a4fe7652834b2056612342eba4fde97413fc860"} Jul 10 18:41:39.581403 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.581322 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-tt746" podStartSLOduration=3.49335624 podStartE2EDuration="4.581307651s" totalImagesPullingTime="1.087951411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:39.580811988 +0000 UTC m=+73.880332230" watchObservedRunningTime="2026-07-10 18:41:39.581307651 +0000 UTC m=+73.880827872" Jul 10 18:41:39.606803 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.606762 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-748c8878fb-fln92" podStartSLOduration=1.606748104 podStartE2EDuration="1.606748104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:39.606690654 +0000 UTC m=+73.906210905" watchObservedRunningTime="2026-07-10 18:41:39.606748104 +0000 UTC m=+73.906268326" Jul 10 18:41:39.618367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:39.618342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:41.323583 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.323549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:41.578937 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.578862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:41.683829 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.683789 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-p8fcp"] Jul 10 18:41:41.687145 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.687125 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5wjvq"] Jul 10 18:41:41.687285 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.687268 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.690924 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.690904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.694033 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.694002 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 18:41:41.694606 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.694587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 18:41:41.694701 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.694626 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fcn5h\"" Jul 10 18:41:41.694701 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.694635 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 18:41:41.695047 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.695034 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 18:41:41.700526 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.700503 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84"] Jul 10 18:41:41.700634 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.700610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-psdxh\"" Jul 10 18:41:41.700787 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.700769 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 18:41:41.703681 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.703666 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.704248 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.704231 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 18:41:41.709643 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.709627 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 18:41:41.710324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.710307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x8nfk\"" Jul 10 18:41:41.710400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.710323 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 18:41:41.722110 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.722073 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84"] Jul 10 18:41:41.727241 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.727218 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-p8fcp"] Jul 10 18:41:41.740382 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.740362 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:41.779346 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-wtmp\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779472 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a88f2843-9ad0-4084-95e6-c1375e4235c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.779472 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgvfz\" (UniqueName: \"kubernetes.io/projected/a88f2843-9ad0-4084-95e6-c1375e4235c7-kube-api-access-qgvfz\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.779472 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.779576 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-sys\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779576 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.779576 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-tls\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779576 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3116354c-4757-4ffe-b78d-b124ca3110aa-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.779695 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779695 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.779695 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-textfile\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779695 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997abcc4-577e-4463-ad65-7ee2bc7e86f8-metrics-client-ca\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779695 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a88f2843-9ad0-4084-95e6-c1375e4235c7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.779867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3116354c-4757-4ffe-b78d-b124ca3110aa-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.779867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-root\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktckw\" (UniqueName: \"kubernetes.io/projected/997abcc4-577e-4463-ad65-7ee2bc7e86f8-kube-api-access-ktckw\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.779867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zxn\" (UniqueName: \"kubernetes.io/projected/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-api-access-g6zxn\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.779867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.779811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88f2843-9ad0-4084-95e6-c1375e4235c7-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.866020 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.865956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:41.880305 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-root\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880436 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktckw\" (UniqueName: \"kubernetes.io/projected/997abcc4-577e-4463-ad65-7ee2bc7e86f8-kube-api-access-ktckw\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880436 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zxn\" (UniqueName: \"kubernetes.io/projected/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-api-access-g6zxn\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.880436 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-root\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880599 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88f2843-9ad0-4084-95e6-c1375e4235c7-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.880657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-wtmp\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880657 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a88f2843-9ad0-4084-95e6-c1375e4235c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.880737 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgvfz\" (UniqueName: \"kubernetes.io/projected/a88f2843-9ad0-4084-95e6-c1375e4235c7-kube-api-access-qgvfz\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.880737 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.880839 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880766 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-wtmp\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880839 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-sys\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880930 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.880930 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-tls\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.880930 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3116354c-4757-4ffe-b78d-b124ca3110aa-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880950 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/997abcc4-577e-4463-ad65-7ee2bc7e86f8-sys\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.880982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-textfile\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997abcc4-577e-4463-ad65-7ee2bc7e86f8-metrics-client-ca\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a88f2843-9ad0-4084-95e6-c1375e4235c7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.881117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3116354c-4757-4ffe-b78d-b124ca3110aa-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.881469 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.881469 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881359 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3116354c-4757-4ffe-b78d-b124ca3110aa-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.881469 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88f2843-9ad0-4084-95e6-c1375e4235c7-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.882247 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.881678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.882247 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.882045 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997abcc4-577e-4463-ad65-7ee2bc7e86f8-metrics-client-ca\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.882247 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.882196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-textfile\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.882467 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.882304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.882736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.882675 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3116354c-4757-4ffe-b78d-b124ca3110aa-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.883586 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.883560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-tls\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.883714 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.883651 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a88f2843-9ad0-4084-95e6-c1375e4235c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.883776 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.883734 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.883850 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.883777 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/997abcc4-577e-4463-ad65-7ee2bc7e86f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.883981 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.883964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a88f2843-9ad0-4084-95e6-c1375e4235c7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.884571 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.884555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.889214 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.889197 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktckw\" (UniqueName: \"kubernetes.io/projected/997abcc4-577e-4463-ad65-7ee2bc7e86f8-kube-api-access-ktckw\") pod \"node-exporter-5wjvq\" (UID: \"997abcc4-577e-4463-ad65-7ee2bc7e86f8\") " pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:41.892223 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.892204 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zxn\" (UniqueName: \"kubernetes.io/projected/3116354c-4757-4ffe-b78d-b124ca3110aa-kube-api-access-g6zxn\") pod \"kube-state-metrics-785778ff74-p8fcp\" (UID: \"3116354c-4757-4ffe-b78d-b124ca3110aa\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:41.893205 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.893186 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgvfz\" (UniqueName: \"kubernetes.io/projected/a88f2843-9ad0-4084-95e6-c1375e4235c7-kube-api-access-qgvfz\") pod \"openshift-state-metrics-84bd68b896-d9k84\" (UID: \"a88f2843-9ad0-4084-95e6-c1375e4235c7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:41.993162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.993141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:41.998042 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:41.998027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" Jul 10 18:41:42.003062 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.003047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wjvq" Jul 10 18:41:42.011928 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.011910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" Jul 10 18:41:42.013915 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:42.013893 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997abcc4_577e_4463_ad65_7ee2bc7e86f8.slice/crio-13e16bab8dbf68d8d8874bd9df447b56ff32454c1713f58420f9f9f9348746ab WatchSource:0}: Error finding container 13e16bab8dbf68d8d8874bd9df447b56ff32454c1713f58420f9f9f9348746ab: Status 404 returned error can't find the container with id 13e16bab8dbf68d8d8874bd9df447b56ff32454c1713f58420f9f9f9348746ab Jul 10 18:41:42.130658 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.130575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:42.140899 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.140873 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-p8fcp"] Jul 10 18:41:42.143873 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:42.143842 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3116354c_4757_4ffe_b78d_b124ca3110aa.slice/crio-9b5a78b37e3e5f7646bdd0d6a7c48f8f07a89c3f82a35f232461422fae162ab1 WatchSource:0}: Error finding container 9b5a78b37e3e5f7646bdd0d6a7c48f8f07a89c3f82a35f232461422fae162ab1: Status 404 returned error can't find the container with id 9b5a78b37e3e5f7646bdd0d6a7c48f8f07a89c3f82a35f232461422fae162ab1 Jul 10 18:41:42.162316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.162232 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84"] Jul 10 18:41:42.164412 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:42.164391 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88f2843_9ad0_4084_95e6_c1375e4235c7.slice/crio-6c878d34e75fafe60f5702a02f8febf0cec1d2b778c59b0ed841693d5d6e17ee WatchSource:0}: Error finding container 6c878d34e75fafe60f5702a02f8febf0cec1d2b778c59b0ed841693d5d6e17ee: Status 404 returned error can't find the container with id 6c878d34e75fafe60f5702a02f8febf0cec1d2b778c59b0ed841693d5d6e17ee Jul 10 18:41:42.348845 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.348812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:42.525522 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.525486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:42.562214 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.562172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wjvq" event={"ID":"997abcc4-577e-4463-ad65-7ee2bc7e86f8","Type":"ContainerStarted","Data":"13e16bab8dbf68d8d8874bd9df447b56ff32454c1713f58420f9f9f9348746ab"} Jul 10 18:41:42.564572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.564445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" event={"ID":"3116354c-4757-4ffe-b78d-b124ca3110aa","Type":"ContainerStarted","Data":"9b5a78b37e3e5f7646bdd0d6a7c48f8f07a89c3f82a35f232461422fae162ab1"} Jul 10 18:41:42.566832 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.566805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" event={"ID":"a88f2843-9ad0-4084-95e6-c1375e4235c7","Type":"ContainerStarted","Data":"1e3d5fa695d74da16983047ede7b1572b564653a85621eb513603c55e61682e7"} Jul 10 18:41:42.566960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.566859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" event={"ID":"a88f2843-9ad0-4084-95e6-c1375e4235c7","Type":"ContainerStarted","Data":"6f84b8878b08c822e06045598d8aa76cb74d22ddffd0dda7b79655343c7f0302"} Jul 10 18:41:42.566960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.566884 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" event={"ID":"a88f2843-9ad0-4084-95e6-c1375e4235c7","Type":"ContainerStarted","Data":"6c878d34e75fafe60f5702a02f8febf0cec1d2b778c59b0ed841693d5d6e17ee"} Jul 10 18:41:42.626444 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.625641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:42.627887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.627854 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:41:42.633800 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.633774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.638875 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.638854 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:41:42.639184 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.638854 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:41:42.639184 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.638858 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:41:42.639184 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.638857 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:41:42.639704 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.639674 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:41:42.639984 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.639956 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:41:42.640118 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.640034 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:41:42.641275 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.641196 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:41:42.641432 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.641391 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:41:42.642124 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.641644 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cmp55\"" Jul 10 18:41:42.672431 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.672403 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:41:42.687843 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.687810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-volume\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.687977 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.687851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.687977 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.687921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-out\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.687977 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.687948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688172 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688172 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688172 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvxhf\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-kube-api-access-qvxhf\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.688324 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.688316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-web-config\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789179 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789179 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789179 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvxhf\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-kube-api-access-qvxhf\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-web-config\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-volume\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:42.789351 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle podName:b0cafd28-cf74-4adc-a4ea-d9e970574178 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:43.289329279 +0000 UTC m=+77.588849503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178") : configmap references non-existent config key: ca-bundle.crt Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:42.789381 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789443 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-out\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789922 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:41:42.789457 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls podName:b0cafd28-cf74-4adc-a4ea-d9e970574178 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:43.289437926 +0000 UTC m=+77.588958133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178") : secret "alertmanager-main-tls" not found Jul 10 18:41:42.789922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789491 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.789922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.789563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.790259 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.790231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.791291 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.791264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.792756 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.792725 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.793302 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.793255 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.793968 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.793945 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.795518 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.795032 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-web-config\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.795518 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.795448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.795518 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.795471 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.795736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.795530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-out\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.796650 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.796471 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-volume\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.805691 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.805666 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvxhf\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-kube-api-access-qvxhf\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:42.945897 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:42.945870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:43.293676 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.293635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:43.293849 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.293695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:43.294457 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.294434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:43.295964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.295938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:43.546928 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.546884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:43.577619 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.577595 2575 generic.go:356] "Generic (PLEG): container finished" podID="997abcc4-577e-4463-ad65-7ee2bc7e86f8" containerID="a64e3226d311706d98e90d8dcb24d1c7c644ab47030b737efc57922b8dc10927" exitCode=0 Jul 10 18:41:43.577741 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.577673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wjvq" event={"ID":"997abcc4-577e-4463-ad65-7ee2bc7e86f8","Type":"ContainerDied","Data":"a64e3226d311706d98e90d8dcb24d1c7c644ab47030b737efc57922b8dc10927"} Jul 10 18:41:43.763540 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.762793 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:41:43.768354 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:43.768315 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0cafd28_cf74_4adc_a4ea_d9e970574178.slice/crio-1a8899483fd07186f49586707c46e223978528e61b80baae0a2edcbe6f06cbc2 WatchSource:0}: Error finding container 1a8899483fd07186f49586707c46e223978528e61b80baae0a2edcbe6f06cbc2: Status 404 returned error can't find the container with id 1a8899483fd07186f49586707c46e223978528e61b80baae0a2edcbe6f06cbc2 Jul 10 18:41:43.818302 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.818269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:43.921125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:43.921067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.018234 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.018199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.027054 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.027030 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:44.027233 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.027113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:44.032820 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.032786 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:44.281839 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.281801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.377486 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.377454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.585454 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.585361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" event={"ID":"a88f2843-9ad0-4084-95e6-c1375e4235c7","Type":"ContainerStarted","Data":"6cf4ac42b42f95abb821bb5e490c6c0e2a267990a2f4abfea5b17a22e7b769be"} Jul 10 18:41:44.586825 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.586798 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"1a8899483fd07186f49586707c46e223978528e61b80baae0a2edcbe6f06cbc2"} Jul 10 18:41:44.589339 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.589309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wjvq" event={"ID":"997abcc4-577e-4463-ad65-7ee2bc7e86f8","Type":"ContainerStarted","Data":"96d60660d90111c4e2829af463fa18a7843c1f1fc5f99ab6b6749bf8d17b1edb"} Jul 10 18:41:44.589468 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.589364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wjvq" event={"ID":"997abcc4-577e-4463-ad65-7ee2bc7e86f8","Type":"ContainerStarted","Data":"6a8f3f268af68e3766ba4d463f72b5f4715094e509ada8b9c7a53ed369156f57"} Jul 10 18:41:44.591924 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.591893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" event={"ID":"3116354c-4757-4ffe-b78d-b124ca3110aa","Type":"ContainerStarted","Data":"1127a26606c1267e0a09e7d21045a791cd6c895de29c38754809543a65470856"} Jul 10 18:41:44.592050 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.591953 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" event={"ID":"3116354c-4757-4ffe-b78d-b124ca3110aa","Type":"ContainerStarted","Data":"8ee066cf49322f67279552265814b43727fc8d9117ef79f83e1d049f3edcf6fb"} Jul 10 18:41:44.592050 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.591979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" event={"ID":"3116354c-4757-4ffe-b78d-b124ca3110aa","Type":"ContainerStarted","Data":"c0822006b47e2d5a8ec3ad38c0a829ec4e8a99f230d88fd17c1eccfbc3971abd"} Jul 10 18:41:44.597369 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.597342 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:41:44.602751 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.602725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.608323 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.608274 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d9k84" podStartSLOduration=2.324520685 podStartE2EDuration="3.608254517s" totalImagesPullingTime="1.283733832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:44.607440153 +0000 UTC m=+78.906960395" watchObservedRunningTime="2026-07-10 18:41:44.608254517 +0000 UTC m=+78.907774753" Jul 10 18:41:44.668932 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.668880 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5wjvq" podStartSLOduration=2.692933237 podStartE2EDuration="3.668859745s" totalImagesPullingTime="897.918607ms" totalInitContainerRuntime="78.007901ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:44.643858317 +0000 UTC m=+78.943378564" watchObservedRunningTime="2026-07-10 18:41:44.668859745 +0000 UTC m=+78.968380015" Jul 10 18:41:44.669285 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.669250 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn"] Jul 10 18:41:44.674294 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.674276 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.697530 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.697508 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 18:41:44.697660 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.697530 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 18:41:44.698527 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.697708 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 18:41:44.698527 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.697774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 18:41:44.698527 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.697797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 18:41:44.698527 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.697800 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-510vcftje6oc7\"" Jul 10 18:41:44.698527 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.698365 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gngz6\"" Jul 10 18:41:44.703668 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.703646 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn"] Jul 10 18:41:44.726692 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.726628 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-p8fcp" podStartSLOduration=2.306582179 podStartE2EDuration="3.726608031s" totalImagesPullingTime="1.420025852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:44.726271824 +0000 UTC m=+79.025792068" watchObservedRunningTime="2026-07-10 18:41:44.726608031 +0000 UTC m=+79.026128254" Jul 10 18:41:44.732184 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.732156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.807041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.806933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-tls\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807266 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807266 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807266 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-grpc-tls\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807266 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59dc3ea8-cc22-4538-a3d9-724572c8f44c-metrics-client-ca\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807266 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzt8\" (UniqueName: \"kubernetes.io/projected/59dc3ea8-cc22-4538-a3d9-724572c8f44c-kube-api-access-qnzt8\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.807516 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.807292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.870809 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.870775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.908538 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzt8\" (UniqueName: \"kubernetes.io/projected/59dc3ea8-cc22-4538-a3d9-724572c8f44c-kube-api-access-qnzt8\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-tls\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908771 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908771 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908771 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-grpc-tls\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.908771 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.908740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59dc3ea8-cc22-4538-a3d9-724572c8f44c-metrics-client-ca\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.909573 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.909546 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59dc3ea8-cc22-4538-a3d9-724572c8f44c-metrics-client-ca\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.911225 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.911196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.911327 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.911257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-grpc-tls\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.911404 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.911387 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.911469 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.911389 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-tls\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.911538 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.911478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.911629 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.911608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59dc3ea8-cc22-4538-a3d9-724572c8f44c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.918470 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.918451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzt8\" (UniqueName: \"kubernetes.io/projected/59dc3ea8-cc22-4538-a3d9-724572c8f44c-kube-api-access-qnzt8\") pod \"thanos-querier-8679f9d5f4-nmmsn\" (UID: \"59dc3ea8-cc22-4538-a3d9-724572c8f44c\") " pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:44.970262 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.970228 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:44.985420 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:44.985395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:45.071975 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:45.071936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:45.128693 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:45.128668 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn"] Jul 10 18:41:45.130992 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:45.130965 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dc3ea8_cc22_4538_a3d9_724572c8f44c.slice/crio-981e777c2273c40081ee9f38d64824d84d4b03f8e25b438dc813378afbbe1221 WatchSource:0}: Error finding container 981e777c2273c40081ee9f38d64824d84d4b03f8e25b438dc813378afbbe1221: Status 404 returned error can't find the container with id 981e777c2273c40081ee9f38d64824d84d4b03f8e25b438dc813378afbbe1221 Jul 10 18:41:45.597893 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:45.597857 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645" exitCode=0 Jul 10 18:41:45.598331 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:45.597958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645"} Jul 10 18:41:45.599597 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:45.599560 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"981e777c2273c40081ee9f38d64824d84d4b03f8e25b438dc813378afbbe1221"} Jul 10 18:41:46.191472 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.191437 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d75498d-dmj8b"] Jul 10 18:41:46.195617 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.195585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.202772 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.202749 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 18:41:46.204812 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.204790 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 18:41:46.206783 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.206395 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 18:41:46.206783 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.206500 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-76n4c\"" Jul 10 18:41:46.206783 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.206625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 18:41:46.206783 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.206723 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-90vs8p0niur4e\"" Jul 10 18:41:46.248653 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.248585 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d75498d-dmj8b"] Jul 10 18:41:46.319193 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-secret-metrics-server-tls\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.319331 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-audit-log\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.319331 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-secret-metrics-server-client-certs\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.319331 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-metrics-server-audit-profiles\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.319459 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-client-ca-bundle\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.319459 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.319459 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.319448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fs7\" (UniqueName: \"kubernetes.io/projected/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-kube-api-access-n4fs7\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.420679 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-secret-metrics-server-client-certs\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.420840 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-metrics-server-audit-profiles\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.420840 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-client-ca-bundle\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.420840 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.420840 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fs7\" (UniqueName: \"kubernetes.io/projected/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-kube-api-access-n4fs7\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.421059 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-secret-metrics-server-tls\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.421059 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.420921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-audit-log\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.421329 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.421303 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-audit-log\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.421899 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.421872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.422012 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.421899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-metrics-server-audit-profiles\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.424904 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.424878 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-secret-metrics-server-client-certs\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.425567 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.425514 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-client-ca-bundle\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.425759 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.425702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-secret-metrics-server-tls\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.435844 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.435821 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fs7\" (UniqueName: \"kubernetes.io/projected/6b4b544d-bfe2-413e-9bb3-d3a8f154a9be-kube-api-access-n4fs7\") pod \"metrics-server-6d75498d-dmj8b\" (UID: \"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be\") " pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.481051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.480967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:46.510023 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.509999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:41:46.516506 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.516486 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748c8878fb-fln92"] Jul 10 18:41:46.517900 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.517874 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv"] Jul 10 18:41:46.520882 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.520863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.524335 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.524158 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 18:41:46.524335 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.524229 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gxj22\"" Jul 10 18:41:46.539928 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.539906 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv"] Jul 10 18:41:46.561202 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.561176 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68557bfb59-44zzk"] Jul 10 18:41:46.564575 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.564555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.588226 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.588206 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68557bfb59-44zzk"] Jul 10 18:41:46.622492 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-trusted-ca-bundle\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-oauth-serving-cert\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-console-config\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llsdm\" (UniqueName: \"kubernetes.io/projected/1d726875-4757-410d-990c-43e97332c086-kube-api-access-llsdm\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-serving-cert\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-oauth-config\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnpgv\" (UniqueName: \"kubernetes.io/projected/a0742a2d-5646-4df5-98f9-0aa951d5faf0-kube-api-access-dnpgv\") pod \"monitoring-plugin-5f68df7f58-2gqpv\" (UID: \"a0742a2d-5646-4df5-98f9-0aa951d5faf0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0742a2d-5646-4df5-98f9-0aa951d5faf0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2gqpv\" (UID: \"a0742a2d-5646-4df5-98f9-0aa951d5faf0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.622867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.622831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-service-ca\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.633700 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.633654 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-oauth-config\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnpgv\" (UniqueName: \"kubernetes.io/projected/a0742a2d-5646-4df5-98f9-0aa951d5faf0-kube-api-access-dnpgv\") pod \"monitoring-plugin-5f68df7f58-2gqpv\" (UID: \"a0742a2d-5646-4df5-98f9-0aa951d5faf0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0742a2d-5646-4df5-98f9-0aa951d5faf0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2gqpv\" (UID: \"a0742a2d-5646-4df5-98f9-0aa951d5faf0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-service-ca\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724324 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-trusted-ca-bundle\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-oauth-serving-cert\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-console-config\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724443 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llsdm\" (UniqueName: \"kubernetes.io/projected/1d726875-4757-410d-990c-43e97332c086-kube-api-access-llsdm\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.724706 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.724473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-serving-cert\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.727112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.726379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-oauth-serving-cert\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.727112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.726411 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-trusted-ca-bundle\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.734141 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.727619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-console-config\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.734141 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.729498 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-service-ca\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.738186 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.737981 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-oauth-config\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.742599 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.742571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-serving-cert\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.747429 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.747385 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0742a2d-5646-4df5-98f9-0aa951d5faf0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2gqpv\" (UID: \"a0742a2d-5646-4df5-98f9-0aa951d5faf0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.749372 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.749346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:46.750547 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.750525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnpgv\" (UniqueName: \"kubernetes.io/projected/a0742a2d-5646-4df5-98f9-0aa951d5faf0-kube-api-access-dnpgv\") pod \"monitoring-plugin-5f68df7f58-2gqpv\" (UID: \"a0742a2d-5646-4df5-98f9-0aa951d5faf0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.751873 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.751850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llsdm\" (UniqueName: \"kubernetes.io/projected/1d726875-4757-410d-990c-43e97332c086-kube-api-access-llsdm\") pod \"console-68557bfb59-44zzk\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.833604 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.833563 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:46.876481 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.876116 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:46.962077 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:46.962022 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d75498d-dmj8b"] Jul 10 18:41:47.203879 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:47.203849 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4b544d_bfe2_413e_9bb3_d3a8f154a9be.slice/crio-86bc36ff637ae33b95d067916b1d7b13894a345c1439c6c65b38bb919f75518a WatchSource:0}: Error finding container 86bc36ff637ae33b95d067916b1d7b13894a345c1439c6c65b38bb919f75518a: Status 404 returned error can't find the container with id 86bc36ff637ae33b95d067916b1d7b13894a345c1439c6c65b38bb919f75518a Jul 10 18:41:47.357367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.357334 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv"] Jul 10 18:41:47.389937 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.389907 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68557bfb59-44zzk"] Jul 10 18:41:47.391586 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:47.391546 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d726875_4757_410d_990c_43e97332c086.slice/crio-9b8bf6f13624fd3237c9e0e4e85ea760294f33ebdde5b45370d2319b400bfaac WatchSource:0}: Error finding container 9b8bf6f13624fd3237c9e0e4e85ea760294f33ebdde5b45370d2319b400bfaac: Status 404 returned error can't find the container with id 9b8bf6f13624fd3237c9e0e4e85ea760294f33ebdde5b45370d2319b400bfaac Jul 10 18:41:47.434744 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.434714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:47.537976 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.537918 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:47.611066 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.611032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" event={"ID":"a0742a2d-5646-4df5-98f9-0aa951d5faf0","Type":"ContainerStarted","Data":"18c5e40d7d7a70f9b16a0e500d3e84c6573b06a09d17013a721f46258c008c30"} Jul 10 18:41:47.612734 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.612688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" event={"ID":"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be","Type":"ContainerStarted","Data":"86bc36ff637ae33b95d067916b1d7b13894a345c1439c6c65b38bb919f75518a"} Jul 10 18:41:47.617063 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.617022 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2"} Jul 10 18:41:47.617162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.617105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819"} Jul 10 18:41:47.617162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.617147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454"} Jul 10 18:41:47.617258 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.617174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110"} Jul 10 18:41:47.619564 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.619520 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"19f814d71433e59246c14f245e2c6336cb79f5e5a07bb97318d75edc0da48249"} Jul 10 18:41:47.619675 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.619582 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"05bee2522daae9190b81b3a2f8d722d4231b4bd88bd0cd84c157c8c061eb54e4"} Jul 10 18:41:47.619675 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.619634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"d234454c52a9b2a69e000e0691c849ba39182b577f750d412142a62172a6e335"} Jul 10 18:41:47.621350 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.621323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68557bfb59-44zzk" event={"ID":"1d726875-4757-410d-990c-43e97332c086","Type":"ContainerStarted","Data":"772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8"} Jul 10 18:41:47.621444 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.621363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68557bfb59-44zzk" event={"ID":"1d726875-4757-410d-990c-43e97332c086","Type":"ContainerStarted","Data":"9b8bf6f13624fd3237c9e0e4e85ea760294f33ebdde5b45370d2319b400bfaac"} Jul 10 18:41:47.646692 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.646646 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68557bfb59-44zzk" podStartSLOduration=1.646627716 podStartE2EDuration="1.646627716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:47.642417324 +0000 UTC m=+81.941937557" watchObservedRunningTime="2026-07-10 18:41:47.646627716 +0000 UTC m=+81.946147938" Jul 10 18:41:47.937228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.937157 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:47.939317 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.939251 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:41:47.945490 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.944840 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:47.951450 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.951427 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 18:41:47.952666 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.951664 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 18:41:47.952666 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.951688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.953549 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.953751 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.953945 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.954169 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.955455 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.955648 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sp9tn\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.955844 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.956023 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 18:41:47.956367 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.956219 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 18:41:47.956829 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.951435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-clq3r5ikqk4sd\"" Jul 10 18:41:47.957060 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.957043 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 18:41:47.958569 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.958550 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 18:41:47.967148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.964005 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:41:47.983853 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:47.983824 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.037982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8wp\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-kube-api-access-cc8wp\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.038349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.038005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.039199 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.038027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.039199 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.038046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.039199 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.038116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.039199 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.038143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8wp\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-kube-api-access-cc8wp\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.141125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.142014 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.139959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.142014 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.140001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.142014 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.140026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.144774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.144837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.145460 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.145480 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.145660 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.145907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.147400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.146762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.150929 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.150158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.151049 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.150991 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.154207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.154127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.155763 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.155738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.156479 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.156269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8wp\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-kube-api-access-cc8wp\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.156952 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.156908 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.158127 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.158050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.158845 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.158794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.162202 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.162161 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.162771 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.162731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.162857 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.162771 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.162857 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.162839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.164337 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.164312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.274413 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.274120 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:41:48.630861 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:48.630780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4"} Jul 10 18:41:49.137121 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.137074 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:41:49.308317 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.308296 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:41:49.309984 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:41:49.309962 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cd3250_165b_446f_9cbf_8926b1dd74d0.slice/crio-d030a6217a190e9ca4a1119499121700c67e0f3416b45934ef0b8f454c996484 WatchSource:0}: Error finding container d030a6217a190e9ca4a1119499121700c67e0f3416b45934ef0b8f454c996484: Status 404 returned error can't find the container with id d030a6217a190e9ca4a1119499121700c67e0f3416b45934ef0b8f454c996484 Jul 10 18:41:49.637196 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.637074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" event={"ID":"a0742a2d-5646-4df5-98f9-0aa951d5faf0","Type":"ContainerStarted","Data":"83c8f90344b841b23d04092755960bec46cc572e674c67a9ed9cef5bca88413a"} Jul 10 18:41:49.637355 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.637276 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:49.638832 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.638803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" event={"ID":"6b4b544d-bfe2-413e-9bb3-d3a8f154a9be","Type":"ContainerStarted","Data":"c649bf0a373e008f8da89e14f861673953aadad6b1cb794121646cba2fe535b7"} Jul 10 18:41:49.640551 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.640517 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" exitCode=0 Jul 10 18:41:49.640683 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.640561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} Jul 10 18:41:49.640683 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.640627 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"d030a6217a190e9ca4a1119499121700c67e0f3416b45934ef0b8f454c996484"} Jul 10 18:41:49.643134 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.643112 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" Jul 10 18:41:49.644615 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.644588 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerStarted","Data":"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c"} Jul 10 18:41:49.647699 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.647681 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"a925de8ebfac3c3a596211e0694b360fb7358a6f1bf2e170e9581bf7b9f00584"} Jul 10 18:41:49.647769 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.647727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"46c9cdc95024e85e5b492ab84f170d2397e14894af948e863256798be9360010"} Jul 10 18:41:49.647769 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.647753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" event={"ID":"59dc3ea8-cc22-4538-a3d9-724572c8f44c","Type":"ContainerStarted","Data":"2d5d965af77d8cda6e62573586d74b745c8ecbad55efcd93349b3bcc8182223b"} Jul 10 18:41:49.647847 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.647834 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:49.654529 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.654490 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2gqpv" podStartSLOduration=1.87663695 podStartE2EDuration="3.654476091s" totalImagesPullingTime="1.777839141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:49.653247855 +0000 UTC m=+83.952768068" watchObservedRunningTime="2026-07-10 18:41:49.654476091 +0000 UTC m=+83.953996314" Jul 10 18:41:49.675887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.675843 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" podStartSLOduration=1.733049069 podStartE2EDuration="3.675828443s" totalImagesPullingTime="1.942779374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:49.674524345 +0000 UTC m=+83.974044592" watchObservedRunningTime="2026-07-10 18:41:49.675828443 +0000 UTC m=+83.975348666" Jul 10 18:41:49.706230 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.706167 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.482482671 podStartE2EDuration="7.70614692s" totalImagesPullingTime="4.208107554s" totalInitContainerRuntime="15.556695ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:49.703673335 +0000 UTC m=+84.003193568" watchObservedRunningTime="2026-07-10 18:41:49.70614692 +0000 UTC m=+84.005667149" Jul 10 18:41:49.747345 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:49.747296 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" podStartSLOduration=2.026383201 podStartE2EDuration="5.747277542s" totalImagesPullingTime="3.720894341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:49.746005207 +0000 UTC m=+84.045525454" watchObservedRunningTime="2026-07-10 18:41:49.747277542 +0000 UTC m=+84.046797764" Jul 10 18:41:53.205744 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.205669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:53.379014 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.378983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:53.669242 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.669164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} Jul 10 18:41:53.669242 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.669231 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} Jul 10 18:41:53.669414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.669257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} Jul 10 18:41:53.669414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.669280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} Jul 10 18:41:53.669414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.669305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} Jul 10 18:41:53.669414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.669347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerStarted","Data":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} Jul 10 18:41:53.703208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:53.703151 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.621929767 podStartE2EDuration="6.70313261s" totalImagesPullingTime="3.058892065s" totalInitContainerRuntime="22.310778ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:53.699734481 +0000 UTC m=+87.999254705" watchObservedRunningTime="2026-07-10 18:41:53.70313261 +0000 UTC m=+88.002652831" Jul 10 18:41:55.659239 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:55.659212 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8679f9d5f4-nmmsn" Jul 10 18:41:55.806435 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:55.806402 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:55.872559 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:55.872524 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:56.877020 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:56.876976 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:56.877577 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:56.877558 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:56.882765 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:56.882742 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:57.248922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.248881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:57.357817 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.357789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:57.470726 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.470697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:57.606728 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.606649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:57.696580 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.696552 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:41:57.762993 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.762956 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84fb58748d-tr69m"] Jul 10 18:41:57.899696 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.899630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:57.998685 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:57.998647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:58.100815 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:58.100785 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:58.274897 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:41:58.274852 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:42:00.754887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:00.754854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:00.874842 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:00.874808 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:02.057233 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:02.057201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:02.126652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:02.126619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:05.331739 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:05.331657 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:05.396393 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:05.396343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:06.510736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:06.510687 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:42:06.511167 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:06.510760 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:42:08.544353 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:08.544325 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cwwx2" Jul 10 18:42:11.541275 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:11.541228 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-748c8878fb-fln92" podUID="25bf746d-df45-43ed-a199-6d78b3f68b29" containerName="console" containerID="cri-o://043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2" gracePeriod=15 Jul 10 18:42:12.315132 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.315102 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:42:12.363709 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.363675 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2skrr\" (UniqueName: \"kubernetes.io/projected/25bf746d-df45-43ed-a199-6d78b3f68b29-kube-api-access-2skrr\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.363905 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.363733 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-trusted-ca-bundle\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.363905 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.363757 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-service-ca\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.363905 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.363866 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-oauth-config\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.364112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.363952 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-console-config\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.364112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364001 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-oauth-serving-cert\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.364112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364070 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-serving-cert\") pod \"25bf746d-df45-43ed-a199-6d78b3f68b29\" (UID: \"25bf746d-df45-43ed-a199-6d78b3f68b29\") " Jul 10 18:42:12.364351 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364198 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-service-ca" (OuterVolumeSpecName: "service-ca") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:12.364351 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364205 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:12.364523 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364404 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.364523 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364422 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-service-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.364627 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364552 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:12.364731 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.364708 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-console-config" (OuterVolumeSpecName: "console-config") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:12.366279 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.366245 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bf746d-df45-43ed-a199-6d78b3f68b29-kube-api-access-2skrr" (OuterVolumeSpecName: "kube-api-access-2skrr") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "kube-api-access-2skrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:42:12.366279 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.366264 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:12.366425 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.366250 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25bf746d-df45-43ed-a199-6d78b3f68b29" (UID: "25bf746d-df45-43ed-a199-6d78b3f68b29"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:12.465749 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.465719 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-console-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.465749 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.465746 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25bf746d-df45-43ed-a199-6d78b3f68b29-oauth-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.465749 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.465756 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.465975 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.465765 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2skrr\" (UniqueName: \"kubernetes.io/projected/25bf746d-df45-43ed-a199-6d78b3f68b29-kube-api-access-2skrr\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.465975 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.465773 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25bf746d-df45-43ed-a199-6d78b3f68b29-console-oauth-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:12.757207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.757095 2575 generic.go:356] "Generic (PLEG): container finished" podID="25bf746d-df45-43ed-a199-6d78b3f68b29" containerID="043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2" exitCode=0 Jul 10 18:42:12.757207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.757133 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748c8878fb-fln92" event={"ID":"25bf746d-df45-43ed-a199-6d78b3f68b29","Type":"ContainerDied","Data":"043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2"} Jul 10 18:42:12.757207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.757207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748c8878fb-fln92" event={"ID":"25bf746d-df45-43ed-a199-6d78b3f68b29","Type":"ContainerDied","Data":"bf366f96526daf00502b4e950a4fe7652834b2056612342eba4fde97413fc860"} Jul 10 18:42:12.757715 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.757151 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748c8878fb-fln92" Jul 10 18:42:12.757715 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.757235 2575 scope.go:117] "RemoveContainer" containerID="043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2" Jul 10 18:42:12.766468 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.766449 2575 scope.go:117] "RemoveContainer" containerID="043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2" Jul 10 18:42:12.766766 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:42:12.766743 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2\": container with ID starting with 043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2 not found: ID does not exist" containerID="043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2" Jul 10 18:42:12.766834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.766780 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2"} err="failed to get container status \"043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2\": rpc error: code = NotFound desc = could not find container \"043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2\": container with ID starting with 043e0b6010796d54230c842411e21cf91edac26daaabe877d9f9d9884ee379b2 not found: ID does not exist" Jul 10 18:42:12.778339 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.778309 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748c8878fb-fln92"] Jul 10 18:42:12.782380 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:12.782358 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-748c8878fb-fln92"] Jul 10 18:42:14.189588 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:14.189549 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25bf746d-df45-43ed-a199-6d78b3f68b29" path="/var/lib/kubelet/pods/25bf746d-df45-43ed-a199-6d78b3f68b29/volumes" Jul 10 18:42:15.765665 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:15.765628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:15.830710 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:15.830673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:22.783035 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:22.782953 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84fb58748d-tr69m" podUID="ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" containerName="console" containerID="cri-o://b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5" gracePeriod=15 Jul 10 18:42:23.079971 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.079934 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:42:23.161966 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.161931 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-oauth-serving-cert\") pod \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " Jul 10 18:42:23.161966 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.161974 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58bjs\" (UniqueName: \"kubernetes.io/projected/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-kube-api-access-58bjs\") pod \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " Jul 10 18:42:23.162208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162001 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-config\") pod \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " Jul 10 18:42:23.162208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162029 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-serving-cert\") pod \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " Jul 10 18:42:23.162208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162078 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-service-ca\") pod \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " Jul 10 18:42:23.162208 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-oauth-config\") pod \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\" (UID: \"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778\") " Jul 10 18:42:23.162482 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162451 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" (UID: "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:23.162544 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162454 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-config" (OuterVolumeSpecName: "console-config") pod "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" (UID: "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:23.162585 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.162530 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-service-ca" (OuterVolumeSpecName: "service-ca") pod "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" (UID: "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:23.164414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.164379 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" (UID: "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:23.164524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.164457 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" (UID: "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:23.164592 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.164564 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-kube-api-access-58bjs" (OuterVolumeSpecName: "kube-api-access-58bjs") pod "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" (UID: "ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778"). InnerVolumeSpecName "kube-api-access-58bjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:42:23.263305 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.263265 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-oauth-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:23.263305 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.263297 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58bjs\" (UniqueName: \"kubernetes.io/projected/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-kube-api-access-58bjs\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:23.263305 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.263309 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:23.263549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.263318 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:23.263549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.263327 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-service-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:23.263549 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.263335 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778-console-oauth-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:42:23.806960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.806921 2575 generic.go:356] "Generic (PLEG): container finished" podID="ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" containerID="b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5" exitCode=0 Jul 10 18:42:23.807391 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.806977 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb58748d-tr69m" Jul 10 18:42:23.807391 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.807017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb58748d-tr69m" event={"ID":"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778","Type":"ContainerDied","Data":"b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5"} Jul 10 18:42:23.807391 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.807074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb58748d-tr69m" event={"ID":"ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778","Type":"ContainerDied","Data":"2d3baa1e18fd1570f418e80ee778676fcf3b08f9589a84f138bed15df4c96e22"} Jul 10 18:42:23.807391 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.807108 2575 scope.go:117] "RemoveContainer" containerID="b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5" Jul 10 18:42:23.815585 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.815568 2575 scope.go:117] "RemoveContainer" containerID="b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5" Jul 10 18:42:23.815881 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:42:23.815861 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5\": container with ID starting with b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5 not found: ID does not exist" containerID="b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5" Jul 10 18:42:23.815925 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.815891 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5"} err="failed to get container status \"b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5\": rpc error: code = NotFound desc = could not find container \"b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5\": container with ID starting with b9be4d12ca64d55ea3fc4a0025d0644e8bc0b25ad10fc4028e673689a1ba45a5 not found: ID does not exist" Jul 10 18:42:23.828392 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.828358 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84fb58748d-tr69m"] Jul 10 18:42:23.832593 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:23.832564 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84fb58748d-tr69m"] Jul 10 18:42:24.189363 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:24.189332 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" path="/var/lib/kubelet/pods/ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778/volumes" Jul 10 18:42:26.515623 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:26.515597 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:42:26.519504 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:26.519480 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d75498d-dmj8b" Jul 10 18:42:48.275245 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:48.275210 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:42:48.295056 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:48.295032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:42:48.932400 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:42:48.932373 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:01.000846 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:01.000799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:01.336401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:01.336280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:02.128572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.128534 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:43:02.129000 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.128822 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="alertmanager" containerID="cri-o://f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110" gracePeriod=120 Jul 10 18:43:02.129000 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.128914 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-metric" containerID="cri-o://447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4" gracePeriod=120 Jul 10 18:43:02.129000 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.128940 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-web" containerID="cri-o://7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819" gracePeriod=120 Jul 10 18:43:02.129190 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.128979 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="prom-label-proxy" containerID="cri-o://be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c" gracePeriod=120 Jul 10 18:43:02.129190 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.129002 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy" containerID="cri-o://d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2" gracePeriod=120 Jul 10 18:43:02.129190 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.128977 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="config-reloader" containerID="cri-o://75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454" gracePeriod=120 Jul 10 18:43:02.976762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976728 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c" exitCode=0 Jul 10 18:43:02.976762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976755 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2" exitCode=0 Jul 10 18:43:02.976762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976763 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454" exitCode=0 Jul 10 18:43:02.976762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976769 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110" exitCode=0 Jul 10 18:43:02.977018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976800 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c"} Jul 10 18:43:02.977018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2"} Jul 10 18:43:02.977018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454"} Jul 10 18:43:02.977018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:02.976917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110"} Jul 10 18:43:03.380233 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.380203 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:03.419620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419600 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-out\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419636 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-tls-assets\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419662 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-web\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419691 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-volume\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419717 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-cluster-tls-config\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419771 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419808 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-metrics-client-ca\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419866 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419922 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-main-db\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.419982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.419947 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-web-config\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.420349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.420324 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.420425 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.420357 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.420425 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.420388 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:03.420721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.420698 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:43:03.427171 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.421799 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvxhf\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-kube-api-access-qvxhf\") pod \"b0cafd28-cf74-4adc-a4ea-d9e970574178\" (UID: \"b0cafd28-cf74-4adc-a4ea-d9e970574178\") " Jul 10 18:43:03.427171 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.422104 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-metrics-client-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.427171 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.422121 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-main-db\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.427171 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.424226 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:03.428519 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.428489 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:43:03.428623 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.428553 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-volume" (OuterVolumeSpecName: "config-volume") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.428691 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.428663 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-out" (OuterVolumeSpecName: "config-out") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:43:03.428691 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.428663 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.428920 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.428880 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.428996 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.428964 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.429592 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.429470 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-kube-api-access-qvxhf" (OuterVolumeSpecName: "kube-api-access-qvxhf") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "kube-api-access-qvxhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:43:03.430120 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.430057 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.431570 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.431547 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.440280 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.440251 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-web-config" (OuterVolumeSpecName: "web-config") pod "b0cafd28-cf74-4adc-a4ea-d9e970574178" (UID: "b0cafd28-cf74-4adc-a4ea-d9e970574178"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522760 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvxhf\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-kube-api-access-qvxhf\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522789 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-out\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522798 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0cafd28-cf74-4adc-a4ea-d9e970574178-tls-assets\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522808 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522818 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-config-volume\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522826 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-cluster-tls-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.522834 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522835 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-main-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.523165 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522844 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.523165 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522852 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-web-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.523165 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522861 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0cafd28-cf74-4adc-a4ea-d9e970574178-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.523165 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.522869 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0cafd28-cf74-4adc-a4ea-d9e970574178-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:03.989401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989370 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4" exitCode=0 Jul 10 18:43:03.989401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989394 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerID="7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819" exitCode=0 Jul 10 18:43:03.989647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989456 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:03.989647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4"} Jul 10 18:43:03.989647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819"} Jul 10 18:43:03.989647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b0cafd28-cf74-4adc-a4ea-d9e970574178","Type":"ContainerDied","Data":"1a8899483fd07186f49586707c46e223978528e61b80baae0a2edcbe6f06cbc2"} Jul 10 18:43:03.989647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.989610 2575 scope.go:117] "RemoveContainer" containerID="be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c" Jul 10 18:43:03.998158 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:03.998128 2575 scope.go:117] "RemoveContainer" containerID="447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4" Jul 10 18:43:04.004848 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.004830 2575 scope.go:117] "RemoveContainer" containerID="d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2" Jul 10 18:43:04.011385 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.011368 2575 scope.go:117] "RemoveContainer" containerID="7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819" Jul 10 18:43:04.017732 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.017708 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:43:04.019061 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.019035 2575 scope.go:117] "RemoveContainer" containerID="75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454" Jul 10 18:43:04.024652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.024628 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:43:04.026639 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.026624 2575 scope.go:117] "RemoveContainer" containerID="f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110" Jul 10 18:43:04.033524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.033509 2575 scope.go:117] "RemoveContainer" containerID="ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645" Jul 10 18:43:04.040224 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040208 2575 scope.go:117] "RemoveContainer" containerID="be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c" Jul 10 18:43:04.040453 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.040437 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c\": container with ID starting with be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c not found: ID does not exist" containerID="be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c" Jul 10 18:43:04.040498 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040470 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c"} err="failed to get container status \"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c\": rpc error: code = NotFound desc = could not find container \"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c\": container with ID starting with be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c not found: ID does not exist" Jul 10 18:43:04.040498 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040487 2575 scope.go:117] "RemoveContainer" containerID="447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4" Jul 10 18:43:04.040710 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.040694 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4\": container with ID starting with 447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4 not found: ID does not exist" containerID="447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4" Jul 10 18:43:04.040745 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040714 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4"} err="failed to get container status \"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4\": rpc error: code = NotFound desc = could not find container \"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4\": container with ID starting with 447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4 not found: ID does not exist" Jul 10 18:43:04.040745 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040728 2575 scope.go:117] "RemoveContainer" containerID="d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2" Jul 10 18:43:04.040929 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.040916 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2\": container with ID starting with d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2 not found: ID does not exist" containerID="d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2" Jul 10 18:43:04.040963 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040933 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2"} err="failed to get container status \"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2\": rpc error: code = NotFound desc = could not find container \"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2\": container with ID starting with d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2 not found: ID does not exist" Jul 10 18:43:04.040963 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.040945 2575 scope.go:117] "RemoveContainer" containerID="7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819" Jul 10 18:43:04.041226 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.041208 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819\": container with ID starting with 7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819 not found: ID does not exist" containerID="7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819" Jul 10 18:43:04.041297 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041234 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819"} err="failed to get container status \"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819\": rpc error: code = NotFound desc = could not find container \"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819\": container with ID starting with 7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819 not found: ID does not exist" Jul 10 18:43:04.041297 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041256 2575 scope.go:117] "RemoveContainer" containerID="75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454" Jul 10 18:43:04.041467 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.041451 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454\": container with ID starting with 75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454 not found: ID does not exist" containerID="75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454" Jul 10 18:43:04.041506 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041472 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454"} err="failed to get container status \"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454\": rpc error: code = NotFound desc = could not find container \"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454\": container with ID starting with 75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454 not found: ID does not exist" Jul 10 18:43:04.041506 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041487 2575 scope.go:117] "RemoveContainer" containerID="f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110" Jul 10 18:43:04.041671 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.041656 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110\": container with ID starting with f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110 not found: ID does not exist" containerID="f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110" Jul 10 18:43:04.041712 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041674 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110"} err="failed to get container status \"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110\": rpc error: code = NotFound desc = could not find container \"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110\": container with ID starting with f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110 not found: ID does not exist" Jul 10 18:43:04.041712 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041686 2575 scope.go:117] "RemoveContainer" containerID="ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645" Jul 10 18:43:04.041899 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:04.041883 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645\": container with ID starting with ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645 not found: ID does not exist" containerID="ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645" Jul 10 18:43:04.041958 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041908 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645"} err="failed to get container status \"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645\": rpc error: code = NotFound desc = could not find container \"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645\": container with ID starting with ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645 not found: ID does not exist" Jul 10 18:43:04.041958 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.041928 2575 scope.go:117] "RemoveContainer" containerID="be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c" Jul 10 18:43:04.042229 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042210 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c"} err="failed to get container status \"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c\": rpc error: code = NotFound desc = could not find container \"be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c\": container with ID starting with be4e4c67451bd97a577ef1220edf17cd09ff0c481bdf2ae0e9e89ff839187a6c not found: ID does not exist" Jul 10 18:43:04.042229 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042229 2575 scope.go:117] "RemoveContainer" containerID="447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4" Jul 10 18:43:04.042424 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042410 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4"} err="failed to get container status \"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4\": rpc error: code = NotFound desc = could not find container \"447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4\": container with ID starting with 447446e0f0cb8d11fddfab16a1bac15dd3c8c737fe8dcb5aa18c832f0c4bfbd4 not found: ID does not exist" Jul 10 18:43:04.042424 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042424 2575 scope.go:117] "RemoveContainer" containerID="d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2" Jul 10 18:43:04.042643 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042627 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2"} err="failed to get container status \"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2\": rpc error: code = NotFound desc = could not find container \"d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2\": container with ID starting with d9ba0d5e13a808fa23cb65979048200a551699371c07b7aab9f0662274d4f6c2 not found: ID does not exist" Jul 10 18:43:04.042708 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042645 2575 scope.go:117] "RemoveContainer" containerID="7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819" Jul 10 18:43:04.042859 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042844 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819"} err="failed to get container status \"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819\": rpc error: code = NotFound desc = could not find container \"7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819\": container with ID starting with 7c20c9692e8ebe0304054cf90c2e5647d0d11fab812650ce09bb67d023b37819 not found: ID does not exist" Jul 10 18:43:04.042908 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.042859 2575 scope.go:117] "RemoveContainer" containerID="75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454" Jul 10 18:43:04.043064 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.043045 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454"} err="failed to get container status \"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454\": rpc error: code = NotFound desc = could not find container \"75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454\": container with ID starting with 75196de32a8e903b96080dabd984e6777c4abf6569f4fc3c618032d0d5d89454 not found: ID does not exist" Jul 10 18:43:04.043140 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.043065 2575 scope.go:117] "RemoveContainer" containerID="f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110" Jul 10 18:43:04.043277 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.043262 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110"} err="failed to get container status \"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110\": rpc error: code = NotFound desc = could not find container \"f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110\": container with ID starting with f8b6d407a3e84221716cb89ab5ee951c380f489450e3c61e792dc7d6bd08f110 not found: ID does not exist" Jul 10 18:43:04.043325 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.043277 2575 scope.go:117] "RemoveContainer" containerID="ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645" Jul 10 18:43:04.043451 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.043434 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645"} err="failed to get container status \"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645\": rpc error: code = NotFound desc = could not find container \"ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645\": container with ID starting with ca678ef9590394ce0ed5349001e04ada16a194f80266acb50d5abb97ab6d3645 not found: ID does not exist" Jul 10 18:43:04.071797 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.071773 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:43:04.072162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072146 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="config-reloader" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072164 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="config-reloader" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072179 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-web" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072188 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-web" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072196 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="prom-label-proxy" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072204 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="prom-label-proxy" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072216 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25bf746d-df45-43ed-a199-6d78b3f68b29" containerName="console" Jul 10 18:43:04.072244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072225 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="25bf746d-df45-43ed-a199-6d78b3f68b29" containerName="console" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072247 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-metric" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072256 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-metric" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072268 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="init-config-reloader" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072277 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="init-config-reloader" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072285 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="alertmanager" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072294 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="alertmanager" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072306 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" containerName="console" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072314 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" containerName="console" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072323 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072330 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072406 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd24bd9-2cc0-4bcf-b44c-3a33ee2f2778" containerName="console" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072418 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="25bf746d-df45-43ed-a199-6d78b3f68b29" containerName="console" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072427 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="prom-label-proxy" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072440 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="alertmanager" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072449 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="config-reloader" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072456 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-metric" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072464 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy" Jul 10 18:43:04.072557 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.072472 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" containerName="kube-rbac-proxy-web" Jul 10 18:43:04.079194 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.079175 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.081950 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.081932 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:43:04.085334 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.085317 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:43:04.085573 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.085484 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:43:04.085922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.085902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:43:04.094581 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.094566 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:43:04.094581 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.094572 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cmp55\"" Jul 10 18:43:04.095036 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.095020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:43:04.115202 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.115179 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:43:04.115288 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.115217 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:43:04.115769 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.115756 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:43:04.122885 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.122862 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:43:04.128110 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33eba4c4-e3b7-412b-af9c-9db67b014b64-config-out\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128145 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33eba4c4-e3b7-412b-af9c-9db67b014b64-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nwzk\" (UniqueName: \"kubernetes.io/projected/33eba4c4-e3b7-412b-af9c-9db67b014b64-kube-api-access-7nwzk\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33eba4c4-e3b7-412b-af9c-9db67b014b64-tls-assets\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128322 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-config-volume\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/33eba4c4-e3b7-412b-af9c-9db67b014b64-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-web-config\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.128644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.128574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33eba4c4-e3b7-412b-af9c-9db67b014b64-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.188337 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.188309 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0cafd28-cf74-4adc-a4ea-d9e970574178" path="/var/lib/kubelet/pods/b0cafd28-cf74-4adc-a4ea-d9e970574178/volumes" Jul 10 18:43:04.229897 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.229858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.229897 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.229896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33eba4c4-e3b7-412b-af9c-9db67b014b64-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.229923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33eba4c4-e3b7-412b-af9c-9db67b014b64-config-out\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.229946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.229964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33eba4c4-e3b7-412b-af9c-9db67b014b64-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.229982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nwzk\" (UniqueName: \"kubernetes.io/projected/33eba4c4-e3b7-412b-af9c-9db67b014b64-kube-api-access-7nwzk\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33eba4c4-e3b7-412b-af9c-9db67b014b64-tls-assets\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-config-volume\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230074 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/33eba4c4-e3b7-412b-af9c-9db67b014b64-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.230423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-web-config\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.231060 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230723 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33eba4c4-e3b7-412b-af9c-9db67b014b64-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.231060 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.230906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33eba4c4-e3b7-412b-af9c-9db67b014b64-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.231854 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.231798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/33eba4c4-e3b7-412b-af9c-9db67b014b64-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.232871 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.232844 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33eba4c4-e3b7-412b-af9c-9db67b014b64-config-out\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.233005 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.232976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.233150 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.233111 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.233446 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.233388 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.233635 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.233607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-config-volume\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.233774 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.233740 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.233950 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.233927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-web-config\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.234015 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.233999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33eba4c4-e3b7-412b-af9c-9db67b014b64-tls-assets\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.234636 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.234619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/33eba4c4-e3b7-412b-af9c-9db67b014b64-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.240382 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.240323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nwzk\" (UniqueName: \"kubernetes.io/projected/33eba4c4-e3b7-412b-af9c-9db67b014b64-kube-api-access-7nwzk\") pod \"alertmanager-main-0\" (UID: \"33eba4c4-e3b7-412b-af9c-9db67b014b64\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.387971 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.387938 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:43:04.538445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.538365 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:43:04.542058 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:43:04.542031 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33eba4c4_e3b7_412b_af9c_9db67b014b64.slice/crio-e1cf16b433c9cd9bc5d502e714baccc738e01f5ae5f99d19ca398693fbacf49a WatchSource:0}: Error finding container e1cf16b433c9cd9bc5d502e714baccc738e01f5ae5f99d19ca398693fbacf49a: Status 404 returned error can't find the container with id e1cf16b433c9cd9bc5d502e714baccc738e01f5ae5f99d19ca398693fbacf49a Jul 10 18:43:04.994835 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.994800 2575 generic.go:356] "Generic (PLEG): container finished" podID="33eba4c4-e3b7-412b-af9c-9db67b014b64" containerID="63d8801dccad3bc83441121443212b0a92c6f29c053a1c6ccfb161b20607720d" exitCode=0 Jul 10 18:43:04.995017 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.994891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerDied","Data":"63d8801dccad3bc83441121443212b0a92c6f29c053a1c6ccfb161b20607720d"} Jul 10 18:43:04.995017 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:04.994958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"e1cf16b433c9cd9bc5d502e714baccc738e01f5ae5f99d19ca398693fbacf49a"} Jul 10 18:43:06.003373 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.003336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"7e36034c10cbaba32bf0155cd03861540eaa9e2d49a91883c6bad67cdb97d67f"} Jul 10 18:43:06.003823 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.003428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"c2a589f03d689a968a18c1c4f1b0f3d2f8b038334d1ba640397864cdfb078d0b"} Jul 10 18:43:06.003823 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.003459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"934733f94be3a42feafc3b4b2386334089cc69f06a25c6891a50048069724455"} Jul 10 18:43:06.003823 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.003485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"af1ced539fcf9e6b72d90ad1d2d56bb15b6d338b80a5ac320a627cf293e8be18"} Jul 10 18:43:06.003823 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.003508 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"7baf1e606c6ba15b5fefb8552c49150ee8f181da2a9e724152702d4b5de3b7b2"} Jul 10 18:43:06.003823 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.003530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"33eba4c4-e3b7-412b-af9c-9db67b014b64","Type":"ContainerStarted","Data":"1ffc02c73a568bbe098ff4418759b3e1b99a5143f4f3c74436aa5c9d6b3151b2"} Jul 10 18:43:06.062394 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.062329 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.047782774 podStartE2EDuration="2.062309446s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.526672ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:43:06.059874298 +0000 UTC m=+160.359394548" watchObservedRunningTime="2026-07-10 18:43:06.062309446 +0000 UTC m=+160.361829667" Jul 10 18:43:06.153607 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.153567 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78655945f4-hxgjg"] Jul 10 18:43:06.158217 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.158191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.164899 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.164866 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 18:43:06.165020 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.164993 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 18:43:06.165611 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.165460 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 18:43:06.165690 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.165620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 18:43:06.165831 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.165817 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wl4lg\"" Jul 10 18:43:06.168310 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.168289 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 18:43:06.177038 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.176950 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 18:43:06.226499 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.226469 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78655945f4-hxgjg"] Jul 10 18:43:06.250132 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pstn\" (UniqueName: \"kubernetes.io/projected/a08aaede-49fd-47a1-8f17-bb15f2452679-kube-api-access-7pstn\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250271 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250271 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-secret-telemeter-client\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250358 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-metrics-client-ca\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250358 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-serving-certs-ca-bundle\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250358 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-telemeter-client-tls\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250446 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.250446 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.250410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-federate-client-tls\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351290 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351290 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-secret-telemeter-client\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-metrics-client-ca\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-serving-certs-ca-bundle\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-telemeter-client-tls\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-federate-client-tls\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.351537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.351514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pstn\" (UniqueName: \"kubernetes.io/projected/a08aaede-49fd-47a1-8f17-bb15f2452679-kube-api-access-7pstn\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.352212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.352191 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.352330 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.352216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-metrics-client-ca\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.352330 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.352216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08aaede-49fd-47a1-8f17-bb15f2452679-serving-certs-ca-bundle\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.354195 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.354162 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.354455 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.354434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-federate-client-tls\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.354524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.354451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-secret-telemeter-client\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.354524 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.354451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a08aaede-49fd-47a1-8f17-bb15f2452679-telemeter-client-tls\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.362397 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.362377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pstn\" (UniqueName: \"kubernetes.io/projected/a08aaede-49fd-47a1-8f17-bb15f2452679-kube-api-access-7pstn\") pod \"telemeter-client-78655945f4-hxgjg\" (UID: \"a08aaede-49fd-47a1-8f17-bb15f2452679\") " pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.468693 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.468653 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" Jul 10 18:43:06.485423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.485394 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:43:06.485867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.485777 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="prometheus" containerID="cri-o://567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" gracePeriod=600 Jul 10 18:43:06.486257 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.486228 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" gracePeriod=600 Jul 10 18:43:06.486418 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.486358 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy" containerID="cri-o://f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" gracePeriod=600 Jul 10 18:43:06.486499 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.486470 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-web" containerID="cri-o://ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" gracePeriod=600 Jul 10 18:43:06.486637 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.486555 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="thanos-sidecar" containerID="cri-o://d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" gracePeriod=600 Jul 10 18:43:06.486694 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.486647 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="config-reloader" containerID="cri-o://ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" gracePeriod=600 Jul 10 18:43:06.647638 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.647606 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78655945f4-hxgjg"] Jul 10 18:43:06.650646 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:43:06.650602 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08aaede_49fd_47a1_8f17_bb15f2452679.slice/crio-e3fabbc74df79616992b7d24175d6706d1b5504eaaff482533eaca5a20b5bf30 WatchSource:0}: Error finding container e3fabbc74df79616992b7d24175d6706d1b5504eaaff482533eaca5a20b5bf30: Status 404 returned error can't find the container with id e3fabbc74df79616992b7d24175d6706d1b5504eaaff482533eaca5a20b5bf30 Jul 10 18:43:06.755825 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.755799 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856074 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-0\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856150 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config-out\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856195 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-serving-certs-ca-bundle\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856221 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-grpc-tls\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856248 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-kube-rbac-proxy\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856293 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-2\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856347 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-web-config\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856414 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-thanos-prometheus-http-client-file\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856463 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856487 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-metrics-client-certs\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856509 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-trusted-ca-bundle\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856532 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856556 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856580 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-metrics-client-ca\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856611 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc8wp\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-kube-api-access-cc8wp\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856637 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-tls\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856660 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-kubelet-serving-ca-bundle\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.856973 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856686 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-tls-assets\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.857994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856718 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-db\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.857994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.856759 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-1\") pod \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\" (UID: \"a8cd3250-165b-446f-9cbf-8926b1dd74d0\") " Jul 10 18:43:06.857994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.857173 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.857994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.857503 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.857994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.857585 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.860052 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.859772 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-kube-api-access-cc8wp" (OuterVolumeSpecName: "kube-api-access-cc8wp") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "kube-api-access-cc8wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:43:06.860052 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.860020 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.860316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.860172 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.860316 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.860240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config-out" (OuterVolumeSpecName: "config-out") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:43:06.860511 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.860483 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.860635 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.860612 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.861354 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.861136 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.861863 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.861594 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.862457 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.862102 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.862457 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.862186 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:06.862957 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.862898 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.863662 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.863627 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:43:06.863974 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.863944 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:43:06.864076 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.864019 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.864309 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.864269 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.864558 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.864540 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config" (OuterVolumeSpecName: "config") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.865005 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.864988 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.872401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.872380 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-web-config" (OuterVolumeSpecName: "web-config") pod "a8cd3250-165b-446f-9cbf-8926b1dd74d0" (UID: "a8cd3250-165b-446f-9cbf-8926b1dd74d0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:06.958023 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.957986 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958023 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958017 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-web-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958023 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958029 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958039 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958048 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-metrics-client-certs\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958057 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958066 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958075 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958104 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-metrics-client-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958117 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc8wp\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-kube-api-access-cc8wp\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958125 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958133 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958141 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8cd3250-165b-446f-9cbf-8926b1dd74d0-tls-assets\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958149 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-db\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958157 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958165 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8cd3250-165b-446f-9cbf-8926b1dd74d0-config-out\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958173 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cd3250-165b-446f-9cbf-8926b1dd74d0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958180 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-grpc-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:06.958296 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:06.958188 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8cd3250-165b-446f-9cbf-8926b1dd74d0-secret-kube-rbac-proxy\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:07.008334 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.008293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" event={"ID":"a08aaede-49fd-47a1-8f17-bb15f2452679","Type":"ContainerStarted","Data":"e3fabbc74df79616992b7d24175d6706d1b5504eaaff482533eaca5a20b5bf30"} Jul 10 18:43:07.011207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011181 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" exitCode=0 Jul 10 18:43:07.011207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011203 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" exitCode=0 Jul 10 18:43:07.011207 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011209 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" exitCode=0 Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011215 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" exitCode=0 Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011220 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" exitCode=0 Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011226 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" exitCode=0 Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011270 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} Jul 10 18:43:07.011395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011396 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} Jul 10 18:43:07.011663 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} Jul 10 18:43:07.011663 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011411 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.011663 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.011443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8cd3250-165b-446f-9cbf-8926b1dd74d0","Type":"ContainerDied","Data":"d030a6217a190e9ca4a1119499121700c67e0f3416b45934ef0b8f454c996484"} Jul 10 18:43:07.019477 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.019455 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.026687 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.026673 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.033566 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.033550 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.042067 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.042003 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.042197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.042145 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:43:07.049754 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.049730 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.058427 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.058404 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.063602 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.063571 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:43:07.068134 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.068112 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.068460 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.068436 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.068538 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.068471 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} err="failed to get container status \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" Jul 10 18:43:07.068538 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.068497 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.068803 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.068785 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.068868 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.068810 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} err="failed to get container status \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" Jul 10 18:43:07.068868 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.068831 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.069152 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.069131 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.069238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.069159 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} err="failed to get container status \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" Jul 10 18:43:07.069238 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.069181 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.069492 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.069475 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.069551 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.069500 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} err="failed to get container status \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" Jul 10 18:43:07.069551 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.069515 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.069781 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.069764 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.069845 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.069784 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} err="failed to get container status \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" Jul 10 18:43:07.069845 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.069801 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.070076 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.070057 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.070245 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070077 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} err="failed to get container status \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" Jul 10 18:43:07.070245 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070169 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.070444 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:07.070425 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.070503 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070453 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} err="failed to get container status \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" Jul 10 18:43:07.070503 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070468 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.070762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070721 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} err="failed to get container status \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" Jul 10 18:43:07.070762 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070747 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.070987 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070969 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} err="failed to get container status \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" Jul 10 18:43:07.071051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.070988 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.071228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071212 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} err="failed to get container status \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" Jul 10 18:43:07.071285 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071229 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.071461 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071434 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} err="failed to get container status \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" Jul 10 18:43:07.071461 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071457 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.071718 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071695 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} err="failed to get container status \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" Jul 10 18:43:07.071779 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071721 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.071968 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071948 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} err="failed to get container status \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" Jul 10 18:43:07.072037 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.071971 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.072232 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072214 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} err="failed to get container status \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" Jul 10 18:43:07.072295 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072232 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.072485 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072468 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} err="failed to get container status \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" Jul 10 18:43:07.072550 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072485 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.072736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072719 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} err="failed to get container status \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" Jul 10 18:43:07.072780 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072735 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.072963 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072939 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} err="failed to get container status \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" Jul 10 18:43:07.073134 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.072965 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.073268 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073239 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} err="failed to get container status \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" Jul 10 18:43:07.073358 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073268 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.073505 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073488 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} err="failed to get container status \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" Jul 10 18:43:07.073582 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073506 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.073777 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073747 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} err="failed to get container status \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" Jul 10 18:43:07.073777 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073768 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.074004 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.073981 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} err="failed to get container status \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" Jul 10 18:43:07.074061 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074007 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.074265 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074241 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} err="failed to get container status \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" Jul 10 18:43:07.074335 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074266 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.074553 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074533 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} err="failed to get container status \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" Jul 10 18:43:07.074553 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074551 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.074792 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074771 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} err="failed to get container status \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" Jul 10 18:43:07.074867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.074792 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.075068 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075042 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} err="failed to get container status \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" Jul 10 18:43:07.075068 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075063 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.075327 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075310 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} err="failed to get container status \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" Jul 10 18:43:07.075384 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075329 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.075578 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075559 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} err="failed to get container status \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" Jul 10 18:43:07.075648 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075579 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.075838 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075812 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} err="failed to get container status \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" Jul 10 18:43:07.075838 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.075838 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.076112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076067 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} err="failed to get container status \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" Jul 10 18:43:07.076165 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076113 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.076398 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076374 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} err="failed to get container status \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" Jul 10 18:43:07.076398 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076397 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.076638 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076619 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} err="failed to get container status \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" Jul 10 18:43:07.076699 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076640 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.076882 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076866 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} err="failed to get container status \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" Jul 10 18:43:07.076941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.076884 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.077162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077143 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} err="failed to get container status \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" Jul 10 18:43:07.077239 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077162 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.077392 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077368 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} err="failed to get container status \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" Jul 10 18:43:07.077392 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077392 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.077602 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077582 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} err="failed to get container status \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" Jul 10 18:43:07.077664 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077605 2575 scope.go:117] "RemoveContainer" containerID="b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9" Jul 10 18:43:07.077847 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077817 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9"} err="failed to get container status \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": rpc error: code = NotFound desc = could not find container \"b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9\": container with ID starting with b0d3d949d485d86b0b631b6f7602fd723bbb8df6b0c7fc95614f985ddd45fba9 not found: ID does not exist" Jul 10 18:43:07.077946 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.077847 2575 scope.go:117] "RemoveContainer" containerID="f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf" Jul 10 18:43:07.078127 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078104 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf"} err="failed to get container status \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": rpc error: code = NotFound desc = could not find container \"f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf\": container with ID starting with f68a12596ff18e59e9f4f6a7220f817965ec98c1115284f2d15a06e3c110afbf not found: ID does not exist" Jul 10 18:43:07.078191 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078130 2575 scope.go:117] "RemoveContainer" containerID="ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8" Jul 10 18:43:07.078389 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078369 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8"} err="failed to get container status \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": rpc error: code = NotFound desc = could not find container \"ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8\": container with ID starting with ab4e5aa7a193000c4e23e1c44c2469bb59066afefa07b402bc38cfc6c10455e8 not found: ID does not exist" Jul 10 18:43:07.078449 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078389 2575 scope.go:117] "RemoveContainer" containerID="d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75" Jul 10 18:43:07.078640 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078617 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75"} err="failed to get container status \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": rpc error: code = NotFound desc = could not find container \"d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75\": container with ID starting with d85e116fdb0432f1eb30d8e8d40dc1ecebb30411b78f09a3455c686eb8875c75 not found: ID does not exist" Jul 10 18:43:07.078640 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078639 2575 scope.go:117] "RemoveContainer" containerID="ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce" Jul 10 18:43:07.078912 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078880 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce"} err="failed to get container status \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": rpc error: code = NotFound desc = could not find container \"ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce\": container with ID starting with ba04e0c5d09d52b835369dcd4df017f8fe89db4dd7a24dea2ccc88627c8246ce not found: ID does not exist" Jul 10 18:43:07.078912 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.078908 2575 scope.go:117] "RemoveContainer" containerID="567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170" Jul 10 18:43:07.079198 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.079168 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170"} err="failed to get container status \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": rpc error: code = NotFound desc = could not find container \"567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170\": container with ID starting with 567ada21eed78a950a03bb4244ad19cf588250fde75f25ab35805f30dac4a170 not found: ID does not exist" Jul 10 18:43:07.079270 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.079199 2575 scope.go:117] "RemoveContainer" containerID="bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d" Jul 10 18:43:07.079453 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.079431 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d"} err="failed to get container status \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": rpc error: code = NotFound desc = could not find container \"bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d\": container with ID starting with bf779b79ac94347b2195f837423efe346d7474018951409d18e855c757d3a22d not found: ID does not exist" Jul 10 18:43:07.142601 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142527 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:43:07.142842 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142830 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="prometheus" Jul 10 18:43:07.142887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142843 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="prometheus" Jul 10 18:43:07.142887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142860 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="init-config-reloader" Jul 10 18:43:07.142887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142866 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="init-config-reloader" Jul 10 18:43:07.142887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142874 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="thanos-sidecar" Jul 10 18:43:07.142887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142879 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="thanos-sidecar" Jul 10 18:43:07.142887 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142885 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142891 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142898 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="config-reloader" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142903 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="config-reloader" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142911 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-web" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142916 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-web" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142927 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-thanos" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142932 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-thanos" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142975 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="prometheus" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142983 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-web" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142989 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy-thanos" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.142995 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="config-reloader" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.143000 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="thanos-sidecar" Jul 10 18:43:07.143051 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.143007 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" containerName="kube-rbac-proxy" Jul 10 18:43:07.148033 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.148015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.155034 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155011 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 18:43:07.155148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155011 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 18:43:07.155148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155053 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 18:43:07.155148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155070 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 18:43:07.155148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155073 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 18:43:07.155369 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155351 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 18:43:07.155423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155377 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 18:43:07.155423 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sp9tn\"" Jul 10 18:43:07.155517 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.155466 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 18:43:07.156288 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.156228 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 18:43:07.156288 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.156287 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 18:43:07.156433 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.156300 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-clq3r5ikqk4sd\"" Jul 10 18:43:07.156555 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.156533 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 18:43:07.156628 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.156599 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 18:43:07.163094 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.163060 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 18:43:07.166414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.166393 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 18:43:07.195267 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.195246 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:43:07.261330 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-config\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261754 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261754 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261754 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261754 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s6td\" (UniqueName: \"kubernetes.io/projected/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-kube-api-access-5s6td\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.261941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.262212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.262212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.261993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.262212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.262020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.262212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.262044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.262212 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.262137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.363537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363496 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-config\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.363702 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.363702 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363585 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.363702 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.363702 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.363702 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.364867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.364867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.363729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.365604 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365578 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.365770 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.365847 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.365906 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s6td\" (UniqueName: \"kubernetes.io/projected/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-kube-api-access-5s6td\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.365963 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.365992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366138 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366138 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366242 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366242 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366361 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366361 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.366931 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.367023 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.366925 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.367729 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.367161 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.367729 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.367179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.368123 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-config\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.368342 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.368366 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.368567 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.368990 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.369132 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.369976 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.369932 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.370241 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.370217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.370995 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.370969 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.371286 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.371263 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.371572 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.371529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.371814 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.371792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.372033 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.372013 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.372768 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.372749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.376940 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.376918 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s6td\" (UniqueName: \"kubernetes.io/projected/1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa-kube-api-access-5s6td\") pod \"prometheus-k8s-0\" (UID: \"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.458160 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.458119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:07.633522 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:07.633487 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 18:43:07.637168 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:43:07.637066 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec7c2ab_c62d_4c39_8a7c_78b9d1d75eaa.slice/crio-04fa95a65cd178963997a6b50763d75aa9532834d645799c858ad1cc30986a9f WatchSource:0}: Error finding container 04fa95a65cd178963997a6b50763d75aa9532834d645799c858ad1cc30986a9f: Status 404 returned error can't find the container with id 04fa95a65cd178963997a6b50763d75aa9532834d645799c858ad1cc30986a9f Jul 10 18:43:08.017374 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:08.017333 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"04fa95a65cd178963997a6b50763d75aa9532834d645799c858ad1cc30986a9f"} Jul 10 18:43:08.194760 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:08.194724 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8cd3250-165b-446f-9cbf-8926b1dd74d0" path="/var/lib/kubelet/pods/a8cd3250-165b-446f-9cbf-8926b1dd74d0/volumes" Jul 10 18:43:09.025770 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:09.025732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" event={"ID":"a08aaede-49fd-47a1-8f17-bb15f2452679","Type":"ContainerStarted","Data":"382209e7f4a4f65c373bd4a708ad85a71cf1ce3e6f80de51770872a789a71348"} Jul 10 18:43:09.026272 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:09.025803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" event={"ID":"a08aaede-49fd-47a1-8f17-bb15f2452679","Type":"ContainerStarted","Data":"1da34124783723d4b87d6fd359414d34ba566d2644ddd106b082d3da94a9d3ad"} Jul 10 18:43:09.026272 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:09.025835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" event={"ID":"a08aaede-49fd-47a1-8f17-bb15f2452679","Type":"ContainerStarted","Data":"60be01d0a75f7135607e00e2a43ed4e6cd7eda25577d6bea3b6fc16a850dfebb"} Jul 10 18:43:09.027304 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:09.027280 2575 generic.go:356] "Generic (PLEG): container finished" podID="1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa" containerID="e49d6746832e19361a13b69cf8b460eb440300678512b8994c3825d5aa6276ee" exitCode=0 Jul 10 18:43:09.027401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:09.027375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerDied","Data":"e49d6746832e19361a13b69cf8b460eb440300678512b8994c3825d5aa6276ee"} Jul 10 18:43:09.053586 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:09.053524 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78655945f4-hxgjg" podStartSLOduration=1.585325798 podStartE2EDuration="3.05350179s" totalImagesPullingTime="1.468175992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:43:09.050953164 +0000 UTC m=+163.350473419" watchObservedRunningTime="2026-07-10 18:43:09.05350179 +0000 UTC m=+163.353022017" Jul 10 18:43:10.035561 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.035525 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"bc59a6a624baff6892748e8d64689dfec95b067e9629fd64dbfd9287f15e29da"} Jul 10 18:43:10.036041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.035605 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"7591284d9f8ebe630032f682d9e6ec6d6a56e45023a6131da1a3db2d2bfa4839"} Jul 10 18:43:10.036041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.035649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"0ede975feb494b1d93532c2ebfe84645bca02580181afb501ae467bb4987fdde"} Jul 10 18:43:10.036041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.035699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"d0b7a9ac2a68101eae99f92205b63a80d310145d94cc623fdf471d23278da9ed"} Jul 10 18:43:10.036041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.035738 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"49519175dcd08c459fbb54569029c5d4ae902f800f6ac667deb3d6fbc09c2835"} Jul 10 18:43:10.036041 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.035779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa","Type":"ContainerStarted","Data":"638b2b5095ffce42e86d789b18f4a45d78309268f69e0b7f0f9ec4ea221e2952"} Jul 10 18:43:10.071125 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.071054 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.048861111 podStartE2EDuration="3.071034245s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.173134ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:43:10.068457272 +0000 UTC m=+164.367977518" watchObservedRunningTime="2026-07-10 18:43:10.071034245 +0000 UTC m=+164.370554468" Jul 10 18:43:10.115526 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.115496 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-686c9b877c-7b2p8"] Jul 10 18:43:10.119922 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.119904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.136815 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.136790 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686c9b877c-7b2p8"] Jul 10 18:43:10.195009 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.194974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-oauth-serving-cert\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.195009 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.195007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plk8p\" (UniqueName: \"kubernetes.io/projected/55261f6b-3c37-4f5a-b575-f3865bbd4a10-kube-api-access-plk8p\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.195197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.195080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-serving-cert\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.195197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.195117 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-trusted-ca-bundle\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.195197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.195140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-oauth-config\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.195197 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.195154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-config\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.195335 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.195198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-service-ca\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.203711 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.203684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:10.296038 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.295964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-oauth-serving-cert\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296038 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.295997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plk8p\" (UniqueName: \"kubernetes.io/projected/55261f6b-3c37-4f5a-b575-f3865bbd4a10-kube-api-access-plk8p\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296221 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-serving-cert\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296221 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-trusted-ca-bundle\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296221 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-oauth-config\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296351 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-config\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296351 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296261 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-service-ca\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296799 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-oauth-serving-cert\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296923 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296895 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-service-ca\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.296989 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.296925 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-config\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.297161 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.297141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-trusted-ca-bundle\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.298652 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.298633 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-oauth-config\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.298868 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.298843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-serving-cert\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.309743 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.309722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plk8p\" (UniqueName: \"kubernetes.io/projected/55261f6b-3c37-4f5a-b575-f3865bbd4a10-kube-api-access-plk8p\") pod \"console-686c9b877c-7b2p8\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.387777 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.387747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:10.434939 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.434909 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:10.564209 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:10.564183 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686c9b877c-7b2p8"] Jul 10 18:43:10.566473 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:43:10.566448 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55261f6b_3c37_4f5a_b575_f3865bbd4a10.slice/crio-f59ebcae50336ca3dae756e5e01e03e571fd3d8ed5478dfbe86202719f69676f WatchSource:0}: Error finding container f59ebcae50336ca3dae756e5e01e03e571fd3d8ed5478dfbe86202719f69676f: Status 404 returned error can't find the container with id f59ebcae50336ca3dae756e5e01e03e571fd3d8ed5478dfbe86202719f69676f Jul 10 18:43:11.000827 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:11.000784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:11.041473 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:11.041437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686c9b877c-7b2p8" event={"ID":"55261f6b-3c37-4f5a-b575-f3865bbd4a10","Type":"ContainerStarted","Data":"d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d"} Jul 10 18:43:11.041912 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:11.041488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686c9b877c-7b2p8" event={"ID":"55261f6b-3c37-4f5a-b575-f3865bbd4a10","Type":"ContainerStarted","Data":"f59ebcae50336ca3dae756e5e01e03e571fd3d8ed5478dfbe86202719f69676f"} Jul 10 18:43:11.062956 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:11.062909 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-686c9b877c-7b2p8" podStartSLOduration=1.06289496 podStartE2EDuration="1.06289496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:43:11.061745432 +0000 UTC m=+165.361265679" watchObservedRunningTime="2026-07-10 18:43:11.06289496 +0000 UTC m=+165.362415182" Jul 10 18:43:12.459199 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:12.459158 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:43:20.436042 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:20.435945 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:20.436042 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:20.436014 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:20.440813 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:20.440788 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:21.087074 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:21.087043 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:43:21.144456 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:21.144425 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68557bfb59-44zzk"] Jul 10 18:43:21.274259 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:21.274225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:21.371665 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:21.371590 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:21.441816 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:21.441783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:46.165068 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.165028 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68557bfb59-44zzk" podUID="1d726875-4757-410d-990c-43e97332c086" containerName="console" containerID="cri-o://772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8" gracePeriod=15 Jul 10 18:43:46.413287 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.413263 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:43:46.526700 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526667 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-service-ca\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.526700 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526706 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-serving-cert\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.526921 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526748 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-trusted-ca-bundle\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.526921 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526786 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llsdm\" (UniqueName: \"kubernetes.io/projected/1d726875-4757-410d-990c-43e97332c086-kube-api-access-llsdm\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.526921 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526850 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-console-config\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.526921 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526892 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-oauth-config\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.527074 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.526932 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-oauth-serving-cert\") pod \"1d726875-4757-410d-990c-43e97332c086\" (UID: \"1d726875-4757-410d-990c-43e97332c086\") " Jul 10 18:43:46.527167 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.527124 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-service-ca" (OuterVolumeSpecName: "service-ca") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:46.527352 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.527322 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:46.527445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.527387 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-service-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:46.527445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.527381 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-console-config" (OuterVolumeSpecName: "console-config") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:46.527445 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.527383 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:46.529011 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.528986 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:46.529203 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.529150 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:46.529265 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.529245 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d726875-4757-410d-990c-43e97332c086-kube-api-access-llsdm" (OuterVolumeSpecName: "kube-api-access-llsdm") pod "1d726875-4757-410d-990c-43e97332c086" (UID: "1d726875-4757-410d-990c-43e97332c086"). InnerVolumeSpecName "kube-api-access-llsdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:43:46.628960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.628927 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:46.628960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.628951 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:46.628960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.628962 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llsdm\" (UniqueName: \"kubernetes.io/projected/1d726875-4757-410d-990c-43e97332c086-kube-api-access-llsdm\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:46.628960 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.628972 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-console-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:46.629268 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.628982 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d726875-4757-410d-990c-43e97332c086-console-oauth-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:46.629268 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:46.628991 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d726875-4757-410d-990c-43e97332c086-oauth-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:43:47.188411 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.188377 2575 generic.go:356] "Generic (PLEG): container finished" podID="1d726875-4757-410d-990c-43e97332c086" containerID="772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8" exitCode=0 Jul 10 18:43:47.188953 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.188429 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68557bfb59-44zzk" event={"ID":"1d726875-4757-410d-990c-43e97332c086","Type":"ContainerDied","Data":"772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8"} Jul 10 18:43:47.188953 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.188438 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68557bfb59-44zzk" Jul 10 18:43:47.188953 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.188466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68557bfb59-44zzk" event={"ID":"1d726875-4757-410d-990c-43e97332c086","Type":"ContainerDied","Data":"9b8bf6f13624fd3237c9e0e4e85ea760294f33ebdde5b45370d2319b400bfaac"} Jul 10 18:43:47.188953 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.188488 2575 scope.go:117] "RemoveContainer" containerID="772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8" Jul 10 18:43:47.198985 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.198964 2575 scope.go:117] "RemoveContainer" containerID="772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8" Jul 10 18:43:47.199392 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:43:47.199372 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8\": container with ID starting with 772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8 not found: ID does not exist" containerID="772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8" Jul 10 18:43:47.199442 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.199403 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8"} err="failed to get container status \"772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8\": rpc error: code = NotFound desc = could not find container \"772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8\": container with ID starting with 772e0a2ee4710a1cf989bc1b63ca864c0d461b788ccb7afd4196ea834622d9c8 not found: ID does not exist" Jul 10 18:43:47.215288 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.215254 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68557bfb59-44zzk"] Jul 10 18:43:47.219516 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:47.219491 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68557bfb59-44zzk"] Jul 10 18:43:48.194326 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:48.194291 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d726875-4757-410d-990c-43e97332c086" path="/var/lib/kubelet/pods/1d726875-4757-410d-990c-43e97332c086/volumes" Jul 10 18:43:56.971194 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:56.971153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:57.030007 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:43:57.029972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:07.458746 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:07.458709 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:44:07.474389 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:07.474368 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:44:08.289794 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:08.289766 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 18:44:16.344264 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:16.344231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:16.399319 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:16.399287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:17.534228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.534189 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-764544dcc-qlp9b"] Jul 10 18:44:17.534607 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.534579 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d726875-4757-410d-990c-43e97332c086" containerName="console" Jul 10 18:44:17.534607 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.534592 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d726875-4757-410d-990c-43e97332c086" containerName="console" Jul 10 18:44:17.534690 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.534655 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d726875-4757-410d-990c-43e97332c086" containerName="console" Jul 10 18:44:17.537583 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.537564 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.560116 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.560069 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764544dcc-qlp9b"] Jul 10 18:44:17.598796 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.598758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-service-ca\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.598796 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.598796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-oauth-config\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.599055 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.598881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-serving-cert\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.599055 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.598956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-trusted-ca-bundle\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.599055 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.598998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-config\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.599055 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.599025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-oauth-serving-cert\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.599256 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.599069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl4px\" (UniqueName: \"kubernetes.io/projected/a517d3a2-4c53-4908-9ba0-8e1e0f553855-kube-api-access-kl4px\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.620490 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.620458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:17.687209 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.687174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:17.699964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.699929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-service-ca\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.699964 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.699966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-oauth-config\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.700225 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.700166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-serving-cert\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.700329 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.700309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-trusted-ca-bundle\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.700389 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.700358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-config\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.700389 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.700382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-oauth-serving-cert\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.700587 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.700553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl4px\" (UniqueName: \"kubernetes.io/projected/a517d3a2-4c53-4908-9ba0-8e1e0f553855-kube-api-access-kl4px\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.700719 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.700697 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-service-ca\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.701146 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.701114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-config\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.701233 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.701150 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-oauth-serving-cert\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.701401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.701383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-trusted-ca-bundle\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.702517 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.702494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-serving-cert\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.702595 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.702531 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-oauth-config\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.710063 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.710040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl4px\" (UniqueName: \"kubernetes.io/projected/a517d3a2-4c53-4908-9ba0-8e1e0f553855-kube-api-access-kl4px\") pod \"console-764544dcc-qlp9b\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.772211 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.772176 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:17.846707 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.846637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:17.973889 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:17.973849 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764544dcc-qlp9b"] Jul 10 18:44:17.976270 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:44:17.976247 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda517d3a2_4c53_4908_9ba0_8e1e0f553855.slice/crio-d7823bcc529cfe13cadda704cec04cf2dde0e6da968fe5759fcb544707c165f5 WatchSource:0}: Error finding container d7823bcc529cfe13cadda704cec04cf2dde0e6da968fe5759fcb544707c165f5: Status 404 returned error can't find the container with id d7823bcc529cfe13cadda704cec04cf2dde0e6da968fe5759fcb544707c165f5 Jul 10 18:44:18.317293 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:18.317259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764544dcc-qlp9b" event={"ID":"a517d3a2-4c53-4908-9ba0-8e1e0f553855","Type":"ContainerStarted","Data":"6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc"} Jul 10 18:44:18.317468 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:18.317312 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764544dcc-qlp9b" event={"ID":"a517d3a2-4c53-4908-9ba0-8e1e0f553855","Type":"ContainerStarted","Data":"d7823bcc529cfe13cadda704cec04cf2dde0e6da968fe5759fcb544707c165f5"} Jul 10 18:44:18.339616 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:18.339557 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-764544dcc-qlp9b" podStartSLOduration=1.339539744 podStartE2EDuration="1.339539744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:44:18.338260376 +0000 UTC m=+232.637780599" watchObservedRunningTime="2026-07-10 18:44:18.339539744 +0000 UTC m=+232.639059967" Jul 10 18:44:18.359850 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:18.359819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:18.425642 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:18.425609 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:27.847632 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:27.847580 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:27.848124 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:27.847686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:27.852485 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:27.852458 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:28.319559 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.319524 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:28.367073 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.367048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:44:28.393242 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.393208 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:28.419602 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.419571 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686c9b877c-7b2p8"] Jul 10 18:44:28.533537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.533508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:28.640680 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.640588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:28.742793 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:28.742766 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:45.795759 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:45.795716 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:45.881574 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:45.881541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:53.440606 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.440516 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-686c9b877c-7b2p8" podUID="55261f6b-3c37-4f5a-b575-f3865bbd4a10" containerName="console" containerID="cri-o://d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d" gracePeriod=15 Jul 10 18:44:53.680069 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.680042 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:44:53.738213 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738078 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-config\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738213 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738171 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-oauth-serving-cert\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738494 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738238 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-trusted-ca-bundle\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738494 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738260 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-service-ca\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738494 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738297 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-serving-cert\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738494 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738332 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-oauth-config\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738494 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738363 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plk8p\" (UniqueName: \"kubernetes.io/projected/55261f6b-3c37-4f5a-b575-f3865bbd4a10-kube-api-access-plk8p\") pod \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\" (UID: \"55261f6b-3c37-4f5a-b575-f3865bbd4a10\") " Jul 10 18:44:53.738721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738509 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-config" (OuterVolumeSpecName: "console-config") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:53.738721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738664 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:53.738721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738698 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:53.738858 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738765 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-service-ca" (OuterVolumeSpecName: "service-ca") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:53.738981 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.738953 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:53.740625 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.740599 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:44:53.741065 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.741023 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:44:53.741182 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.741029 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55261f6b-3c37-4f5a-b575-f3865bbd4a10-kube-api-access-plk8p" (OuterVolumeSpecName: "kube-api-access-plk8p") pod "55261f6b-3c37-4f5a-b575-f3865bbd4a10" (UID: "55261f6b-3c37-4f5a-b575-f3865bbd4a10"). InnerVolumeSpecName "kube-api-access-plk8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:44:53.839869 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.839831 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:53.839869 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.839863 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-service-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:53.839869 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.839877 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:53.840141 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.839888 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55261f6b-3c37-4f5a-b575-f3865bbd4a10-console-oauth-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:53.840141 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.839900 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plk8p\" (UniqueName: \"kubernetes.io/projected/55261f6b-3c37-4f5a-b575-f3865bbd4a10-kube-api-access-plk8p\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:53.840141 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:53.839914 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55261f6b-3c37-4f5a-b575-f3865bbd4a10-oauth-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:44:54.482804 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.482714 2575 generic.go:356] "Generic (PLEG): container finished" podID="55261f6b-3c37-4f5a-b575-f3865bbd4a10" containerID="d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d" exitCode=0 Jul 10 18:44:54.482804 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.482765 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686c9b877c-7b2p8" Jul 10 18:44:54.483256 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.482798 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686c9b877c-7b2p8" event={"ID":"55261f6b-3c37-4f5a-b575-f3865bbd4a10","Type":"ContainerDied","Data":"d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d"} Jul 10 18:44:54.483256 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.482870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686c9b877c-7b2p8" event={"ID":"55261f6b-3c37-4f5a-b575-f3865bbd4a10","Type":"ContainerDied","Data":"f59ebcae50336ca3dae756e5e01e03e571fd3d8ed5478dfbe86202719f69676f"} Jul 10 18:44:54.483256 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.482891 2575 scope.go:117] "RemoveContainer" containerID="d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d" Jul 10 18:44:54.491075 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.491058 2575 scope.go:117] "RemoveContainer" containerID="d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d" Jul 10 18:44:54.491369 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:44:54.491343 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d\": container with ID starting with d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d not found: ID does not exist" containerID="d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d" Jul 10 18:44:54.491424 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.491369 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d"} err="failed to get container status \"d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d\": rpc error: code = NotFound desc = could not find container \"d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d\": container with ID starting with d4f25507a372038277555f9f8ebae347da8fceaab2f48a04d9e053a584b07e8d not found: ID does not exist" Jul 10 18:44:54.498795 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.498764 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686c9b877c-7b2p8"] Jul 10 18:44:54.504466 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:54.504440 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-686c9b877c-7b2p8"] Jul 10 18:44:56.188687 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:44:56.188648 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55261f6b-3c37-4f5a-b575-f3865bbd4a10" path="/var/lib/kubelet/pods/55261f6b-3c37-4f5a-b575-f3865bbd4a10/volumes" Jul 10 18:45:26.018612 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:45:26.018581 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:45:26.019295 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:45:26.019264 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:45:26.024720 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:45:26.024699 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 18:46:02.864068 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:02.864023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:04.690370 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:04.690336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:16.321781 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:16.321747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:16.390495 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:16.390465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:25.916292 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:25.916207 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:26.017412 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:26.017370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:31.532941 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:31.532895 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:31.834160 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:31.834042 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.098672 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.098590 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.171152 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.171120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.306292 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.306254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.403661 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.403555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.502530 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.502482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.644272 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.644236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:32.845098 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:32.845054 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:33.046999 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:33.046973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:33.157739 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:33.157656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:33.257464 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:33.257428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:38.373624 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:38.373593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:38.443484 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:46:38.443452 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:24.029944 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:24.029901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:24.129254 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:24.129220 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:38.103526 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:38.103486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:38.230302 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:38.230271 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:38.294375 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:38.294342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:38.397383 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:38.397300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:38.870101 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:38.870036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:38.968916 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:38.968886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:51.806659 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:51.806569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:51.865743 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:51.865701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:53.756153 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:53.756110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:53.814882 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:53.814849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:59.047003 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:47:59.046966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:17.316390 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.316347 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6656c47b96-lh6bn"] Jul 10 18:48:17.316951 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.316856 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55261f6b-3c37-4f5a-b575-f3865bbd4a10" containerName="console" Jul 10 18:48:17.316951 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.316877 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="55261f6b-3c37-4f5a-b575-f3865bbd4a10" containerName="console" Jul 10 18:48:17.317102 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.316970 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="55261f6b-3c37-4f5a-b575-f3865bbd4a10" containerName="console" Jul 10 18:48:17.320066 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.320044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.331337 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.331313 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6656c47b96-lh6bn"] Jul 10 18:48:17.424504 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-trusted-ca-bundle\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.424504 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pkz4\" (UniqueName: \"kubernetes.io/projected/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-kube-api-access-2pkz4\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.424746 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-service-ca\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.424746 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-oauth-serving-cert\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.424746 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-oauth-config\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.424746 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-config\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.424746 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.424658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-serving-cert\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.431255 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.431232 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:17.526188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-oauth-serving-cert\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526371 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-oauth-config\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526371 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-config\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526371 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-serving-cert\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526371 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-trusted-ca-bundle\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526371 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pkz4\" (UniqueName: \"kubernetes.io/projected/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-kube-api-access-2pkz4\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526633 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-service-ca\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.526992 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.526964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-config\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.527119 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.527040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-oauth-serving-cert\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.527228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.527206 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-trusted-ca-bundle\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.527469 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.527454 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-service-ca\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.528662 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.528646 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-oauth-config\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.528866 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.528848 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-console-serving-cert\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.532959 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.532934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:17.535915 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.535896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pkz4\" (UniqueName: \"kubernetes.io/projected/af6e2a21-89a5-4cfc-8ae4-0bc31491660c-kube-api-access-2pkz4\") pod \"console-6656c47b96-lh6bn\" (UID: \"af6e2a21-89a5-4cfc-8ae4-0bc31491660c\") " pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.629199 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.629117 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:17.717574 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.717542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:17.764329 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:17.764306 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6656c47b96-lh6bn"] Jul 10 18:48:17.766904 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:48:17.766877 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6e2a21_89a5_4cfc_8ae4_0bc31491660c.slice/crio-e0537f7d9ef843b4ee3133f8c5328dfaeb55fc29e96c6931c16783a7f834ce35 WatchSource:0}: Error finding container e0537f7d9ef843b4ee3133f8c5328dfaeb55fc29e96c6931c16783a7f834ce35: Status 404 returned error can't find the container with id e0537f7d9ef843b4ee3133f8c5328dfaeb55fc29e96c6931c16783a7f834ce35 Jul 10 18:48:18.311432 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:18.311396 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6656c47b96-lh6bn" event={"ID":"af6e2a21-89a5-4cfc-8ae4-0bc31491660c","Type":"ContainerStarted","Data":"ffb016633c663fd0129c7b0130248bbdd8d5433216d10eb45895b709e3c887bf"} Jul 10 18:48:18.311620 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:18.311480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6656c47b96-lh6bn" event={"ID":"af6e2a21-89a5-4cfc-8ae4-0bc31491660c","Type":"ContainerStarted","Data":"e0537f7d9ef843b4ee3133f8c5328dfaeb55fc29e96c6931c16783a7f834ce35"} Jul 10 18:48:18.335537 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:18.335479 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6656c47b96-lh6bn" podStartSLOduration=1.335462745 podStartE2EDuration="1.335462745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:48:18.334289441 +0000 UTC m=+472.633809662" watchObservedRunningTime="2026-07-10 18:48:18.335462745 +0000 UTC m=+472.634982968" Jul 10 18:48:18.338741 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:18.338715 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:18.438441 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:18.438391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:27.629625 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:27.629584 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:27.630002 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:27.629646 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:27.634137 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:27.634117 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:28.355918 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:28.355890 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6656c47b96-lh6bn" Jul 10 18:48:28.399749 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:28.399714 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764544dcc-qlp9b"] Jul 10 18:48:28.512064 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:28.512037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:28.625712 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:28.625623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:28.722411 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:28.722376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:46.637757 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:46.637726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:46.745131 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:46.745075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:46.844394 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:46.844362 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:47.119068 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:47.119034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:47.599401 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:47.599356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:47.696513 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:47.696478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:48:53.420779 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.420743 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-764544dcc-qlp9b" podUID="a517d3a2-4c53-4908-9ba0-8e1e0f553855" containerName="console" containerID="cri-o://6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc" gracePeriod=15 Jul 10 18:48:53.660134 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.660110 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:48:53.750345 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750308 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-service-ca\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750543 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750370 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-oauth-config\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750543 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750393 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-config\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750543 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750462 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl4px\" (UniqueName: \"kubernetes.io/projected/a517d3a2-4c53-4908-9ba0-8e1e0f553855-kube-api-access-kl4px\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750543 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750519 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-oauth-serving-cert\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750753 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750545 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-trusted-ca-bundle\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750753 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750574 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-serving-cert\") pod \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\" (UID: \"a517d3a2-4c53-4908-9ba0-8e1e0f553855\") " Jul 10 18:48:53.750852 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750821 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-config" (OuterVolumeSpecName: "console-config") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:53.750914 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750881 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:53.750977 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.750946 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:53.751133 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.751117 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-service-ca" (OuterVolumeSpecName: "service-ca") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:53.752599 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.752579 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:48:53.752729 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.752624 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a517d3a2-4c53-4908-9ba0-8e1e0f553855-kube-api-access-kl4px" (OuterVolumeSpecName: "kube-api-access-kl4px") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "kube-api-access-kl4px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:48:53.752729 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.752679 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a517d3a2-4c53-4908-9ba0-8e1e0f553855" (UID: "a517d3a2-4c53-4908-9ba0-8e1e0f553855"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:48:53.851428 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851393 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl4px\" (UniqueName: \"kubernetes.io/projected/a517d3a2-4c53-4908-9ba0-8e1e0f553855-kube-api-access-kl4px\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:53.851428 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851420 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-oauth-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:53.851428 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851430 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:53.851428 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851439 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-serving-cert\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:53.851687 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851448 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-service-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:53.851687 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851456 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-oauth-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:53.851687 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:53.851465 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a517d3a2-4c53-4908-9ba0-8e1e0f553855-console-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:48:54.455535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.455448 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517d3a2-4c53-4908-9ba0-8e1e0f553855" containerID="6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc" exitCode=0 Jul 10 18:48:54.455535 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.455505 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764544dcc-qlp9b" Jul 10 18:48:54.456018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.455534 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764544dcc-qlp9b" event={"ID":"a517d3a2-4c53-4908-9ba0-8e1e0f553855","Type":"ContainerDied","Data":"6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc"} Jul 10 18:48:54.456018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.455587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764544dcc-qlp9b" event={"ID":"a517d3a2-4c53-4908-9ba0-8e1e0f553855","Type":"ContainerDied","Data":"d7823bcc529cfe13cadda704cec04cf2dde0e6da968fe5759fcb544707c165f5"} Jul 10 18:48:54.456018 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.455607 2575 scope.go:117] "RemoveContainer" containerID="6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc" Jul 10 18:48:54.464290 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.464271 2575 scope.go:117] "RemoveContainer" containerID="6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc" Jul 10 18:48:54.464634 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:48:54.464615 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc\": container with ID starting with 6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc not found: ID does not exist" containerID="6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc" Jul 10 18:48:54.464686 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.464642 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc"} err="failed to get container status \"6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc\": rpc error: code = NotFound desc = could not find container \"6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc\": container with ID starting with 6952d20c94cae21617aba9538d9bcd57112735ca7bc2409c7ce3b6719c0dbffc not found: ID does not exist" Jul 10 18:48:54.473251 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.473222 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764544dcc-qlp9b"] Jul 10 18:48:54.476948 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:54.476921 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-764544dcc-qlp9b"] Jul 10 18:48:56.188644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:48:56.188608 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a517d3a2-4c53-4908-9ba0-8e1e0f553855" path="/var/lib/kubelet/pods/a517d3a2-4c53-4908-9ba0-8e1e0f553855/volumes" Jul 10 18:49:03.056808 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.056776 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-4ls69"] Jul 10 18:49:03.057223 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.057125 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a517d3a2-4c53-4908-9ba0-8e1e0f553855" containerName="console" Jul 10 18:49:03.057223 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.057137 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a517d3a2-4c53-4908-9ba0-8e1e0f553855" containerName="console" Jul 10 18:49:03.057223 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.057203 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a517d3a2-4c53-4908-9ba0-8e1e0f553855" containerName="console" Jul 10 18:49:03.061368 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.061352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4ls69" Jul 10 18:49:03.064162 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.064142 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 10 18:49:03.064267 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.064257 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 10 18:49:03.064317 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.064308 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 10 18:49:03.065518 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.065375 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-bqnpr\"" Jul 10 18:49:03.067248 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.067232 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-4ls69"] Jul 10 18:49:03.137577 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.137550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvg7s\" (UniqueName: \"kubernetes.io/projected/a0b3afc6-94b2-4704-8596-6751f2c28f77-kube-api-access-vvg7s\") pod \"s3-init-4ls69\" (UID: \"a0b3afc6-94b2-4704-8596-6751f2c28f77\") " pod="kserve/s3-init-4ls69" Jul 10 18:49:03.238066 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.238026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvg7s\" (UniqueName: \"kubernetes.io/projected/a0b3afc6-94b2-4704-8596-6751f2c28f77-kube-api-access-vvg7s\") pod \"s3-init-4ls69\" (UID: \"a0b3afc6-94b2-4704-8596-6751f2c28f77\") " pod="kserve/s3-init-4ls69" Jul 10 18:49:03.246627 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.246600 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvg7s\" (UniqueName: \"kubernetes.io/projected/a0b3afc6-94b2-4704-8596-6751f2c28f77-kube-api-access-vvg7s\") pod \"s3-init-4ls69\" (UID: \"a0b3afc6-94b2-4704-8596-6751f2c28f77\") " pod="kserve/s3-init-4ls69" Jul 10 18:49:03.387579 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.387497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4ls69" Jul 10 18:49:03.510551 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.510525 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-4ls69"] Jul 10 18:49:03.513377 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:49:03.513352 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0b3afc6_94b2_4704_8596_6751f2c28f77.slice/crio-b6f1ccea352a33051275aa7eccd42288aba4a2d27725979a062f0842b0a51c69 WatchSource:0}: Error finding container b6f1ccea352a33051275aa7eccd42288aba4a2d27725979a062f0842b0a51c69: Status 404 returned error can't find the container with id b6f1ccea352a33051275aa7eccd42288aba4a2d27725979a062f0842b0a51c69 Jul 10 18:49:03.515142 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:03.515126 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:49:04.500929 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:04.500899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4ls69" event={"ID":"a0b3afc6-94b2-4704-8596-6751f2c28f77","Type":"ContainerStarted","Data":"b6f1ccea352a33051275aa7eccd42288aba4a2d27725979a062f0842b0a51c69"} Jul 10 18:49:08.520867 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:08.520820 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4ls69" event={"ID":"a0b3afc6-94b2-4704-8596-6751f2c28f77","Type":"ContainerStarted","Data":"4f4328818aaefbcdf4a73818e753cd613fb3c8515454a096dc86973aa444100f"} Jul 10 18:49:08.537501 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:08.537449 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-4ls69" podStartSLOduration=1.003711353 podStartE2EDuration="5.537434267s" totalImagesPullingTime="4.533722914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:49:08.536356043 +0000 UTC m=+522.835876264" watchObservedRunningTime="2026-07-10 18:49:08.537434267 +0000 UTC m=+522.836954489" Jul 10 18:49:11.534150 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:11.534115 2575 generic.go:356] "Generic (PLEG): container finished" podID="a0b3afc6-94b2-4704-8596-6751f2c28f77" containerID="4f4328818aaefbcdf4a73818e753cd613fb3c8515454a096dc86973aa444100f" exitCode=0 Jul 10 18:49:11.534536 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:11.534172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4ls69" event={"ID":"a0b3afc6-94b2-4704-8596-6751f2c28f77","Type":"ContainerDied","Data":"4f4328818aaefbcdf4a73818e753cd613fb3c8515454a096dc86973aa444100f"} Jul 10 18:49:12.661659 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:12.661623 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4ls69" Jul 10 18:49:12.833326 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:12.833232 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvg7s\" (UniqueName: \"kubernetes.io/projected/a0b3afc6-94b2-4704-8596-6751f2c28f77-kube-api-access-vvg7s\") pod \"a0b3afc6-94b2-4704-8596-6751f2c28f77\" (UID: \"a0b3afc6-94b2-4704-8596-6751f2c28f77\") " Jul 10 18:49:12.835376 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:12.835342 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0b3afc6-94b2-4704-8596-6751f2c28f77-kube-api-access-vvg7s" (OuterVolumeSpecName: "kube-api-access-vvg7s") pod "a0b3afc6-94b2-4704-8596-6751f2c28f77" (UID: "a0b3afc6-94b2-4704-8596-6751f2c28f77"). InnerVolumeSpecName "kube-api-access-vvg7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:49:12.934120 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:12.934071 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvg7s\" (UniqueName: \"kubernetes.io/projected/a0b3afc6-94b2-4704-8596-6751f2c28f77-kube-api-access-vvg7s\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:49:13.544638 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:13.544609 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4ls69" Jul 10 18:49:13.544815 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:13.544646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4ls69" event={"ID":"a0b3afc6-94b2-4704-8596-6751f2c28f77","Type":"ContainerDied","Data":"b6f1ccea352a33051275aa7eccd42288aba4a2d27725979a062f0842b0a51c69"} Jul 10 18:49:13.544815 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:13.544683 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6f1ccea352a33051275aa7eccd42288aba4a2d27725979a062f0842b0a51c69" Jul 10 18:49:14.030227 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:14.030192 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:49:14.127130 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:14.127102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:49:22.697450 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:22.697379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:49:23.262848 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:23.262810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:49:32.235057 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:32.235022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:49:32.338450 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:49:32.338422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:50:26.045833 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:50:26.045807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:50:26.046351 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:50:26.045839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:50:29.993618 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:50:29.993578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:51:07.798923 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.798890 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:51:07.933123 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.933074 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb"] Jul 10 18:51:07.933472 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.933460 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b3afc6-94b2-4704-8596-6751f2c28f77" containerName="s3-init" Jul 10 18:51:07.933515 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.933474 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b3afc6-94b2-4704-8596-6751f2c28f77" containerName="s3-init" Jul 10 18:51:07.933555 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.933530 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0b3afc6-94b2-4704-8596-6751f2c28f77" containerName="s3-init" Jul 10 18:51:07.936690 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.936675 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:07.939373 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.939352 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-kr64x\"" Jul 10 18:51:07.939721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.939695 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 10 18:51:07.939866 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.939842 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-c446e-predictor-serving-cert\"" Jul 10 18:51:07.939936 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.939899 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\"" Jul 10 18:51:07.940430 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.940412 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 10 18:51:07.947606 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:07.947583 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb"] Jul 10 18:51:08.026981 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.026948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.027210 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.027024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.027210 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.027059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-proxy-tls\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.027210 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.027076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbvmc\" (UniqueName: \"kubernetes.io/projected/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kube-api-access-xbvmc\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.128587 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.128497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.128587 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.128548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-proxy-tls\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.128799 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.128706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbvmc\" (UniqueName: \"kubernetes.io/projected/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kube-api-access-xbvmc\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.128799 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.128768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.129166 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.129146 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.129294 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.129274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.131137 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.131116 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-proxy-tls\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.136485 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.136462 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbvmc\" (UniqueName: \"kubernetes.io/projected/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kube-api-access-xbvmc\") pod \"isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.248811 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.248772 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:08.380939 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:08.380914 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb"] Jul 10 18:51:08.382873 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:51:08.382845 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d16cb0_6067_4bb6_8ddd_6efe59db5464.slice/crio-78d69606bc5039eae5a7d5e88c55231acccb69a14da988e938d17cf55b152b95 WatchSource:0}: Error finding container 78d69606bc5039eae5a7d5e88c55231acccb69a14da988e938d17cf55b152b95: Status 404 returned error can't find the container with id 78d69606bc5039eae5a7d5e88c55231acccb69a14da988e938d17cf55b152b95 Jul 10 18:51:09.006576 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:09.006541 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerStarted","Data":"78d69606bc5039eae5a7d5e88c55231acccb69a14da988e938d17cf55b152b95"} Jul 10 18:51:09.018136 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:09.018107 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:51:12.023633 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:12.023598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerStarted","Data":"4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df"} Jul 10 18:51:16.040371 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:16.040338 2575 generic.go:356] "Generic (PLEG): container finished" podID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerID="4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df" exitCode=0 Jul 10 18:51:16.040722 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:16.040414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerDied","Data":"4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df"} Jul 10 18:51:36.008975 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:36.008925 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:51:36.133411 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:36.133379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerStarted","Data":"ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175"} Jul 10 18:51:39.149184 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:39.149149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerStarted","Data":"b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93"} Jul 10 18:51:39.149663 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:39.149368 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:39.149663 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:39.149413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:39.150497 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:39.150470 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:51:39.169919 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:39.169870 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podStartSLOduration=2.843541194 podStartE2EDuration="32.169856611s" totalImagesPullingTime="25.611074611s" totalInitContainerRuntime="3.715240806s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:51:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:51:39.16769848 +0000 UTC m=+673.467218703" watchObservedRunningTime="2026-07-10 18:51:39.169856611 +0000 UTC m=+673.469376833" Jul 10 18:51:40.153010 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:40.152974 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:51:45.158442 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:45.158413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:51:45.158999 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:45.158971 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:51:55.159596 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:51:55.159555 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:52:05.159098 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:05.159047 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:52:15.159403 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:15.159365 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:52:25.159504 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:25.159418 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused" Jul 10 18:52:35.160148 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:35.160115 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:52:37.870894 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:37.870866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:37.969982 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:37.969950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:47.959817 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:47.959782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.116143 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.116066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.214900 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.214818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.290255 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.290222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.311360 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.311330 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb"] Jul 10 18:52:48.311627 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.311603 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" containerID="cri-o://ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175" gracePeriod=30 Jul 10 18:52:48.311721 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.311677 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kube-rbac-proxy" containerID="cri-o://b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93" gracePeriod=30 Jul 10 18:52:48.315100 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.315059 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps"] Jul 10 18:52:48.319349 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.319333 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.322140 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.322120 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-e9877-predictor-serving-cert\"" Jul 10 18:52:48.322530 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.322168 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\"" Jul 10 18:52:48.330439 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.330420 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps"] Jul 10 18:52:48.388525 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.388495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.429188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.429164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50650f77-fac1-420b-a9fb-79e927ede74a-isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.429317 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.429197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50650f77-fac1-420b-a9fb-79e927ede74a-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.429317 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.429278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50650f77-fac1-420b-a9fb-79e927ede74a-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.429317 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.429308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w77w\" (UniqueName: \"kubernetes.io/projected/50650f77-fac1-420b-a9fb-79e927ede74a-kube-api-access-5w77w\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.429444 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.429421 2575 generic.go:356] "Generic (PLEG): container finished" podID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerID="b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93" exitCode=2 Jul 10 18:52:48.429489 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.429458 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerDied","Data":"b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93"} Jul 10 18:52:48.491880 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.491804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.530260 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.530229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50650f77-fac1-420b-a9fb-79e927ede74a-isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.530395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.530264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50650f77-fac1-420b-a9fb-79e927ede74a-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.530395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.530299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50650f77-fac1-420b-a9fb-79e927ede74a-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.530395 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.530329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w77w\" (UniqueName: \"kubernetes.io/projected/50650f77-fac1-420b-a9fb-79e927ede74a-kube-api-access-5w77w\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.530705 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.530682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50650f77-fac1-420b-a9fb-79e927ede74a-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.530914 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.530892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50650f77-fac1-420b-a9fb-79e927ede74a-isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.532795 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.532775 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50650f77-fac1-420b-a9fb-79e927ede74a-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.538928 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.538892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w77w\" (UniqueName: \"kubernetes.io/projected/50650f77-fac1-420b-a9fb-79e927ede74a-kube-api-access-5w77w\") pod \"isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.588958 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.588932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:48.635022 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.634987 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:48.786767 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:48.786669 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps"] Jul 10 18:52:48.789317 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:52:48.789293 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50650f77_fac1_420b_a9fb_79e927ede74a.slice/crio-a32f1f96cde602523c78b33042584c4238602f44fcb856564d27db7def95678f WatchSource:0}: Error finding container a32f1f96cde602523c78b33042584c4238602f44fcb856564d27db7def95678f: Status 404 returned error can't find the container with id a32f1f96cde602523c78b33042584c4238602f44fcb856564d27db7def95678f Jul 10 18:52:49.434869 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:49.434829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerStarted","Data":"bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980"} Jul 10 18:52:49.435264 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:49.434899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerStarted","Data":"a32f1f96cde602523c78b33042584c4238602f44fcb856564d27db7def95678f"} Jul 10 18:52:50.153831 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:50.153783 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused" Jul 10 18:52:51.953558 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:51.953531 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:52:52.067709 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.067615 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbvmc\" (UniqueName: \"kubernetes.io/projected/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kube-api-access-xbvmc\") pod \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " Jul 10 18:52:52.067709 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.067654 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-proxy-tls\") pod \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " Jul 10 18:52:52.067709 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.067688 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kserve-provision-location\") pod \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " Jul 10 18:52:52.067996 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.067713 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\") pod \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\" (UID: \"a9d16cb0-6067-4bb6-8ddd-6efe59db5464\") " Jul 10 18:52:52.068128 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.068099 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a9d16cb0-6067-4bb6-8ddd-6efe59db5464" (UID: "a9d16cb0-6067-4bb6-8ddd-6efe59db5464"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:52:52.068188 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.068143 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config") pod "a9d16cb0-6067-4bb6-8ddd-6efe59db5464" (UID: "a9d16cb0-6067-4bb6-8ddd-6efe59db5464"). InnerVolumeSpecName "isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:52:52.069920 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.069901 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a9d16cb0-6067-4bb6-8ddd-6efe59db5464" (UID: "a9d16cb0-6067-4bb6-8ddd-6efe59db5464"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:52:52.069988 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.069974 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kube-api-access-xbvmc" (OuterVolumeSpecName: "kube-api-access-xbvmc") pod "a9d16cb0-6067-4bb6-8ddd-6efe59db5464" (UID: "a9d16cb0-6067-4bb6-8ddd-6efe59db5464"). InnerVolumeSpecName "kube-api-access-xbvmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:52:52.168679 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.168648 2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kserve-provision-location\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:52:52.168679 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.168672 2575 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-isvc-xgboost-graph-raw-c446e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:52:52.168679 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.168684 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbvmc\" (UniqueName: \"kubernetes.io/projected/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-kube-api-access-xbvmc\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:52:52.168896 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.168692 2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a9d16cb0-6067-4bb6-8ddd-6efe59db5464-proxy-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:52:52.449873 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.449841 2575 generic.go:356] "Generic (PLEG): container finished" podID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerID="ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175" exitCode=0 Jul 10 18:52:52.450061 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.449896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerDied","Data":"ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175"} Jul 10 18:52:52.450061 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.449907 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" Jul 10 18:52:52.450061 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.449958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb" event={"ID":"a9d16cb0-6067-4bb6-8ddd-6efe59db5464","Type":"ContainerDied","Data":"78d69606bc5039eae5a7d5e88c55231acccb69a14da988e938d17cf55b152b95"} Jul 10 18:52:52.450061 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.449991 2575 scope.go:117] "RemoveContainer" containerID="b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93" Jul 10 18:52:52.451859 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.451825 2575 generic.go:356] "Generic (PLEG): container finished" podID="50650f77-fac1-420b-a9fb-79e927ede74a" containerID="bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980" exitCode=0 Jul 10 18:52:52.451994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.451919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerDied","Data":"bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980"} Jul 10 18:52:52.471112 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.470952 2575 scope.go:117] "RemoveContainer" containerID="ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175" Jul 10 18:52:52.490065 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.490035 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb"] Jul 10 18:52:52.493120 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.493079 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-c446e-predictor-547f5b47f5-6m7fb"] Jul 10 18:52:52.495752 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.495730 2575 scope.go:117] "RemoveContainer" containerID="4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df" Jul 10 18:52:52.510110 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.510070 2575 scope.go:117] "RemoveContainer" containerID="b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93" Jul 10 18:52:52.510401 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:52:52.510385 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93\": container with ID starting with b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93 not found: ID does not exist" containerID="b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93" Jul 10 18:52:52.510463 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.510410 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93"} err="failed to get container status \"b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93\": rpc error: code = NotFound desc = could not find container \"b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93\": container with ID starting with b479616c35694f28eafd2e186a0202bebe15ae7536650b394b83e7753777fa93 not found: ID does not exist" Jul 10 18:52:52.510463 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.510428 2575 scope.go:117] "RemoveContainer" containerID="ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175" Jul 10 18:52:52.510686 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:52:52.510666 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175\": container with ID starting with ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175 not found: ID does not exist" containerID="ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175" Jul 10 18:52:52.510768 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.510688 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175"} err="failed to get container status \"ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175\": rpc error: code = NotFound desc = could not find container \"ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175\": container with ID starting with ae10a1c6f43f0687ff8bbc67880de4d0af13e23439c5d69625f2083c565dc175 not found: ID does not exist" Jul 10 18:52:52.510768 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.510702 2575 scope.go:117] "RemoveContainer" containerID="4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df" Jul 10 18:52:52.510979 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:52:52.510946 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df\": container with ID starting with 4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df not found: ID does not exist" containerID="4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df" Jul 10 18:52:52.511020 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:52.510991 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df"} err="failed to get container status \"4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df\": rpc error: code = NotFound desc = could not find container \"4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df\": container with ID starting with 4e7f56f8b84899e984d71fb29b18c73a620822d3664bf09f36ff15fceb1d33df not found: ID does not exist" Jul 10 18:52:53.459222 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:53.459189 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerStarted","Data":"9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405"} Jul 10 18:52:53.459728 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:53.459247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerStarted","Data":"1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4"} Jul 10 18:52:53.459728 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:53.459438 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:53.479897 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:53.479854 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podStartSLOduration=1.9093956589999999 podStartE2EDuration="5.479841563s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.570445904s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:52:53.477462735 +0000 UTC m=+747.776982977" watchObservedRunningTime="2026-07-10 18:52:53.479841563 +0000 UTC m=+747.779361784" Jul 10 18:52:54.189278 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:54.189245 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" path="/var/lib/kubelet/pods/a9d16cb0-6067-4bb6-8ddd-6efe59db5464/volumes" Jul 10 18:52:54.463966 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:54.463883 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:52:54.465333 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:54.465301 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:52:55.468099 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:55.468049 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:52:56.262383 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:56.262353 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:52:56.364335 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:52:56.364303 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:53:00.473063 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:00.473024 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:53:00.473644 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:00.473620 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:53:10.474490 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:10.474450 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:53:18.840756 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:18.840718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:53:20.474017 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:20.473971 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:53:30.474625 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:30.474587 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:53:40.474269 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:40.474227 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:53:50.473868 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:53:50.473770 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:54:00.474542 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:00.474515 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:54:28.254469 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:28.254441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:28.445525 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:28.445488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:38.314937 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.314894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:38.482394 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.482361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:38.527825 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.527790 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262"] Jul 10 18:54:38.528173 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528159 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="storage-initializer" Jul 10 18:54:38.528228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528176 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="storage-initializer" Jul 10 18:54:38.528228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528191 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kube-rbac-proxy" Jul 10 18:54:38.528228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528196 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kube-rbac-proxy" Jul 10 18:54:38.528228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528206 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" Jul 10 18:54:38.528228 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528211 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" Jul 10 18:54:38.528414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528278 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kube-rbac-proxy" Jul 10 18:54:38.528414 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.528286 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d16cb0-6067-4bb6-8ddd-6efe59db5464" containerName="kserve-container" Jul 10 18:54:38.531385 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.531367 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.534312 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.534293 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-bb4f7-predictor-serving-cert\"" Jul 10 18:54:38.534420 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.534306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\"" Jul 10 18:54:38.544626 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.544602 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262"] Jul 10 18:54:38.588701 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.588632 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:38.628977 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.628956 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps"] Jul 10 18:54:38.629244 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.629223 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" containerID="cri-o://1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4" gracePeriod=30 Jul 10 18:54:38.629314 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.629245 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kube-rbac-proxy" containerID="cri-o://9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405" gracePeriod=30 Jul 10 18:54:38.673952 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.673925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48dmw\" (UniqueName: \"kubernetes.io/projected/06b77dc0-9801-444d-846b-3cf91a61ce99-kube-api-access-48dmw\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.674062 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.673972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/06b77dc0-9801-444d-846b-3cf91a61ce99-proxy-tls\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.674147 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.674109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/06b77dc0-9801-444d-846b-3cf91a61ce99-message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.687218 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.687197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:38.775194 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.775163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/06b77dc0-9801-444d-846b-3cf91a61ce99-proxy-tls\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.775336 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.775233 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/06b77dc0-9801-444d-846b-3cf91a61ce99-message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.775336 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.775271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48dmw\" (UniqueName: \"kubernetes.io/projected/06b77dc0-9801-444d-846b-3cf91a61ce99-kube-api-access-48dmw\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.775911 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.775893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/06b77dc0-9801-444d-846b-3cf91a61ce99-message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.777426 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.777399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/06b77dc0-9801-444d-846b-3cf91a61ce99-proxy-tls\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.784329 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.784297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48dmw\" (UniqueName: \"kubernetes.io/projected/06b77dc0-9801-444d-846b-3cf91a61ce99-kube-api-access-48dmw\") pod \"message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.821664 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.821633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:38.846292 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.846211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:38.898880 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.898831 2575 generic.go:356] "Generic (PLEG): container finished" podID="50650f77-fac1-420b-a9fb-79e927ede74a" containerID="9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405" exitCode=2 Jul 10 18:54:38.899019 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.898877 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerDied","Data":"9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405"} Jul 10 18:54:38.980511 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.980486 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262"] Jul 10 18:54:38.982903 ip-10-0-129-211 kubenswrapper[2575]: W0710 18:54:38.982876 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b77dc0_9801_444d_846b_3cf91a61ce99.slice/crio-890a79154a16c9b7e285e6f6392f8a24037a0da68dff3847436c2c217f2bf636 WatchSource:0}: Error finding container 890a79154a16c9b7e285e6f6392f8a24037a0da68dff3847436c2c217f2bf636: Status 404 returned error can't find the container with id 890a79154a16c9b7e285e6f6392f8a24037a0da68dff3847436c2c217f2bf636 Jul 10 18:54:38.984767 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:38.984750 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:54:39.903531 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:39.903497 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" event={"ID":"06b77dc0-9801-444d-846b-3cf91a61ce99","Type":"ContainerStarted","Data":"890a79154a16c9b7e285e6f6392f8a24037a0da68dff3847436c2c217f2bf636"} Jul 10 18:54:40.468333 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:40.468294 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused" Jul 10 18:54:40.473660 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:40.473634 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Jul 10 18:54:40.909139 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:40.909098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" event={"ID":"06b77dc0-9801-444d-846b-3cf91a61ce99","Type":"ContainerStarted","Data":"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27"} Jul 10 18:54:40.909508 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:40.909153 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" event={"ID":"06b77dc0-9801-444d-846b-3cf91a61ce99","Type":"ContainerStarted","Data":"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b"} Jul 10 18:54:40.909508 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:40.909247 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:40.929455 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:40.929412 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" podStartSLOduration=1.668598493 podStartE2EDuration="2.929397727s" totalImagesPullingTime="1.260799234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:54:40.928633838 +0000 UTC m=+855.228154082" watchObservedRunningTime="2026-07-10 18:54:40.929397727 +0000 UTC m=+855.228918013" Jul 10 18:54:41.913218 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:41.913188 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:41.914796 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:41.914771 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:42.368736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.368715 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:54:42.412845 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.412818 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50650f77-fac1-420b-a9fb-79e927ede74a-kserve-provision-location\") pod \"50650f77-fac1-420b-a9fb-79e927ede74a\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " Jul 10 18:54:42.412994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.412869 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50650f77-fac1-420b-a9fb-79e927ede74a-proxy-tls\") pod \"50650f77-fac1-420b-a9fb-79e927ede74a\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " Jul 10 18:54:42.412994 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.412945 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50650f77-fac1-420b-a9fb-79e927ede74a-isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\") pod \"50650f77-fac1-420b-a9fb-79e927ede74a\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " Jul 10 18:54:42.413144 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.413123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w77w\" (UniqueName: \"kubernetes.io/projected/50650f77-fac1-420b-a9fb-79e927ede74a-kube-api-access-5w77w\") pod \"50650f77-fac1-420b-a9fb-79e927ede74a\" (UID: \"50650f77-fac1-420b-a9fb-79e927ede74a\") " Jul 10 18:54:42.413144 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.413134 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50650f77-fac1-420b-a9fb-79e927ede74a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "50650f77-fac1-420b-a9fb-79e927ede74a" (UID: "50650f77-fac1-420b-a9fb-79e927ede74a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:54:42.413309 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.413289 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50650f77-fac1-420b-a9fb-79e927ede74a-isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config") pod "50650f77-fac1-420b-a9fb-79e927ede74a" (UID: "50650f77-fac1-420b-a9fb-79e927ede74a"). InnerVolumeSpecName "isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:54:42.413406 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.413392 2575 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50650f77-fac1-420b-a9fb-79e927ede74a-isvc-xgboost-graph-raw-hpa-e9877-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:54:42.413460 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.413413 2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50650f77-fac1-420b-a9fb-79e927ede74a-kserve-provision-location\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:54:42.414814 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.414795 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50650f77-fac1-420b-a9fb-79e927ede74a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "50650f77-fac1-420b-a9fb-79e927ede74a" (UID: "50650f77-fac1-420b-a9fb-79e927ede74a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:54:42.414925 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.414905 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50650f77-fac1-420b-a9fb-79e927ede74a-kube-api-access-5w77w" (OuterVolumeSpecName: "kube-api-access-5w77w") pod "50650f77-fac1-420b-a9fb-79e927ede74a" (UID: "50650f77-fac1-420b-a9fb-79e927ede74a"). InnerVolumeSpecName "kube-api-access-5w77w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:54:42.513895 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.513816 2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50650f77-fac1-420b-a9fb-79e927ede74a-proxy-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:54:42.513895 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.513843 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w77w\" (UniqueName: \"kubernetes.io/projected/50650f77-fac1-420b-a9fb-79e927ede74a-kube-api-access-5w77w\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:54:42.918533 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.918446 2575 generic.go:356] "Generic (PLEG): container finished" podID="50650f77-fac1-420b-a9fb-79e927ede74a" containerID="1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4" exitCode=0 Jul 10 18:54:42.918533 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.918509 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" Jul 10 18:54:42.918533 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.918522 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerDied","Data":"1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4"} Jul 10 18:54:42.918980 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.918581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps" event={"ID":"50650f77-fac1-420b-a9fb-79e927ede74a","Type":"ContainerDied","Data":"a32f1f96cde602523c78b33042584c4238602f44fcb856564d27db7def95678f"} Jul 10 18:54:42.918980 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.918607 2575 scope.go:117] "RemoveContainer" containerID="9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405" Jul 10 18:54:42.927426 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.927409 2575 scope.go:117] "RemoveContainer" containerID="1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4" Jul 10 18:54:42.934545 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.934530 2575 scope.go:117] "RemoveContainer" containerID="bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980" Jul 10 18:54:42.941312 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.941295 2575 scope.go:117] "RemoveContainer" containerID="9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405" Jul 10 18:54:42.941536 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:54:42.941518 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405\": container with ID starting with 9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405 not found: ID does not exist" containerID="9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405" Jul 10 18:54:42.941606 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.941543 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405"} err="failed to get container status \"9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405\": rpc error: code = NotFound desc = could not find container \"9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405\": container with ID starting with 9ac129e30d4551f1c6f97a0212a00f6a47d2c4fea5eeb06c237b58a71abd9405 not found: ID does not exist" Jul 10 18:54:42.941606 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.941557 2575 scope.go:117] "RemoveContainer" containerID="1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4" Jul 10 18:54:42.941797 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:54:42.941780 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4\": container with ID starting with 1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4 not found: ID does not exist" containerID="1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4" Jul 10 18:54:42.941858 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.941803 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4"} err="failed to get container status \"1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4\": rpc error: code = NotFound desc = could not find container \"1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4\": container with ID starting with 1c778322b850e361b7ad2c7ae3fc0e345447f5131ab790139d66c7d5098f8fe4 not found: ID does not exist" Jul 10 18:54:42.941858 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.941818 2575 scope.go:117] "RemoveContainer" containerID="bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980" Jul 10 18:54:42.942218 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:54:42.942193 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980\": container with ID starting with bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980 not found: ID does not exist" containerID="bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980" Jul 10 18:54:42.942303 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.942223 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980"} err="failed to get container status \"bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980\": rpc error: code = NotFound desc = could not find container \"bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980\": container with ID starting with bf7141c305cfa1057f7c1c6c0c89648e1d935356dbf3b14acd70814999727980 not found: ID does not exist" Jul 10 18:54:42.944277 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.944257 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps"] Jul 10 18:54:42.951736 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:42.951716 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-e9877-predictor-6ccdd5f99-jl9ps"] Jul 10 18:54:44.189219 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:44.189181 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" path="/var/lib/kubelet/pods/50650f77-fac1-420b-a9fb-79e927ede74a/volumes" Jul 10 18:54:48.934915 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:48.934888 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:54:58.491842 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:58.491799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:59.104411 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:54:59.104368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:55:26.074591 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:55:26.074505 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:55:26.075886 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:55:26.075863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 18:56:23.537723 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:23.537692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262_06b77dc0-9801-444d-846b-3cf91a61ce99/kserve-container/0.log" Jul 10 18:56:23.751912 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:23.751872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:23.868934 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:23.868853 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262"] Jul 10 18:56:23.869179 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:23.869140 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kserve-container" containerID="cri-o://7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b" gracePeriod=30 Jul 10 18:56:23.869326 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:23.869178 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kube-rbac-proxy" containerID="cri-o://10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27" gracePeriod=30 Jul 10 18:56:23.929760 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:23.929721 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused" Jul 10 18:56:24.121726 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.121675 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:56:24.204690 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.204661 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48dmw\" (UniqueName: \"kubernetes.io/projected/06b77dc0-9801-444d-846b-3cf91a61ce99-kube-api-access-48dmw\") pod \"06b77dc0-9801-444d-846b-3cf91a61ce99\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " Jul 10 18:56:24.204832 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.204712 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/06b77dc0-9801-444d-846b-3cf91a61ce99-proxy-tls\") pod \"06b77dc0-9801-444d-846b-3cf91a61ce99\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " Jul 10 18:56:24.204832 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.204796 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/06b77dc0-9801-444d-846b-3cf91a61ce99-message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\") pod \"06b77dc0-9801-444d-846b-3cf91a61ce99\" (UID: \"06b77dc0-9801-444d-846b-3cf91a61ce99\") " Jul 10 18:56:24.205205 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.205183 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b77dc0-9801-444d-846b-3cf91a61ce99-message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config") pod "06b77dc0-9801-444d-846b-3cf91a61ce99" (UID: "06b77dc0-9801-444d-846b-3cf91a61ce99"). InnerVolumeSpecName "message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:56:24.206653 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.206626 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b77dc0-9801-444d-846b-3cf91a61ce99-kube-api-access-48dmw" (OuterVolumeSpecName: "kube-api-access-48dmw") pod "06b77dc0-9801-444d-846b-3cf91a61ce99" (UID: "06b77dc0-9801-444d-846b-3cf91a61ce99"). InnerVolumeSpecName "kube-api-access-48dmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:56:24.206750 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.206727 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b77dc0-9801-444d-846b-3cf91a61ce99-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "06b77dc0-9801-444d-846b-3cf91a61ce99" (UID: "06b77dc0-9801-444d-846b-3cf91a61ce99"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:56:24.305943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.305894 2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/06b77dc0-9801-444d-846b-3cf91a61ce99-proxy-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:56:24.305943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.305936 2575 reconciler_common.go:299] "Volume detached for volume \"message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/06b77dc0-9801-444d-846b-3cf91a61ce99-message-dumper-raw-bb4f7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:56:24.305943 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.305947 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48dmw\" (UniqueName: \"kubernetes.io/projected/06b77dc0-9801-444d-846b-3cf91a61ce99-kube-api-access-48dmw\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 18:56:24.339846 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339812 2575 generic.go:356] "Generic (PLEG): container finished" podID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerID="10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27" exitCode=2 Jul 10 18:56:24.339846 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339839 2575 generic.go:356] "Generic (PLEG): container finished" podID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerID="7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b" exitCode=2 Jul 10 18:56:24.340030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339867 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" Jul 10 18:56:24.340030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" event={"ID":"06b77dc0-9801-444d-846b-3cf91a61ce99","Type":"ContainerDied","Data":"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27"} Jul 10 18:56:24.340030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" event={"ID":"06b77dc0-9801-444d-846b-3cf91a61ce99","Type":"ContainerDied","Data":"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b"} Jul 10 18:56:24.340030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262" event={"ID":"06b77dc0-9801-444d-846b-3cf91a61ce99","Type":"ContainerDied","Data":"890a79154a16c9b7e285e6f6392f8a24037a0da68dff3847436c2c217f2bf636"} Jul 10 18:56:24.340030 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.339991 2575 scope.go:117] "RemoveContainer" containerID="10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27" Jul 10 18:56:24.352031 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.352011 2575 scope.go:117] "RemoveContainer" containerID="7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b" Jul 10 18:56:24.359597 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.359582 2575 scope.go:117] "RemoveContainer" containerID="10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27" Jul 10 18:56:24.359839 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:56:24.359821 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27\": container with ID starting with 10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27 not found: ID does not exist" containerID="10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27" Jul 10 18:56:24.359885 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.359849 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27"} err="failed to get container status \"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27\": rpc error: code = NotFound desc = could not find container \"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27\": container with ID starting with 10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27 not found: ID does not exist" Jul 10 18:56:24.359885 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.359866 2575 scope.go:117] "RemoveContainer" containerID="7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b" Jul 10 18:56:24.360053 ip-10-0-129-211 kubenswrapper[2575]: E0710 18:56:24.360041 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b\": container with ID starting with 7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b not found: ID does not exist" containerID="7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b" Jul 10 18:56:24.360117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.360056 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b"} err="failed to get container status \"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b\": rpc error: code = NotFound desc = could not find container \"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b\": container with ID starting with 7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b not found: ID does not exist" Jul 10 18:56:24.360117 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.360066 2575 scope.go:117] "RemoveContainer" containerID="10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27" Jul 10 18:56:24.360303 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.360285 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27"} err="failed to get container status \"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27\": rpc error: code = NotFound desc = could not find container \"10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27\": container with ID starting with 10536d5726756e614c35897377f8d27648a4b3ea348b044f00d230f5002a4a27 not found: ID does not exist" Jul 10 18:56:24.360344 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.360304 2575 scope.go:117] "RemoveContainer" containerID="7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b" Jul 10 18:56:24.360493 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.360477 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b"} err="failed to get container status \"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b\": rpc error: code = NotFound desc = could not find container \"7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b\": container with ID starting with 7d3614f523ec50b24f2a568359be4973d50f3b97c86f0ec5bdbed39e5d5eab6b not found: ID does not exist" Jul 10 18:56:24.367482 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.367462 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262"] Jul 10 18:56:24.371503 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:24.371482 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-bb4f7-predictor-79d4f46b7c-cn262"] Jul 10 18:56:25.016475 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:25.016446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:26.190295 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:56:26.190262 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" path="/var/lib/kubelet/pods/06b77dc0-9801-444d-846b-3cf91a61ce99/volumes" Jul 10 18:59:04.157949 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:59:04.157919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:04.233780 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:59:04.233749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:04.366647 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:59:04.366615 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:34.885865 ip-10-0-129-211 kubenswrapper[2575]: I0710 18:59:34.885829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:24.224240 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:24.224170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:24.510180 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:24.510075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:26.104584 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:26.104554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 19:00:26.106897 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:26.106876 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 19:00:38.352477 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:38.352441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:38.450243 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:38.450209 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:38.547594 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:38.547566 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:38.895618 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:38.895588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:48.472846 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:48.472809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:48.571331 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:48.571298 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:48.716901 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:00:48.716869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:02.103579 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:01:02.103540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:08.791431 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:02:08.791398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:10.934814 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:02:10.934783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:18.405583 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:18.405497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:28.979812 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:28.979778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:30.303844 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.303809 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-84p55/must-gather-slstx"] Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304145 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kube-rbac-proxy" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304157 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kube-rbac-proxy" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304171 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kube-rbac-proxy" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304177 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kube-rbac-proxy" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304194 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="storage-initializer" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304200 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="storage-initializer" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304207 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304212 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304222 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kserve-container" Jul 10 19:03:30.304263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304227 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kserve-container" Jul 10 19:03:30.304639 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304275 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kserve-container" Jul 10 19:03:30.304639 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304285 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b77dc0-9801-444d-846b-3cf91a61ce99" containerName="kube-rbac-proxy" Jul 10 19:03:30.304639 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304292 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kube-rbac-proxy" Jul 10 19:03:30.304639 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.304299 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="50650f77-fac1-420b-a9fb-79e927ede74a" containerName="kserve-container" Jul 10 19:03:30.307210 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.307191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.311975 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.311956 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-84p55\"/\"default-dockercfg-5zmt5\"" Jul 10 19:03:30.311975 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.311964 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84p55\"/\"openshift-service-ca.crt\"" Jul 10 19:03:30.312179 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.311964 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84p55\"/\"kube-root-ca.crt\"" Jul 10 19:03:30.313890 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.313841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:30.320554 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.320526 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84p55/must-gather-slstx"] Jul 10 19:03:30.408346 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.408315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:30.434811 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.434778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6krxb\" (UniqueName: \"kubernetes.io/projected/de78657a-ca14-4c79-9b4b-7c01947a6cf3-kube-api-access-6krxb\") pod \"must-gather-slstx\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.434967 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.434815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de78657a-ca14-4c79-9b4b-7c01947a6cf3-must-gather-output\") pod \"must-gather-slstx\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.535845 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.535812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6krxb\" (UniqueName: \"kubernetes.io/projected/de78657a-ca14-4c79-9b4b-7c01947a6cf3-kube-api-access-6krxb\") pod \"must-gather-slstx\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.535845 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.535847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de78657a-ca14-4c79-9b4b-7c01947a6cf3-must-gather-output\") pod \"must-gather-slstx\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.536208 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.536190 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de78657a-ca14-4c79-9b4b-7c01947a6cf3-must-gather-output\") pod \"must-gather-slstx\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.547386 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.547361 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6krxb\" (UniqueName: \"kubernetes.io/projected/de78657a-ca14-4c79-9b4b-7c01947a6cf3-kube-api-access-6krxb\") pod \"must-gather-slstx\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.625680 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.625594 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:03:30.764225 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.764201 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84p55/must-gather-slstx"] Jul 10 19:03:30.766349 ip-10-0-129-211 kubenswrapper[2575]: W0710 19:03:30.766308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde78657a_ca14_4c79_9b4b_7c01947a6cf3.slice/crio-aa044be536349c077ff562725e03471425ecdba6acb1b8d9303b76c55130772b WatchSource:0}: Error finding container aa044be536349c077ff562725e03471425ecdba6acb1b8d9303b76c55130772b: Status 404 returned error can't find the container with id aa044be536349c077ff562725e03471425ecdba6acb1b8d9303b76c55130772b Jul 10 19:03:30.768172 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:30.768154 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:03:31.074510 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:31.074476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84p55/must-gather-slstx" event={"ID":"de78657a-ca14-4c79-9b4b-7c01947a6cf3","Type":"ContainerStarted","Data":"aa044be536349c077ff562725e03471425ecdba6acb1b8d9303b76c55130772b"} Jul 10 19:03:38.111298 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:38.111259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84p55/must-gather-slstx" event={"ID":"de78657a-ca14-4c79-9b4b-7c01947a6cf3","Type":"ContainerStarted","Data":"b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43"} Jul 10 19:03:38.111823 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:38.111798 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84p55/must-gather-slstx" event={"ID":"de78657a-ca14-4c79-9b4b-7c01947a6cf3","Type":"ContainerStarted","Data":"3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257"} Jul 10 19:03:58.205431 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.205396 2575 generic.go:356] "Generic (PLEG): container finished" podID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerID="3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257" exitCode=0 Jul 10 19:03:58.205837 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.205473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84p55/must-gather-slstx" event={"ID":"de78657a-ca14-4c79-9b4b-7c01947a6cf3","Type":"ContainerDied","Data":"3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257"} Jul 10 19:03:58.205837 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.205769 2575 scope.go:117] "RemoveContainer" containerID="3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257" Jul 10 19:03:58.277497 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.277468 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-84p55_must-gather-slstx_de78657a-ca14-4c79-9b4b-7c01947a6cf3/gather/0.log" Jul 10 19:03:58.782126 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.782032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:58.931517 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.931484 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fs9kw/must-gather-rp6zr"] Jul 10 19:03:58.934775 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.934759 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:58.939300 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.939277 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fs9kw\"/\"kube-root-ca.crt\"" Jul 10 19:03:58.939440 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.939309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fs9kw\"/\"default-dockercfg-9qq2d\"" Jul 10 19:03:58.939684 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.939661 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fs9kw\"/\"openshift-service-ca.crt\"" Jul 10 19:03:58.954592 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.954560 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fs9kw/must-gather-rp6zr"] Jul 10 19:03:58.962057 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.962030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:58.997620 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.997588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fe9152cb-ad5f-41a5-aa67-7e55eaa06216-must-gather-output\") pod \"must-gather-rp6zr\" (UID: \"fe9152cb-ad5f-41a5-aa67-7e55eaa06216\") " pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:58.997779 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:58.997639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbrzh\" (UniqueName: \"kubernetes.io/projected/fe9152cb-ad5f-41a5-aa67-7e55eaa06216-kube-api-access-mbrzh\") pod \"must-gather-rp6zr\" (UID: \"fe9152cb-ad5f-41a5-aa67-7e55eaa06216\") " pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:59.075548 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.075463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:59.099063 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.099038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fe9152cb-ad5f-41a5-aa67-7e55eaa06216-must-gather-output\") pod \"must-gather-rp6zr\" (UID: \"fe9152cb-ad5f-41a5-aa67-7e55eaa06216\") " pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:59.099168 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.099107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbrzh\" (UniqueName: \"kubernetes.io/projected/fe9152cb-ad5f-41a5-aa67-7e55eaa06216-kube-api-access-mbrzh\") pod \"must-gather-rp6zr\" (UID: \"fe9152cb-ad5f-41a5-aa67-7e55eaa06216\") " pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:59.099444 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.099423 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fe9152cb-ad5f-41a5-aa67-7e55eaa06216-must-gather-output\") pod \"must-gather-rp6zr\" (UID: \"fe9152cb-ad5f-41a5-aa67-7e55eaa06216\") " pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:59.116569 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.116545 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbrzh\" (UniqueName: \"kubernetes.io/projected/fe9152cb-ad5f-41a5-aa67-7e55eaa06216-kube-api-access-mbrzh\") pod \"must-gather-rp6zr\" (UID: \"fe9152cb-ad5f-41a5-aa67-7e55eaa06216\") " pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:59.245636 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.245598 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fs9kw/must-gather-rp6zr" Jul 10 19:03:59.374491 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:03:59.374450 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fs9kw/must-gather-rp6zr"] Jul 10 19:03:59.376925 ip-10-0-129-211 kubenswrapper[2575]: W0710 19:03:59.376897 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe9152cb_ad5f_41a5_aa67_7e55eaa06216.slice/crio-93e9467abb5e1fd9a64bb4a92909be0421ade02453a8d544036160763867f554 WatchSource:0}: Error finding container 93e9467abb5e1fd9a64bb4a92909be0421ade02453a8d544036160763867f554: Status 404 returned error can't find the container with id 93e9467abb5e1fd9a64bb4a92909be0421ade02453a8d544036160763867f554 Jul 10 19:04:00.215777 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:00.215735 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs9kw/must-gather-rp6zr" event={"ID":"fe9152cb-ad5f-41a5-aa67-7e55eaa06216","Type":"ContainerStarted","Data":"93e9467abb5e1fd9a64bb4a92909be0421ade02453a8d544036160763867f554"} Jul 10 19:04:01.223280 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:01.223245 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs9kw/must-gather-rp6zr" event={"ID":"fe9152cb-ad5f-41a5-aa67-7e55eaa06216","Type":"ContainerStarted","Data":"c37402b4031b92d8bb61823c9ffe28c0db27a905a642599e861bde99700e45e8"} Jul 10 19:04:01.223758 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:01.223303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs9kw/must-gather-rp6zr" event={"ID":"fe9152cb-ad5f-41a5-aa67-7e55eaa06216","Type":"ContainerStarted","Data":"e877fa8071bd6c0b4a0d1f72cc166206431801bd3daa83a8614078694f31ffd9"} Jul 10 19:04:01.242813 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:01.242760 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fs9kw/must-gather-rp6zr" podStartSLOduration=2.303418881 podStartE2EDuration="3.242742065s" totalImagesPullingTime="939.323184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:01.240128882 +0000 UTC m=+1415.539649128" watchObservedRunningTime="2026-07-10 19:04:01.242742065 +0000 UTC m=+1415.542262287" Jul 10 19:04:01.790785 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:01.790759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x6g4x_1f371b76-9c91-4668-af94-96ae07d3d130/global-pull-secret-syncer/0.log" Jul 10 19:04:01.916966 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:01.916935 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" Jul 10 19:04:02.024298 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:02.024270 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-211.ec2.internal_5cd24277ff6091c18d8b9f1eee6e8097/haproxy/0.log" Jul 10 19:04:03.758948 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:03.758906 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-84p55/must-gather-slstx"] Jul 10 19:04:03.759822 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:03.759791 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-84p55/must-gather-slstx" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="copy" containerID="cri-o://b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43" gracePeriod=2 Jul 10 19:04:03.767013 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:03.766982 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-84p55/must-gather-slstx"] Jul 10 19:04:04.230884 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.229819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-84p55_must-gather-slstx_de78657a-ca14-4c79-9b4b-7c01947a6cf3/copy/0.log" Jul 10 19:04:04.242107 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.234967 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:04:04.242952 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.242934 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-84p55_must-gather-slstx_de78657a-ca14-4c79-9b4b-7c01947a6cf3/copy/0.log" Jul 10 19:04:04.245606 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.245577 2575 generic.go:356] "Generic (PLEG): container finished" podID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerID="b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43" exitCode=143 Jul 10 19:04:04.245821 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.245807 2575 scope.go:117] "RemoveContainer" containerID="b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43" Jul 10 19:04:04.246069 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.246054 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84p55/must-gather-slstx" Jul 10 19:04:04.277350 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.277310 2575 scope.go:117] "RemoveContainer" containerID="3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257" Jul 10 19:04:04.350499 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.350395 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de78657a-ca14-4c79-9b4b-7c01947a6cf3-must-gather-output\") pod \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " Jul 10 19:04:04.350825 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.350801 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6krxb\" (UniqueName: \"kubernetes.io/projected/de78657a-ca14-4c79-9b4b-7c01947a6cf3-kube-api-access-6krxb\") pod \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\" (UID: \"de78657a-ca14-4c79-9b4b-7c01947a6cf3\") " Jul 10 19:04:04.362282 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.362256 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de78657a-ca14-4c79-9b4b-7c01947a6cf3-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "de78657a-ca14-4c79-9b4b-7c01947a6cf3" (UID: "de78657a-ca14-4c79-9b4b-7c01947a6cf3"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:04:04.362811 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.362791 2575 scope.go:117] "RemoveContainer" containerID="b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43" Jul 10 19:04:04.363343 ip-10-0-129-211 kubenswrapper[2575]: E0710 19:04:04.363320 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43\": container with ID starting with b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43 not found: ID does not exist" containerID="b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43" Jul 10 19:04:04.363490 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.363464 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43"} err="failed to get container status \"b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43\": rpc error: code = NotFound desc = could not find container \"b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43\": container with ID starting with b79b61f4795f011a028816fa9d7f867be6c657e5edb138b9b120af05eb30ad43 not found: ID does not exist" Jul 10 19:04:04.363593 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.363581 2575 scope.go:117] "RemoveContainer" containerID="3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257" Jul 10 19:04:04.364142 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.364121 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de78657a-ca14-4c79-9b4b-7c01947a6cf3-kube-api-access-6krxb" (OuterVolumeSpecName: "kube-api-access-6krxb") pod "de78657a-ca14-4c79-9b4b-7c01947a6cf3" (UID: "de78657a-ca14-4c79-9b4b-7c01947a6cf3"). InnerVolumeSpecName "kube-api-access-6krxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:04:04.364602 ip-10-0-129-211 kubenswrapper[2575]: E0710 19:04:04.364573 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257\": container with ID starting with 3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257 not found: ID does not exist" containerID="3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257" Jul 10 19:04:04.364685 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.364621 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257"} err="failed to get container status \"3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257\": rpc error: code = NotFound desc = could not find container \"3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257\": container with ID starting with 3ed6ac65dd587a6d61247a148840962e4c6d7d296c453dcaa46bc1b68498f257 not found: ID does not exist" Jul 10 19:04:04.452872 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.452816 2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de78657a-ca14-4c79-9b4b-7c01947a6cf3-must-gather-output\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 19:04:04.452872 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.452871 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6krxb\" (UniqueName: \"kubernetes.io/projected/de78657a-ca14-4c79-9b4b-7c01947a6cf3-kube-api-access-6krxb\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jul 10 19:04:04.558677 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.558624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:04.690514 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:04.690409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4sb_7d9a6410-eabb-4a5d-9d98-8dc774709785/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:06.192922 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.192884 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" path="/var/lib/kubelet/pods/de78657a-ca14-4c79-9b4b-7c01947a6cf3/volumes" Jul 10 19:04:06.426261 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.426231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/alertmanager/0.log" Jul 10 19:04:06.454177 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.454147 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/config-reloader/0.log" Jul 10 19:04:06.491345 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.491322 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/kube-rbac-proxy-web/0.log" Jul 10 19:04:06.527729 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.527696 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/kube-rbac-proxy/0.log" Jul 10 19:04:06.557000 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.556979 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/kube-rbac-proxy-metric/0.log" Jul 10 19:04:06.586337 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.586308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/prom-label-proxy/0.log" Jul 10 19:04:06.614904 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.614875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_33eba4c4-e3b7-412b-af9c-9db67b014b64/init-config-reloader/0.log" Jul 10 19:04:06.702208 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.702120 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-p8fcp_3116354c-4757-4ffe-b78d-b124ca3110aa/kube-state-metrics/0.log" Jul 10 19:04:06.733182 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.733156 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-p8fcp_3116354c-4757-4ffe-b78d-b124ca3110aa/kube-rbac-proxy-main/0.log" Jul 10 19:04:06.773974 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.773901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-p8fcp_3116354c-4757-4ffe-b78d-b124ca3110aa/kube-rbac-proxy-self/0.log" Jul 10 19:04:06.816272 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.816248 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d75498d-dmj8b_6b4b544d-bfe2-413e-9bb3-d3a8f154a9be/metrics-server/0.log" Jul 10 19:04:06.854722 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.854696 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-2gqpv_a0742a2d-5646-4df5-98f9-0aa951d5faf0/monitoring-plugin/0.log" Jul 10 19:04:06.890850 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.890781 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wjvq_997abcc4-577e-4463-ad65-7ee2bc7e86f8/node-exporter/0.log" Jul 10 19:04:06.923446 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.923414 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wjvq_997abcc4-577e-4463-ad65-7ee2bc7e86f8/kube-rbac-proxy/0.log" Jul 10 19:04:06.965710 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:06.965645 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wjvq_997abcc4-577e-4463-ad65-7ee2bc7e86f8/init-textfile/0.log" Jul 10 19:04:07.222820 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.222742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-d9k84_a88f2843-9ad0-4084-95e6-c1375e4235c7/kube-rbac-proxy-main/0.log" Jul 10 19:04:07.255557 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.255525 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-d9k84_a88f2843-9ad0-4084-95e6-c1375e4235c7/kube-rbac-proxy-self/0.log" Jul 10 19:04:07.297631 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.297600 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-d9k84_a88f2843-9ad0-4084-95e6-c1375e4235c7/openshift-state-metrics/0.log" Jul 10 19:04:07.356794 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.356770 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/prometheus/0.log" Jul 10 19:04:07.393005 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.392975 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/config-reloader/0.log" Jul 10 19:04:07.435025 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.434997 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/thanos-sidecar/0.log" Jul 10 19:04:07.476730 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.476661 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/kube-rbac-proxy-web/0.log" Jul 10 19:04:07.516179 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.515275 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/kube-rbac-proxy/0.log" Jul 10 19:04:07.545992 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.545964 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/kube-rbac-proxy-thanos/0.log" Jul 10 19:04:07.584833 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.584810 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ec7c2ab-c62d-4c39-8a7c-78b9d1d75eaa/init-config-reloader/0.log" Jul 10 19:04:07.620883 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.620848 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-tt746_2ec7160e-1188-4004-a4a9-dcf3d8074919/prometheus-operator/0.log" Jul 10 19:04:07.647890 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.647808 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-tt746_2ec7160e-1188-4004-a4a9-dcf3d8074919/kube-rbac-proxy/0.log" Jul 10 19:04:07.698146 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.698119 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-7nrqj_4f459005-f4c8-4cb6-9224-2d33fb6c06a9/prometheus-operator-admission-webhook/0.log" Jul 10 19:04:07.736897 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.736872 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78655945f4-hxgjg_a08aaede-49fd-47a1-8f17-bb15f2452679/telemeter-client/0.log" Jul 10 19:04:07.776862 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.776727 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78655945f4-hxgjg_a08aaede-49fd-47a1-8f17-bb15f2452679/reload/0.log" Jul 10 19:04:07.809148 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.808616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78655945f4-hxgjg_a08aaede-49fd-47a1-8f17-bb15f2452679/kube-rbac-proxy/0.log" Jul 10 19:04:07.856317 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.856288 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8679f9d5f4-nmmsn_59dc3ea8-cc22-4538-a3d9-724572c8f44c/thanos-query/0.log" Jul 10 19:04:07.891241 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.891210 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8679f9d5f4-nmmsn_59dc3ea8-cc22-4538-a3d9-724572c8f44c/kube-rbac-proxy-web/0.log" Jul 10 19:04:07.924866 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.924835 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8679f9d5f4-nmmsn_59dc3ea8-cc22-4538-a3d9-724572c8f44c/kube-rbac-proxy/0.log" Jul 10 19:04:07.957374 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.957344 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8679f9d5f4-nmmsn_59dc3ea8-cc22-4538-a3d9-724572c8f44c/prom-label-proxy/0.log" Jul 10 19:04:07.985406 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:07.985320 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8679f9d5f4-nmmsn_59dc3ea8-cc22-4538-a3d9-724572c8f44c/kube-rbac-proxy-rules/0.log" Jul 10 19:04:08.016416 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:08.016384 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8679f9d5f4-nmmsn_59dc3ea8-cc22-4538-a3d9-724572c8f44c/kube-rbac-proxy-metrics/0.log" Jul 10 19:04:10.045885 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.045861 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6656c47b96-lh6bn_af6e2a21-89a5-4cfc-8ae4-0bc31491660c/console/0.log" Jul 10 19:04:10.218815 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.218784 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx"] Jul 10 19:04:10.219151 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.219138 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="gather" Jul 10 19:04:10.219215 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.219153 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="gather" Jul 10 19:04:10.219215 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.219173 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="copy" Jul 10 19:04:10.219215 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.219179 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="copy" Jul 10 19:04:10.219322 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.219234 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="gather" Jul 10 19:04:10.219322 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.219243 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="de78657a-ca14-4c79-9b4b-7c01947a6cf3" containerName="copy" Jul 10 19:04:10.225850 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.225812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.233200 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.233175 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx"] Jul 10 19:04:10.316187 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.316115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-sys\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.316187 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.316183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-proc\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.316386 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.316247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-lib-modules\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.316386 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.316273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-podres\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.316386 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.316298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6bnb\" (UniqueName: \"kubernetes.io/projected/d8bb4a57-4afe-422e-838c-087f8a03c62c-kube-api-access-j6bnb\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417469 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-proc\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417660 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-lib-modules\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417660 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-podres\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417660 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6bnb\" (UniqueName: \"kubernetes.io/projected/d8bb4a57-4afe-422e-838c-087f8a03c62c-kube-api-access-j6bnb\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417660 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-sys\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417870 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-sys\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417870 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-proc\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.417972 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.417939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-lib-modules\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.418021 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.418006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8bb4a57-4afe-422e-838c-087f8a03c62c-podres\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.427522 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.427492 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6bnb\" (UniqueName: \"kubernetes.io/projected/d8bb4a57-4afe-422e-838c-087f8a03c62c-kube-api-access-j6bnb\") pod \"perf-node-gather-daemonset-nmccx\" (UID: \"d8bb4a57-4afe-422e-838c-087f8a03c62c\") " pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.541509 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.541478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:10.706659 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:10.705899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx"] Jul 10 19:04:10.710532 ip-10-0-129-211 kubenswrapper[2575]: W0710 19:04:10.710453 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd8bb4a57_4afe_422e_838c_087f8a03c62c.slice/crio-b5d3b427e9659fcbe77906f7e0331ac011e551e6a90cd5bd8875104841d24d9c WatchSource:0}: Error finding container b5d3b427e9659fcbe77906f7e0331ac011e551e6a90cd5bd8875104841d24d9c: Status 404 returned error can't find the container with id b5d3b427e9659fcbe77906f7e0331ac011e551e6a90cd5bd8875104841d24d9c Jul 10 19:04:11.288792 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.288746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" event={"ID":"d8bb4a57-4afe-422e-838c-087f8a03c62c","Type":"ContainerStarted","Data":"518f15ba092aac5b98308bed9da9505d3765f0c5f627a7b95a32b8929a27901d"} Jul 10 19:04:11.289310 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.288821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" event={"ID":"d8bb4a57-4afe-422e-838c-087f8a03c62c","Type":"ContainerStarted","Data":"b5d3b427e9659fcbe77906f7e0331ac011e551e6a90cd5bd8875104841d24d9c"} Jul 10 19:04:11.289656 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.289629 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:11.312604 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.312540 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" podStartSLOduration=1.312518911 podStartE2EDuration="1.312518911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:11.309255645 +0000 UTC m=+1425.608775864" watchObservedRunningTime="2026-07-10 19:04:11.312518911 +0000 UTC m=+1425.612039133" Jul 10 19:04:11.596724 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.596649 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frwg7_9ae22d66-db44-4903-b591-c0550b43cf29/dns/0.log" Jul 10 19:04:11.626410 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.626384 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frwg7_9ae22d66-db44-4903-b591-c0550b43cf29/kube-rbac-proxy/0.log" Jul 10 19:04:11.810334 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:11.810212 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g4mpc_eef46a16-6cf7-43b1-b015-06a7a7c688fa/dns-node-resolver/0.log" Jul 10 19:04:12.447505 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:12.447476 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvjm9_5aaf044d-3291-4235-b262-fcfd91af532b/node-ca/0.log" Jul 10 19:04:13.646247 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:13.646219 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8sdk4_6a14600a-4843-4fab-8408-6d3175c49d1d/serve-healthcheck-canary/0.log" Jul 10 19:04:14.200955 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:14.200928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84nwb_0963365b-07b6-4b5a-acf2-aaf768e5761f/kube-rbac-proxy/0.log" Jul 10 19:04:14.229106 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:14.229065 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84nwb_0963365b-07b6-4b5a-acf2-aaf768e5761f/exporter/0.log" Jul 10 19:04:14.253645 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:14.253627 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84nwb_0963365b-07b6-4b5a-acf2-aaf768e5761f/extractor/0.log" Jul 10 19:04:16.650271 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:16.650244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-4ls69_a0b3afc6-94b2-4704-8596-6751f2c28f77/s3-init/0.log" Jul 10 19:04:18.308558 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:18.308476 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fs9kw/perf-node-gather-daemonset-nmccx" Jul 10 19:04:22.811401 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.811369 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/kube-multus-additional-cni-plugins/0.log" Jul 10 19:04:22.840263 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.840232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/egress-router-binary-copy/0.log" Jul 10 19:04:22.869406 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.869377 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/cni-plugins/0.log" Jul 10 19:04:22.896042 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.896018 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/bond-cni-plugin/0.log" Jul 10 19:04:22.928686 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.928667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/routeoverride-cni/0.log" Jul 10 19:04:22.955528 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.955510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/whereabouts-cni-bincopy/0.log" Jul 10 19:04:22.986378 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:22.986355 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxvz9_1c3f90b4-212a-4972-9e18-949717cf8a26/whereabouts-cni/0.log" Jul 10 19:04:23.021015 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:23.020999 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hd5s6_5f2ea91f-2379-4915-ad7e-6b605dd96817/kube-multus/0.log" Jul 10 19:04:23.237207 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:23.237145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sh7h8_77b27729-1834-4b4f-9fd0-a7691aed9f7f/network-metrics-daemon/0.log" Jul 10 19:04:23.263274 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:23.263252 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sh7h8_77b27729-1834-4b4f-9fd0-a7691aed9f7f/kube-rbac-proxy/0.log" Jul 10 19:04:24.618811 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.618783 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-controller/0.log" Jul 10 19:04:24.650307 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.650284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/0.log" Jul 10 19:04:24.650600 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.650588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovn-acl-logging/1.log" Jul 10 19:04:24.673447 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.673427 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/kube-rbac-proxy-node/0.log" Jul 10 19:04:24.701938 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.701917 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 19:04:24.745575 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.745550 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/northd/0.log" Jul 10 19:04:24.783139 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.783112 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/nbdb/0.log" Jul 10 19:04:24.820912 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.820888 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/sbdb/0.log" Jul 10 19:04:24.883555 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:24.883484 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2pms_95c2ffa6-dda7-485a-969a-375a2ae85241/ovnkube-controller/0.log" Jul 10 19:04:26.040816 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:26.040787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cwwx2_908bdb08-3e7e-481e-a6a6-10436d5e6812/network-check-target-container/0.log" Jul 10 19:04:27.157020 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:27.156995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-gtwv5_68cae9d4-2bde-43a8-adf9-6bcfa511585d/iptables-alerter/0.log" Jul 10 19:04:27.897847 ip-10-0-129-211 kubenswrapper[2575]: I0710 19:04:27.897817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7sjt7_3d872580-31d5-484e-8858-71b1f497fee5/tuned/0.log"