Jul 24 09:00:46.666572 ip-10-0-135-101 systemd[1]: Starting Kubernetes Kubelet... Jul 24 09:00:47.841405 ip-10-0-135-101 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 09:00:47.841405 ip-10-0-135-101 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 09:00:47.841405 ip-10-0-135-101 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 09:00:47.841405 ip-10-0-135-101 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 09:00:47.841405 ip-10-0-135-101 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 09:00:47.842187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.842067 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 09:00:47.847311 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847292 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:00:47.847311 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847310 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847314 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847318 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847323 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847326 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847330 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847334 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847337 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847341 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847345 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847371 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847375 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847379 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847382 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847385 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847387 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847391 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847393 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847396 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:00:47.847399 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847399 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847402 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847405 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847408 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847411 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847414 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847417 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847420 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847422 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847425 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847429 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847432 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847434 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847437 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847440 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847444 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847447 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847451 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847454 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:00:47.847943 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847456 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847459 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847462 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847466 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847468 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847471 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847474 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847476 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847479 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847481 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847484 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847486 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847489 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847492 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847494 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847498 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847501 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847504 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847506 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847509 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:00:47.848442 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847512 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847515 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847518 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847520 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847523 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847525 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847528 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847531 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847534 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847536 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847541 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847543 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847546 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847551 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847554 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847557 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847560 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847563 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847567 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847570 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:00:47.848952 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847573 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847575 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847578 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847581 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847583 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847586 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847589 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847592 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847595 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847598 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847601 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847603 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847606 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847608 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847611 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847614 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847617 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847619 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847622 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.847625 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:00:47.849521 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848425 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848433 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848437 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848440 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848443 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848447 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848451 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848454 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848457 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848461 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848466 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848470 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848473 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848477 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848480 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848483 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848487 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848490 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848493 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:00:47.850028 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848497 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848500 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848503 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848506 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848509 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848512 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848515 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848517 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848520 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848524 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848528 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848531 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848534 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848537 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848540 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848542 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848545 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848548 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848551 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848554 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:00:47.850547 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848556 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848559 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848562 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848566 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848569 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848571 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848574 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848578 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848582 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848585 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848588 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848591 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848594 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848597 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848600 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848604 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848606 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848609 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848612 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:00:47.851048 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848615 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848617 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848620 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848623 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848626 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848629 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848631 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848634 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848637 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848640 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848643 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848646 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848649 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848652 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848655 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848658 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848660 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848663 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848666 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848668 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:00:47.851561 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848671 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848675 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848677 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848680 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848683 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848686 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848689 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848692 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848694 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848697 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848699 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848702 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848705 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848708 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848710 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848713 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848716 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848719 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848721 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848724 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:00:47.852075 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.848727 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849119 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849124 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849128 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849130 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849134 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849137 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849140 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849143 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849146 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849149 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849152 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849155 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849158 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849161 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849163 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849167 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849171 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849173 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:00:47.852611 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849176 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849179 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849182 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849185 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849187 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849190 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849193 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849196 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849198 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849201 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849204 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849207 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849210 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849213 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849215 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849218 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849221 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849223 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849226 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849229 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:00:47.853110 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849232 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849235 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849238 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849241 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849244 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849247 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849249 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849252 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849256 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849260 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849263 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849267 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849270 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849272 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849275 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849278 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849280 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849283 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849286 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849289 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:00:47.853637 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849291 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849294 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849298 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849316 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849320 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849324 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849326 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849330 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849332 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849335 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849338 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849347 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849350 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849353 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849370 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849373 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849376 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849379 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849381 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849384 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:00:47.854156 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849387 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849390 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849392 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849395 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849398 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849401 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849404 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849407 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849409 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849412 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849415 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849418 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849420 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849423 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849426 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849429 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849437 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849440 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849442 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849446 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:00:47.854724 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.849448 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849518 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849526 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849535 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849540 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849544 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849548 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849553 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849557 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849561 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849564 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849568 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849571 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849575 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849578 2554 flags.go:64] FLAG: --cgroup-root="" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849581 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849584 2554 flags.go:64] FLAG: --client-ca-file="" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849587 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849591 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849596 2554 flags.go:64] FLAG: --cluster-domain="" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849599 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849603 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849606 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849610 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 09:00:47.855253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849614 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849617 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849621 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849624 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849630 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849633 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849636 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849640 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849643 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849648 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849651 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849656 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849659 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849663 2554 flags.go:64] FLAG: --enable-server="true" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849667 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849671 2554 flags.go:64] FLAG: --event-burst="100" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849675 2554 flags.go:64] FLAG: --event-qps="50" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849678 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849681 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849684 2554 flags.go:64] FLAG: --eviction-hard="" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849688 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849691 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849695 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849698 2554 flags.go:64] FLAG: --eviction-soft="" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849701 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 09:00:47.855888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849704 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849708 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849711 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849714 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849717 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849720 2554 flags.go:64] FLAG: --feature-gates="" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849724 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849728 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849731 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849734 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849737 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849742 2554 flags.go:64] FLAG: --help="false" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849745 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-135-101.ec2.internal" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849748 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849751 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849755 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849758 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849762 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849767 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849770 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849773 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849777 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849780 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849784 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 09:00:47.856558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849786 2554 flags.go:64] FLAG: --kube-reserved="" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849789 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849793 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849796 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849799 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849802 2554 flags.go:64] FLAG: --lock-file="" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849805 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849808 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849811 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849817 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849820 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849823 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849826 2554 flags.go:64] FLAG: --logging-format="text" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849829 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849833 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849836 2554 flags.go:64] FLAG: --manifest-url="" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849839 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849844 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849847 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849852 2554 flags.go:64] FLAG: --max-pods="110" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849855 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849859 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849862 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849866 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849869 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 09:00:47.857187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849872 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849876 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849889 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849892 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849896 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849899 2554 flags.go:64] FLAG: --pod-cidr="" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849902 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849908 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849911 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849915 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849918 2554 flags.go:64] FLAG: --port="10250" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849922 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849925 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0909484c79c785942" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849928 2554 flags.go:64] FLAG: --qos-reserved="" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849931 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849934 2554 flags.go:64] FLAG: --register-node="true" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849938 2554 flags.go:64] FLAG: --register-with-taints="" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849942 2554 flags.go:64] FLAG: --registry-burst="10" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849945 2554 flags.go:64] FLAG: --registry-qps="5" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849947 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849950 2554 flags.go:64] FLAG: --reserved-memory="" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849954 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849959 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849962 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849965 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 09:00:47.857846 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849968 2554 flags.go:64] FLAG: --runonce="false" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849972 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849976 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849979 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849982 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849985 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849988 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849991 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849995 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.849999 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850002 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850005 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850008 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850011 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850015 2554 flags.go:64] FLAG: --system-cgroups="" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850018 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850024 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850027 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850030 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850035 2554 flags.go:64] FLAG: --tls-min-version="" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850038 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850041 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850045 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850048 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850051 2554 flags.go:64] FLAG: --v="2" Jul 24 09:00:47.858536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850055 2554 flags.go:64] FLAG: --version="false" Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850060 2554 flags.go:64] FLAG: --vmodule="" Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850063 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.850067 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850187 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850191 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850195 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850198 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850203 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850206 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850208 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850211 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850214 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850216 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850220 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850222 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850226 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850229 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850231 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850234 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850237 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:00:47.859174 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850239 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850243 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850246 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850248 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850251 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850254 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850256 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850259 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850262 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850264 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850267 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850269 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850272 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850275 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850277 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850280 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850283 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850286 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850288 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850292 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:00:47.859722 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850295 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850298 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850300 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850304 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850306 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850309 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850312 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850315 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850318 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850320 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850323 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850326 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850329 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850332 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850335 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850338 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850340 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850345 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:00:47.860242 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850349 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850353 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850370 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850374 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850377 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850380 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850383 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850387 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850390 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850393 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850396 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850399 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850402 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850407 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850410 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850413 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850416 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850419 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850422 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850425 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:00:47.860765 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850428 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850431 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850434 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850437 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850440 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850443 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850446 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850449 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850451 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850455 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850458 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850461 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850464 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850466 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850470 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850474 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850477 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850480 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850484 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850487 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:00:47.861286 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850490 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850492 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850495 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.850498 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.851046 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.858828 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.858845 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.858866 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.858873 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858941 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858947 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858950 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858954 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858957 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858960 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:00:47.861991 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858963 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858966 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858969 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858971 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858974 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858977 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858986 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858989 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.858993 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859001 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859005 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859008 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859011 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859013 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859016 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859019 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859022 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859025 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859027 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859030 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:00:47.862660 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859033 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859036 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859039 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859043 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859046 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859049 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859052 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859055 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859057 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859062 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859066 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859069 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859072 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859075 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859078 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859080 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859083 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859086 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859089 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:00:47.863466 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859101 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859105 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859108 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859112 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859115 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859117 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859120 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859123 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859126 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859129 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859131 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859134 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859136 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859139 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859142 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859145 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859148 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859151 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859154 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:00:47.864003 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859157 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859160 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859163 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859165 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859168 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859171 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859173 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859177 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859180 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859182 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859185 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859188 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859191 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859194 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859202 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859206 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859208 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859211 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859214 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859216 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:00:47.864540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859219 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859222 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859224 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859227 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859230 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859232 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859235 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859238 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859241 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859244 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859249 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859253 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859256 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859259 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859262 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:00:47.865098 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.859268 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859450 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859456 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859460 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859463 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859466 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859471 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859474 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859478 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859481 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859484 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859487 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859496 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859500 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859502 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859505 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859509 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859512 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859515 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 09:00:47.865523 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859518 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859521 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859525 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859527 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859532 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859535 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859538 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859541 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859544 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859547 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859550 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859552 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859555 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859557 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859560 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859563 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859566 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859568 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859571 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859574 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 09:00:47.866007 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859576 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859579 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859582 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859584 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859587 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859590 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859599 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859603 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859606 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859609 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859612 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859615 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859618 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859620 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859623 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859626 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859629 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859631 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859635 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 09:00:47.866541 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859638 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859640 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859643 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859645 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859648 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859651 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859653 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859656 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859659 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859661 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859664 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859667 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859669 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859672 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859675 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859677 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859680 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859683 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859686 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859688 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 09:00:47.867029 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859697 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859700 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859703 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859706 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859708 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859711 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859714 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859717 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859719 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859722 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859725 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859728 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859731 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859734 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859737 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859740 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859742 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859745 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859748 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859750 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 09:00:47.867594 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859753 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:47.859756 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.859768 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.859898 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.863374 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.864995 2554 server.go:1019] "Starting client certificate rotation" Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.865097 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.865138 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 09:00:47.868104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.867325 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 09:00:47.868659 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.868641 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 09:00:47.881674 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.881653 2554 log.go:25] "Validated CRI v1 runtime API" Jul 24 09:00:47.883718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.883696 2554 log.go:25] "Validated CRI v1 image API" Jul 24 09:00:47.884611 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.884594 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 09:00:47.887802 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.887773 2554 fs.go:135] Filesystem UUIDs: map[1b075989-34bd-419b-b00f-3e16c4d38c87:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 95ae1600-f0ce-4b29-9ab5-479f4cc25b74:/dev/nvme0n1p4] Jul 24 09:00:47.887882 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.887801 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 09:00:47.894582 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.894465 2554 manager.go:216] Machine: {Timestamp:2026-07-24 09:00:47.893044429 +0000 UTC m=+1.118058044 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3154947 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29c2a3fa4759749d972bb5997b312f SystemUUID:ec29c2a3-fa47-5974-9d97-2bb5997b312f BootID:b54e1e9d-04dc-43d7-a0b5-58f829d6162f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:15:ba:30:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:15:ba:30:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:67:c0:c5:59:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 09:00:47.894582 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.894581 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 09:00:47.894699 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.894665 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 09:00:47.897415 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.897384 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 09:00:47.897562 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.897419 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 09:00:47.898108 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.898097 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 09:00:47.898146 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.898110 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 09:00:47.898146 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.898118 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 09:00:47.898554 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.898542 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 09:00:47.899489 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.899478 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 09:00:47.900004 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.899987 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 09:00:47.901449 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901437 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 24 09:00:47.901572 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901562 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 09:00:47.901610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901600 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 24 09:00:47.901642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901616 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 09:00:47.901642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901633 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 09:00:47.901727 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901644 2554 kubelet.go:398] "Adding apiserver pod source" Jul 24 09:00:47.901727 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.901655 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 09:00:47.902095 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.902082 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 09:00:47.902138 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.902102 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 09:00:47.906003 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.905979 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 09:00:47.907875 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.907861 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 09:00:47.907929 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.907893 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 09:00:47.909546 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909526 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 09:00:47.909597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909556 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 09:00:47.909597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909565 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 09:00:47.909597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909572 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 09:00:47.909597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909583 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 09:00:47.909597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909589 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 09:00:47.909597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909598 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 09:00:47.909767 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909606 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 09:00:47.909767 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909617 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 09:00:47.909767 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909625 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 09:00:47.909767 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909634 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 09:00:47.909767 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.909640 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 09:00:47.910425 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.910413 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 09:00:47.910458 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.910427 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 09:00:47.912702 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.912671 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 09:00:47.912702 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.912680 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 09:00:47.912702 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.912693 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 09:00:47.913978 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.913963 2554 server.go:1268] "Started kubelet" Jul 24 09:00:47.914077 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.914048 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 09:00:47.914777 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.914723 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 09:00:47.914900 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.914798 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 09:00:47.914847 ip-10-0-135-101 systemd[1]: Started Kubernetes Kubelet. Jul 24 09:00:47.916453 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.916428 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 09:00:47.916868 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.916856 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 24 09:00:47.918878 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.918859 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 09:00:47.919620 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.918817 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-101.ec2.internal.18c52e3897503fa8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-101.ec2.internal,UID:ip-10-0-135-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-101.ec2.internal,},FirstTimestamp:2026-07-24 09:00:47.91393476 +0000 UTC m=+1.138948376,LastTimestamp:2026-07-24 09:00:47.91393476 +0000 UTC m=+1.138948376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-101.ec2.internal,}" Jul 24 09:00:47.921122 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.921097 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2cmff" Jul 24 09:00:47.923736 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.923717 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 09:00:47.923736 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.923728 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 09:00:47.923882 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.923800 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:47.924434 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924415 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 09:00:47.924535 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924439 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 09:00:47.924535 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924460 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 09:00:47.924704 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924690 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 24 09:00:47.924791 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924777 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 24 09:00:47.924853 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924828 2554 factory.go:153] Registering CRI-O factory Jul 24 09:00:47.924853 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924841 2554 factory.go:223] Registration of the crio container factory successfully Jul 24 09:00:47.924952 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924908 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 09:00:47.924952 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924918 2554 factory.go:55] Registering systemd factory Jul 24 09:00:47.924952 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924927 2554 factory.go:223] Registration of the systemd container factory successfully Jul 24 09:00:47.924952 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924948 2554 factory.go:103] Registering Raw factory Jul 24 09:00:47.925134 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.924961 2554 manager.go:1196] Started watching for new ooms in manager Jul 24 09:00:47.925606 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.925588 2554 manager.go:349] Starting recovery of all containers Jul 24 09:00:47.927524 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.927500 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2cmff" Jul 24 09:00:47.932238 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.932203 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 09:00:47.935315 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.934803 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:00:47.938204 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.938185 2554 manager.go:354] Recovery completed Jul 24 09:00:47.938994 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.938973 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-101.ec2.internal\" not found" node="ip-10-0-135-101.ec2.internal" Jul 24 09:00:47.944060 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.944040 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:47.945922 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.945903 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:47.945998 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.945935 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:47.945998 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.945947 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:47.946535 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.946519 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 09:00:47.946535 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.946532 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:47.946535 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.946534 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 09:00:47.946719 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.946553 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 24 09:00:47.947272 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.947256 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:47.947372 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.947290 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:47.947372 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.947306 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:47.948474 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.948461 2554 policy_none.go:49] "None policy: Start" Jul 24 09:00:47.948541 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.948478 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 09:00:47.948541 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.948488 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 09:00:47.949732 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.949718 2554 policy_none.go:47] "Start" Jul 24 09:00:47.992135 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.991949 2554 manager.go:337] "Starting Device Plugin manager" Jul 24 09:00:47.992284 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.992159 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 09:00:47.992284 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.992172 2554 server.go:87] "Starting device plugin registration server" Jul 24 09:00:47.992431 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.992420 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 09:00:47.992463 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.992434 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 09:00:47.992577 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.992557 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 09:00:47.992681 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.992667 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 09:00:47.992779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:47.992681 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 09:00:47.993276 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.993252 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 09:00:47.993396 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:47.993323 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.093946 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.093884 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:48.095007 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.094941 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:48.095007 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.094995 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:48.095007 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.095006 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:48.095148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.095034 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.103994 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.103976 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.104091 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.104001 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-101.ec2.internal\": node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.104170 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.104150 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 09:00:48.104206 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.104193 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 09:00:48.104240 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.104215 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 09:00:48.104327 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.104254 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 09:00:48.106653 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.106636 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:00:48.161590 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.161563 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.206634 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.206576 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"] Jul 24 09:00:48.206780 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.206669 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:48.207724 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.207697 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:48.207834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.207731 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:48.207834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.207745 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:48.209109 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209096 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:48.209225 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209211 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.209264 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209248 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:48.209903 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209885 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:48.209997 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209890 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:48.209997 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209916 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:48.209997 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209926 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:48.209997 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209936 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:48.209997 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.209949 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:48.211124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.211107 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.211203 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.211135 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 09:00:48.211841 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.211822 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory" Jul 24 09:00:48.211935 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.211849 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 09:00:48.211935 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.211861 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID" Jul 24 09:00:48.225969 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.225953 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-101.ec2.internal\" not found" node="ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.226202 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.226183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed436c2c06eb421aaa817d4e8a2cf780-config\") pod \"kube-apiserver-proxy-ip-10-0-135-101.ec2.internal\" (UID: \"ed436c2c06eb421aaa817d4e8a2cf780\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.226264 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.226210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5914545796d27e5f7bd262f1db2d1af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"5914545796d27e5f7bd262f1db2d1af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.226264 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.226228 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5914545796d27e5f7bd262f1db2d1af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"5914545796d27e5f7bd262f1db2d1af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.230043 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.230028 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-101.ec2.internal\" not found" node="ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.262550 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.262523 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.327204 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.327166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed436c2c06eb421aaa817d4e8a2cf780-config\") pod \"kube-apiserver-proxy-ip-10-0-135-101.ec2.internal\" (UID: \"ed436c2c06eb421aaa817d4e8a2cf780\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.327204 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.327199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5914545796d27e5f7bd262f1db2d1af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"5914545796d27e5f7bd262f1db2d1af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.327449 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.327219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5914545796d27e5f7bd262f1db2d1af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"5914545796d27e5f7bd262f1db2d1af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.327449 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.327267 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5914545796d27e5f7bd262f1db2d1af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"5914545796d27e5f7bd262f1db2d1af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.327449 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.327280 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed436c2c06eb421aaa817d4e8a2cf780-config\") pod \"kube-apiserver-proxy-ip-10-0-135-101.ec2.internal\" (UID: \"ed436c2c06eb421aaa817d4e8a2cf780\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.327449 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.327280 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5914545796d27e5f7bd262f1db2d1af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"5914545796d27e5f7bd262f1db2d1af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.365201 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.365137 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.467515 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.467471 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.528753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.528718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.533680 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.533662 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" Jul 24 09:00:48.568273 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.568235 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.670950 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.670849 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.771297 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.771243 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.864478 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.864442 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 09:00:48.864956 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.864617 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 09:00:48.864956 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.864626 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 09:00:48.872337 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.872310 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:48.932311 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.932211 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 08:55:48 +0000 UTC" deadline="2028-03-20 19:26:37.042874801 +0000 UTC" Jul 24 09:00:48.932311 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.932241 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14530h25m48.110637494s" Jul 24 09:00:48.956194 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:48.956170 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:00:48.972770 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:48.972747 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:49.073456 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.073418 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:49.149939 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:49.149904 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded436c2c06eb421aaa817d4e8a2cf780.slice/crio-ec255319f9d1040f9d32a8047e7c55b028965990c86bbd9e559d8d53fbb3c7e4 WatchSource:0}: Error finding container ec255319f9d1040f9d32a8047e7c55b028965990c86bbd9e559d8d53fbb3c7e4: Status 404 returned error can't find the container with id ec255319f9d1040f9d32a8047e7c55b028965990c86bbd9e559d8d53fbb3c7e4 Jul 24 09:00:49.150154 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:49.150126 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5914545796d27e5f7bd262f1db2d1af6.slice/crio-95f391d666a98873f8455d08f6f5dc18dd0dff73d490acd082886555ac5a7ced WatchSource:0}: Error finding container 95f391d666a98873f8455d08f6f5dc18dd0dff73d490acd082886555ac5a7ced: Status 404 returned error can't find the container with id 95f391d666a98873f8455d08f6f5dc18dd0dff73d490acd082886555ac5a7ced Jul 24 09:00:49.155976 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.155959 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 09:00:49.173691 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.173663 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:49.276434 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.276393 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:49.377031 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.376988 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:49.478249 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.478206 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found" Jul 24 09:00:49.518983 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.518951 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:00:49.524394 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.524378 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" Jul 24 09:00:49.537689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.537624 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 09:00:49.538722 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.538705 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" Jul 24 09:00:49.552171 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.552149 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 09:00:49.903094 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.903009 2554 apiserver.go:52] "Watching apiserver" Jul 24 09:00:49.915377 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.914601 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 09:00:49.915837 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.915804 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kfrml","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm","openshift-dns/node-resolver-b2858","openshift-image-registry/node-ca-wzm7c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-787dc","openshift-multus/multus-kj5f4","kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hxxcj","openshift-multus/network-metrics-daemon-ctznw","openshift-network-diagnostics/network-check-target-x6xwp","openshift-network-operator/iptables-alerter-zfhlc","openshift-ovn-kubernetes/ovnkube-node-k9f4x","kube-system/global-pull-secret-syncer-gct5x"] Jul 24 09:00:49.917700 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.917631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.919181 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.919158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:49.919288 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.919237 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:00:49.920330 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.920307 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fzkjz\"" Jul 24 09:00:49.920474 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.920448 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:49.921448 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.921204 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 09:00:49.921595 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.921572 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.921789 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.921772 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 09:00:49.921981 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.921965 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.923627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.922904 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:49.923627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.923440 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.923627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.923527 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lvr6f\"" Jul 24 09:00:49.925980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.924084 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.925980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.924256 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 09:00:49.925980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.925880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:49.925980 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.925940 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:00:49.927347 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.926644 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.927347 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.926792 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v774t\"" Jul 24 09:00:49.927347 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.926955 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.927347 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.926652 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 09:00:49.930161 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.929097 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:49.930161 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.929741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:49.932642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.931487 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:49.934075 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.932815 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:49.935020 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.934346 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2p5wc\"" Jul 24 09:00:49.935020 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.934411 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 09:00:49.935020 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.934654 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 09:00:49.935020 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.934660 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 09:00:49.935020 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.934826 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.935020 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.934871 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hpdbx\"" Jul 24 09:00:49.935472 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.935056 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.935472 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.935243 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.936620 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.935616 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7q92w\"" Jul 24 09:00:49.936620 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.935965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:49.936620 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:49.936037 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:00:49.936620 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.936119 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:49.936870 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.936700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:49.936931 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.936881 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 09:00:49.937834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.937482 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 09:00:49.937834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.937512 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xnq9x\"" Jul 24 09:00:49.937834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.937694 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 09:00:49.937834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.937782 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.938117 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.937978 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-cni-bin\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938117 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-cni-multus\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938117 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938031 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.938117 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-daemon-config\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938117 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56c58aa5-e6a2-4804-8f5a-aed5751fde00-host\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:49.938117 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-kubelet-config\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-dbus\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938147 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-cni-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-os-release\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-hostroot\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-etc-kubernetes\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938266 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-kubelet\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjnq\" (UniqueName: \"kubernetes.io/projected/5c13b14a-81ba-4718-9ca3-35d736c972a7-kube-api-access-7cjnq\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938479 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e58a784-5951-40d4-92b0-cf6fe5bad774-hosts-file\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-socket-dir-parent\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938595 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-system-cni-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-multus-certs\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c13b14a-81ba-4718-9ca3-35d736c972a7-cni-binary-copy\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938679 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-netns\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938713 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-cnibin\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938752 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxt75\" (UniqueName: \"kubernetes.io/projected/0e58a784-5951-40d4-92b0-cf6fe5bad774-kube-api-access-fxt75\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938815 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-conf-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e58a784-5951-40d4-92b0-cf6fe5bad774-tmp-dir\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56c58aa5-e6a2-4804-8f5a-aed5751fde00-serviceca\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lslk5\" (UniqueName: \"kubernetes.io/projected/56c58aa5-e6a2-4804-8f5a-aed5751fde00-kube-api-access-lslk5\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:49.938984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.938939 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-k8s-cni-cncf-io\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:49.939851 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.939679 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 09:00:49.940273 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.940244 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 09:00:49.940856 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.940792 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pg8w9\"" Jul 24 09:00:49.941130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.941112 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 09:00:49.941440 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.941395 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w8zfp\"" Jul 24 09:00:49.942148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.941891 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 09:00:49.942148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.942144 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 09:00:49.949914 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.949892 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 09:00:49.969427 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.969104 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:00:49.988477 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.988446 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpdpd" Jul 24 09:00:49.998111 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:49.998090 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpdpd" Jul 24 09:00:50.026104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.026028 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 09:00:50.039524 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-etc-kubernetes\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.039678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-cni-netd\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.039678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.039678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwlcc\" (UniqueName: \"kubernetes.io/projected/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-kube-api-access-vwlcc\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.039678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-env-overrides\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.039678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovn-node-metrics-cert\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.039678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039654 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-etc-kubernetes\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b-konnectivity-ca\") pod \"konnectivity-agent-kfrml\" (UID: \"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b\") " pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-device-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-socket-dir-parent\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-multus-certs\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-systemd-units\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039885 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-sys-fs\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cnibin\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039937 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-os-release\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.039967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039981 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-socket-dir-parent\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.039989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-socket-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040029 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-multus-certs\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-etc-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-cnibin\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-var-lib-kubelet\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040170 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-slash\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovnkube-config\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040245 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56c58aa5-e6a2-4804-8f5a-aed5751fde00-serviceca\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lslk5\" (UniqueName: \"kubernetes.io/projected/56c58aa5-e6a2-4804-8f5a-aed5751fde00-kube-api-access-lslk5\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040393 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-modprobe-d\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.040426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-sys\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040459 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-run-netns\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040471 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-cnibin\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-ovn\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040593 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-system-cni-dir\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysconfig\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-cni-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-hostroot\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e58a784-5951-40d4-92b0-cf6fe5bad774-hosts-file\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-run\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040780 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-hostroot\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040781 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-cni-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040836 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e58a784-5951-40d4-92b0-cf6fe5bad774-hosts-file\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040852 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56c58aa5-e6a2-4804-8f5a-aed5751fde00-serviceca\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.041092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-kubelet\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjnq\" (UniqueName: \"kubernetes.io/projected/5c13b14a-81ba-4718-9ca3-35d736c972a7-kube-api-access-7cjnq\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040939 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-kubelet\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.040962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-kubernetes\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-systemd\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-var-lib-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-cni-bin\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgpfz\" (UniqueName: \"kubernetes.io/projected/f239f931-1d0b-46d0-9cec-4bb5eb586232-kube-api-access-pgpfz\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lqbt\" (UniqueName: \"kubernetes.io/projected/e05dfa0d-ccac-44da-a18a-923316c63c29-kube-api-access-4lqbt\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-system-cni-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041172 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-tuned\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041212 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-system-cni-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vbxx\" (UniqueName: \"kubernetes.io/projected/e78b0558-fd5c-4b81-9229-6bb4646e6157-kube-api-access-5vbxx\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-log-socket\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041337 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c13b14a-81ba-4718-9ca3-35d736c972a7-cni-binary-copy\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041390 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-node-log\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.041809 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-netns\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxt75\" (UniqueName: \"kubernetes.io/projected/0e58a784-5951-40d4-92b0-cf6fe5bad774-kube-api-access-fxt75\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041467 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-netns\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-lib-modules\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-host\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-systemd\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-iptables-alerter-script\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-conf-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e58a784-5951-40d4-92b0-cf6fe5bad774-tmp-dir\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041684 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b-agent-certs\") pod \"konnectivity-agent-kfrml\" (UID: \"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b\") " pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.041710 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-conf-dir\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cni-binary-copy\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.041786 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:00:50.541761946 +0000 UTC m=+3.766775579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-registration-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.042622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5pj\" (UniqueName: \"kubernetes.io/projected/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-kube-api-access-jw5pj\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-k8s-cni-cncf-io\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041938 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c13b14a-81ba-4718-9ca3-35d736c972a7-cni-binary-copy\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041963 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysctl-d\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-run-k8s-cni-cncf-io\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.041994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysctl-conf\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-host-slash\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042034 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e58a784-5951-40d4-92b0-cf6fe5bad774-tmp-dir\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kckh\" (UniqueName: \"kubernetes.io/projected/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-kube-api-access-8kckh\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-cni-bin\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-cni-multus\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-daemon-config\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042156 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e78b0558-fd5c-4b81-9229-6bb4646e6157-tmp\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042181 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-kubelet\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042185 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-cni-bin\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042197 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-host-var-lib-cni-multus\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.043279 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042206 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovnkube-script-lib\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56c58aa5-e6a2-4804-8f5a-aed5751fde00-host\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-kubelet-config\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-dbus\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042404 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-os-release\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042417 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56c58aa5-e6a2-4804-8f5a-aed5751fde00-host\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042421 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-kubelet-config\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042530 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c13b14a-81ba-4718-9ca3-35d736c972a7-os-release\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042627 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-dbus\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:50.044106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.042883 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5c13b14a-81ba-4718-9ca3-35d736c972a7-multus-daemon-config\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.052652 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.052622 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 09:00:50.057928 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.057804 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 09:00:50.059845 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.059822 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:00:50.059970 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.059854 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:00:50.059970 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.059869 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:50.059970 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.059965 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:50.559922505 +0000 UTC m=+3.784936122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:50.062187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.062163 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjnq\" (UniqueName: \"kubernetes.io/projected/5c13b14a-81ba-4718-9ca3-35d736c972a7-kube-api-access-7cjnq\") pod \"multus-kj5f4\" (UID: \"5c13b14a-81ba-4718-9ca3-35d736c972a7\") " pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.062187 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.062172 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lslk5\" (UniqueName: \"kubernetes.io/projected/56c58aa5-e6a2-4804-8f5a-aed5751fde00-kube-api-access-lslk5\") pod \"node-ca-wzm7c\" (UID: \"56c58aa5-e6a2-4804-8f5a-aed5751fde00\") " pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.064063 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.064042 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxt75\" (UniqueName: \"kubernetes.io/projected/0e58a784-5951-40d4-92b0-cf6fe5bad774-kube-api-access-fxt75\") pod \"node-resolver-b2858\" (UID: \"0e58a784-5951-40d4-92b0-cf6fe5bad774\") " pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.109631 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.109574 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" event={"ID":"5914545796d27e5f7bd262f1db2d1af6","Type":"ContainerStarted","Data":"95f391d666a98873f8455d08f6f5dc18dd0dff73d490acd082886555ac5a7ced"} Jul 24 09:00:50.110827 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.110795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" event={"ID":"ed436c2c06eb421aaa817d4e8a2cf780","Type":"ContainerStarted","Data":"ec255319f9d1040f9d32a8047e7c55b028965990c86bbd9e559d8d53fbb3c7e4"} Jul 24 09:00:50.143613 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143571 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-iptables-alerter-script\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.143788 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b-agent-certs\") pod \"konnectivity-agent-kfrml\" (UID: \"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b\") " pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.143788 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cni-binary-copy\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.143788 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143700 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-registration-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.143788 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:50.143788 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5pj\" (UniqueName: \"kubernetes.io/projected/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-kube-api-access-jw5pj\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:50.143788 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysctl-d\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysctl-conf\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143830 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-host-slash\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kckh\" (UniqueName: \"kubernetes.io/projected/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-kube-api-access-8kckh\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e78b0558-fd5c-4b81-9229-6bb4646e6157-tmp\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-kubelet\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143957 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.143984 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovnkube-script-lib\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-cni-netd\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysctl-conf\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.144112 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwlcc\" (UniqueName: \"kubernetes.io/projected/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-kube-api-access-vwlcc\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-env-overrides\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144150 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovn-node-metrics-cert\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b-konnectivity-ca\") pod \"konnectivity-agent-kfrml\" (UID: \"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b\") " pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144203 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-registration-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-device-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144213 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysctl-d\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-systemd-units\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-device-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-sys-fs\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144327 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-host-slash\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cnibin\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-os-release\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-iptables-alerter-script\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144408 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cni-binary-copy\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-socket-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.144718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cnibin\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-cni-netd\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-etc-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-systemd-units\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144522 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-etc-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.144862 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.144947 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:50.64492569 +0000 UTC m=+3.869939295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.144547 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145351 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145323 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-sys-fs\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145415 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-os-release\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-var-lib-kubelet\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145482 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-slash\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovnkube-config\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-modprobe-d\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-sys\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.145662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-run-netns\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.145996 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.146057 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-ovn\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.146057 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.146174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-system-cni-dir\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.146174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysconfig\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.145660 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146415 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-var-lib-kubelet\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-run\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-kubernetes\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-systemd\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146584 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-var-lib-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146620 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-cni-bin\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146625 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-slash\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgpfz\" (UniqueName: \"kubernetes.io/projected/f239f931-1d0b-46d0-9cec-4bb5eb586232-kube-api-access-pgpfz\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lqbt\" (UniqueName: \"kubernetes.io/projected/e05dfa0d-ccac-44da-a18a-923316c63c29-kube-api-access-4lqbt\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-tuned\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vbxx\" (UniqueName: \"kubernetes.io/projected/e78b0558-fd5c-4b81-9229-6bb4646e6157-kube-api-access-5vbxx\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-log-socket\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146821 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b-agent-certs\") pod \"konnectivity-agent-kfrml\" (UID: \"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b\") " pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-run\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.148876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146959 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-kubelet\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.146961 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147049 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147108 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-log-socket\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147151 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovnkube-config\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147158 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-run-netns\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147327 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-systemd\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147407 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-var-lib-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147590 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-host-cni-bin\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147625 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-ovn\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147680 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147696 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-openvswitch\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147862 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147954 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-sysconfig\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e05dfa0d-ccac-44da-a18a-923316c63c29-socket-dir\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148027 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-system-cni-dir\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.149801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148346 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-kubernetes\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148477 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-modprobe-d\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.147676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-sys\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-node-log\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-lib-modules\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-host\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-systemd\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148687 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-run-systemd\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148740 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f239f931-1d0b-46d0-9cec-4bb5eb586232-node-log\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148796 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-lib-modules\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148811 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e78b0558-fd5c-4b81-9229-6bb4646e6157-tmp\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.148867 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e78b0558-fd5c-4b81-9229-6bb4646e6157-host\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.149213 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-env-overrides\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.149321 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovnkube-script-lib\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.150605 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.149520 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b-konnectivity-ca\") pod \"konnectivity-agent-kfrml\" (UID: \"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b\") " pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.151951 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.151720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f239f931-1d0b-46d0-9cec-4bb5eb586232-ovn-node-metrics-cert\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.153309 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.153248 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e78b0558-fd5c-4b81-9229-6bb4646e6157-etc-tuned\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.156163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.156141 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kckh\" (UniqueName: \"kubernetes.io/projected/ea0b9cf8-6b7b-45f6-8ea1-7433de538519-kube-api-access-8kckh\") pod \"iptables-alerter-zfhlc\" (UID: \"ea0b9cf8-6b7b-45f6-8ea1-7433de538519\") " pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.156664 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.156646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5pj\" (UniqueName: \"kubernetes.io/projected/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-kube-api-access-jw5pj\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:50.161849 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.161826 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vbxx\" (UniqueName: \"kubernetes.io/projected/e78b0558-fd5c-4b81-9229-6bb4646e6157-kube-api-access-5vbxx\") pod \"tuned-hxxcj\" (UID: \"e78b0558-fd5c-4b81-9229-6bb4646e6157\") " pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.161998 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.161979 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgpfz\" (UniqueName: \"kubernetes.io/projected/f239f931-1d0b-46d0-9cec-4bb5eb586232-kube-api-access-pgpfz\") pod \"ovnkube-node-k9f4x\" (UID: \"f239f931-1d0b-46d0-9cec-4bb5eb586232\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.163752 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.163729 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lqbt\" (UniqueName: \"kubernetes.io/projected/e05dfa0d-ccac-44da-a18a-923316c63c29-kube-api-access-4lqbt\") pod \"aws-ebs-csi-driver-node-ljhkm\" (UID: \"e05dfa0d-ccac-44da-a18a-923316c63c29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.165670 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.165652 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwlcc\" (UniqueName: \"kubernetes.io/projected/f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72-kube-api-access-vwlcc\") pod \"multus-additional-cni-plugins-787dc\" (UID: \"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72\") " pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.234577 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.234540 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kj5f4" Jul 24 09:00:50.247554 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.247520 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzm7c" Jul 24 09:00:50.258592 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.258565 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2858" Jul 24 09:00:50.264539 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.264517 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-787dc" Jul 24 09:00:50.276244 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.276222 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" Jul 24 09:00:50.287243 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.287219 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:00:50.299052 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.299031 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" Jul 24 09:00:50.306908 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.306884 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:00:50.313744 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.313725 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zfhlc" Jul 24 09:00:50.551713 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.551677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:50.551892 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.551829 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:50.551948 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.551899 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:00:51.551883318 +0000 UTC m=+4.776896920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:50.653062 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.653019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:50.653267 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:50.653207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:50.653267 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.653210 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:00:50.653419 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.653271 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:50.653419 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.653308 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:00:50.653419 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.653326 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:50.653419 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.653355 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:51.653333558 +0000 UTC m=+4.878347160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:50.653419 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:50.653381 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:51.653368363 +0000 UTC m=+4.878381987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:51.000668 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:51.000572 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 08:55:50 +0000 UTC" deadline="2028-02-04 05:34:38.701005392 +0000 UTC" Jul 24 09:00:51.000668 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:51.000608 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13436h33m47.70040066s" Jul 24 09:00:51.105376 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:51.105325 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:51.105548 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.105456 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:00:51.150911 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:51.150875 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf239f931_1d0b_46d0_9cec_4bb5eb586232.slice/crio-276b1fe76ddb9f4c74df48636d14f04548fbcf5d2a9f744e4762184463bdea21 WatchSource:0}: Error finding container 276b1fe76ddb9f4c74df48636d14f04548fbcf5d2a9f744e4762184463bdea21: Status 404 returned error can't find the container with id 276b1fe76ddb9f4c74df48636d14f04548fbcf5d2a9f744e4762184463bdea21 Jul 24 09:00:51.153041 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:51.152653 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e58a784_5951_40d4_92b0_cf6fe5bad774.slice/crio-ad66b1808036d32e7da8e047209bdaecc1fe1405f1e7360dbec02c0f5158cba8 WatchSource:0}: Error finding container ad66b1808036d32e7da8e047209bdaecc1fe1405f1e7360dbec02c0f5158cba8: Status 404 returned error can't find the container with id ad66b1808036d32e7da8e047209bdaecc1fe1405f1e7360dbec02c0f5158cba8 Jul 24 09:00:51.158019 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:51.157865 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0b9cf8_6b7b_45f6_8ea1_7433de538519.slice/crio-fd41bda3c51472f2cd45f9a9901467fa8aee1dc3906692430d9292adb76c90d4 WatchSource:0}: Error finding container fd41bda3c51472f2cd45f9a9901467fa8aee1dc3906692430d9292adb76c90d4: Status 404 returned error can't find the container with id fd41bda3c51472f2cd45f9a9901467fa8aee1dc3906692430d9292adb76c90d4 Jul 24 09:00:51.159293 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:51.159267 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06a0dde_8ef7_4bb1_9c33_8775bdfd2b9b.slice/crio-3ce2dc301a46175061fcf2f7944bff772047f2de3c1ebffe784141813d4a2bb3 WatchSource:0}: Error finding container 3ce2dc301a46175061fcf2f7944bff772047f2de3c1ebffe784141813d4a2bb3: Status 404 returned error can't find the container with id 3ce2dc301a46175061fcf2f7944bff772047f2de3c1ebffe784141813d4a2bb3 Jul 24 09:00:51.161039 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:00:51.161007 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05dfa0d_ccac_44da_a18a_923316c63c29.slice/crio-8f7db948bcff647522c05f4da332170052aeca44a0c75612f0d168aaa0f01dcd WatchSource:0}: Error finding container 8f7db948bcff647522c05f4da332170052aeca44a0c75612f0d168aaa0f01dcd: Status 404 returned error can't find the container with id 8f7db948bcff647522c05f4da332170052aeca44a0c75612f0d168aaa0f01dcd Jul 24 09:00:51.562017 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:51.561825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:51.562157 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.561988 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:51.562157 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.562123 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:00:53.562106414 +0000 UTC m=+6.787120017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:51.663566 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:51.663431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:51.663566 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:51.663502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:51.663776 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.663630 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:51.663776 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.663696 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:53.663675521 +0000 UTC m=+6.888689122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:51.664082 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.664012 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:00:51.664082 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.664038 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:00:51.664082 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.664051 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:51.664274 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:51.664107 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:53.664091042 +0000 UTC m=+6.889104662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:52.001791 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.001657 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 08:55:50 +0000 UTC" deadline="2028-02-17 09:41:00.831955884 +0000 UTC" Jul 24 09:00:52.001791 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.001708 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13752h40m8.830253566s" Jul 24 09:00:52.105539 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.104954 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:52.105539 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:52.105107 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:00:52.106053 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.105893 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:52.106053 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:52.106015 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:00:52.117963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.117933 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfrml" event={"ID":"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b","Type":"ContainerStarted","Data":"3ce2dc301a46175061fcf2f7944bff772047f2de3c1ebffe784141813d4a2bb3"} Jul 24 09:00:52.119610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.119580 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"276b1fe76ddb9f4c74df48636d14f04548fbcf5d2a9f744e4762184463bdea21"} Jul 24 09:00:52.121643 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.121616 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerStarted","Data":"065f3458d38ca3fe1faf644a4dad26929cb0f2dca0725ff7dfcaa496450d103f"} Jul 24 09:00:52.122956 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.122908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" event={"ID":"e78b0558-fd5c-4b81-9229-6bb4646e6157","Type":"ContainerStarted","Data":"1ab1d9b8ec2eaa1c0195c7fe992a431ecd18aedcad4d303f79655eeb5e2e2d5c"} Jul 24 09:00:52.124971 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.124922 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kj5f4" event={"ID":"5c13b14a-81ba-4718-9ca3-35d736c972a7","Type":"ContainerStarted","Data":"84d56b286a2d3774e1a67cb1341a0998ee696b9bb8a0e2d1a0efdd8ebddda20d"} Jul 24 09:00:52.131352 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.131301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" event={"ID":"e05dfa0d-ccac-44da-a18a-923316c63c29","Type":"ContainerStarted","Data":"8f7db948bcff647522c05f4da332170052aeca44a0c75612f0d168aaa0f01dcd"} Jul 24 09:00:52.133195 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.133170 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zfhlc" event={"ID":"ea0b9cf8-6b7b-45f6-8ea1-7433de538519","Type":"ContainerStarted","Data":"fd41bda3c51472f2cd45f9a9901467fa8aee1dc3906692430d9292adb76c90d4"} Jul 24 09:00:52.134317 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.134294 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2858" event={"ID":"0e58a784-5951-40d4-92b0-cf6fe5bad774","Type":"ContainerStarted","Data":"ad66b1808036d32e7da8e047209bdaecc1fe1405f1e7360dbec02c0f5158cba8"} Jul 24 09:00:52.137872 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.137847 2554 generic.go:356] "Generic (PLEG): container finished" podID="5914545796d27e5f7bd262f1db2d1af6" containerID="ef0dcd13392bbb90ba03fd959a146a93c672178d93869c2546148e403d544dfc" exitCode=0 Jul 24 09:00:52.137973 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.137926 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" event={"ID":"5914545796d27e5f7bd262f1db2d1af6","Type":"ContainerDied","Data":"ef0dcd13392bbb90ba03fd959a146a93c672178d93869c2546148e403d544dfc"} Jul 24 09:00:52.144301 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.144275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" event={"ID":"ed436c2c06eb421aaa817d4e8a2cf780","Type":"ContainerStarted","Data":"a4ed31fc7f8dd68e045237f42169671eea876546f927d0eb09ce8b7548f6adc6"} Jul 24 09:00:52.146394 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.146366 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzm7c" event={"ID":"56c58aa5-e6a2-4804-8f5a-aed5751fde00","Type":"ContainerStarted","Data":"0549c24e9310fa9d8e5466bbe6de7a1200cb625647a1e30a78e8faf0c0bfad6d"} Jul 24 09:00:52.169973 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:52.169911 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" podStartSLOduration=3.169888796 podStartE2EDuration="3.169888796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:00:52.168964799 +0000 UTC m=+5.393978428" watchObservedRunningTime="2026-07-24 09:00:52.169888796 +0000 UTC m=+5.394902423" Jul 24 09:00:53.105234 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:53.104717 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:53.105234 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.104855 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:00:53.169002 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:53.168962 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" event={"ID":"5914545796d27e5f7bd262f1db2d1af6","Type":"ContainerStarted","Data":"ae4953c8de65fbea40b3c4fd04763e8daef1e24e8ef81547b3d2cf3b2743f4b2"} Jul 24 09:00:53.184665 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:53.184606 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" podStartSLOduration=4.184583454 podStartE2EDuration="4.184583454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:00:53.183688705 +0000 UTC m=+6.408702345" watchObservedRunningTime="2026-07-24 09:00:53.184583454 +0000 UTC m=+6.409597080" Jul 24 09:00:53.580920 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:53.580880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:53.581125 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.581096 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:53.581217 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.581171 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:00:57.581149688 +0000 UTC m=+10.806163295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:53.682254 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:53.682198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:53.682458 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:53.682268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:53.682458 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.682448 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:53.682580 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.682517 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:57.682496222 +0000 UTC m=+10.907509844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:53.682996 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.682975 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:00:53.683095 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.683006 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:00:53.683095 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.683020 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:53.683095 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:53.683069 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:00:57.683052191 +0000 UTC m=+10.908065811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:54.105464 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:54.105430 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:54.105978 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:54.105576 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:00:54.106055 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:54.106013 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:54.106158 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:54.106132 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:00:55.104618 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:55.104577 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:55.104801 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:55.104710 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:00:56.104935 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:56.104902 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:56.105456 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:56.104950 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:56.105456 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:56.105057 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:00:56.105456 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:56.105173 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:00:57.104580 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:57.104544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:57.104744 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.104670 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:00:57.616746 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:57.616649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:57.617193 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.616820 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:57.617193 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.616890 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:01:05.616866836 +0000 UTC m=+18.841880451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:57.717883 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:57.717955 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.718110 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.718178 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:05.718159048 +0000 UTC m=+18.943172651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.718205 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.718226 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.718239 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:57.718532 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:57.718299 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:05.718270723 +0000 UTC m=+18.943284337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:00:58.106870 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:58.106234 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:00:58.106870 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:58.106381 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:00:58.106870 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:58.106729 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:00:58.106870 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:58.106830 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:00:59.104568 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:00:59.104530 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:00:59.105018 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:00:59.104686 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:00.105965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:00.105452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:00.105965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:00.105473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:00.105965 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:00.105591 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:00.105965 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:00.105728 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:01.104426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:01.104395 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:01.104589 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:01.104517 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:02.105023 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:02.104983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:02.105023 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:02.105011 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:02.105641 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:02.105128 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:02.105641 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:02.105258 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:03.104778 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:03.104743 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:03.104969 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:03.104865 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:04.104855 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:04.104814 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:04.105267 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:04.104947 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:04.105267 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:04.104990 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:04.105267 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:04.105085 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:05.104723 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:05.104685 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:05.105008 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.104806 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:05.681477 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:05.681446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:05.681641 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.681582 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:01:05.681641 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.681639 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:01:21.68162492 +0000 UTC m=+34.906638523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:01:05.782056 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:05.782026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:05.782213 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:05.782071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:05.782213 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.782159 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:01:05.782213 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.782188 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:01:05.782213 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.782209 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:21.78219468 +0000 UTC m=+35.007208280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:01:05.782213 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.782210 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:01:05.782430 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.782222 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:01:05.782430 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:05.782260 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:21.782249342 +0000 UTC m=+35.007262942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:01:06.105497 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:06.105461 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:06.105878 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:06.105581 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:06.105878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:06.105631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:06.105878 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:06.105753 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:07.104570 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:07.104527 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:07.104765 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:07.104643 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:08.105403 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:08.105370 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:08.105841 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:08.105477 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:08.105841 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:08.105595 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:08.105841 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:08.105723 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:09.105025 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:09.104987 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:09.105208 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:09.105123 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:10.105634 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.105373 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:10.106227 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.105387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:10.106227 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:10.105712 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:10.106227 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:10.105806 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:10.205340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.205311 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"29b8e495de36364205d95448c64e5d3ddb86ea331b4dbc59bd48ad84b0c343ad"} Jul 24 09:01:10.205487 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.205384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"71ef7ffc0382c3e325ab77c17419a30ab306a8d9c9b50be2f728d3b4df54df76"} Jul 24 09:01:10.205487 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.205416 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"bcc973ebc9fc399a5da5bbc576b502f87750c5736f6c8e34571fdd2cce2ed8c4"} Jul 24 09:01:10.206557 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.206532 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72" containerID="5ab271fd48ca82f1574aa3ff4b4bea3f40cdac41858cb367c7892fde2ad377ed" exitCode=0 Jul 24 09:01:10.206671 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.206608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerDied","Data":"5ab271fd48ca82f1574aa3ff4b4bea3f40cdac41858cb367c7892fde2ad377ed"} Jul 24 09:01:10.207942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.207921 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" event={"ID":"e78b0558-fd5c-4b81-9229-6bb4646e6157","Type":"ContainerStarted","Data":"91a019d5bed71a114f3069d4727fb9ab1f217ff1e709d2f27c5481afb19845a7"} Jul 24 09:01:10.209306 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.209258 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kj5f4" event={"ID":"5c13b14a-81ba-4718-9ca3-35d736c972a7","Type":"ContainerStarted","Data":"2ca41fa476bdfd1702b8830ae2922933ac905e4ae3f4fb02f069cd53fc3be9bb"} Jul 24 09:01:10.210983 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.210928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" event={"ID":"e05dfa0d-ccac-44da-a18a-923316c63c29","Type":"ContainerStarted","Data":"517c889a1441428c66d76d2dac011ccc790189ca79f78dce08e1d4839a8b533a"} Jul 24 09:01:10.212396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.212377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2858" event={"ID":"0e58a784-5951-40d4-92b0-cf6fe5bad774","Type":"ContainerStarted","Data":"b89e642746777f798d54076600f7b46d5ba04ca31ea69630901fece9b2d94d52"} Jul 24 09:01:10.213830 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.213813 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzm7c" event={"ID":"56c58aa5-e6a2-4804-8f5a-aed5751fde00","Type":"ContainerStarted","Data":"0eb0ed3e9f450c55f1869d7a93b8d9159882392bafeb29a81ca6e4ed5c76f6c7"} Jul 24 09:01:10.215193 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.215172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfrml" event={"ID":"c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b","Type":"ContainerStarted","Data":"7d6b3cceabf6eebfcff3d84bd8247507a137ff5e4eea63061fab3ea54bfcb3ff"} Jul 24 09:01:10.248213 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.248161 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b2858" podStartSLOduration=3.697372148 podStartE2EDuration="22.248146983s" totalImagesPullingTime="18.550774835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:10.247757463 +0000 UTC m=+23.472771085" watchObservedRunningTime="2026-07-24 09:01:10.248146983 +0000 UTC m=+23.473160604" Jul 24 09:01:10.279678 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.279623 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wzm7c" podStartSLOduration=3.7424903609999998 podStartE2EDuration="22.279608438s" totalImagesPullingTime="18.537118077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:10.262302853 +0000 UTC m=+23.487316472" watchObservedRunningTime="2026-07-24 09:01:10.279608438 +0000 UTC m=+23.504622129" Jul 24 09:01:10.279911 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.279891 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hxxcj" podStartSLOduration=3.7139764570000002 podStartE2EDuration="22.279883979s" totalImagesPullingTime="18.565907522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:10.279478212 +0000 UTC m=+23.504491835" watchObservedRunningTime="2026-07-24 09:01:10.279883979 +0000 UTC m=+23.504897633" Jul 24 09:01:10.300035 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.299994 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kj5f4" podStartSLOduration=3.677084691 podStartE2EDuration="22.299979804s" totalImagesPullingTime="18.622895113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:10.299163646 +0000 UTC m=+23.524177270" watchObservedRunningTime="2026-07-24 09:01:10.299979804 +0000 UTC m=+23.524993427" Jul 24 09:01:10.314828 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:10.314788 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kfrml" podStartSLOduration=3.766149503 podStartE2EDuration="22.31477459s" totalImagesPullingTime="18.548625087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:10.314466597 +0000 UTC m=+23.539480218" watchObservedRunningTime="2026-07-24 09:01:10.31477459 +0000 UTC m=+23.539788211" Jul 24 09:01:11.104737 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.104707 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:11.104870 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:11.104842 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:11.219609 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.219579 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zfhlc" event={"ID":"ea0b9cf8-6b7b-45f6-8ea1-7433de538519","Type":"ContainerStarted","Data":"16c8d8b28aba5aa6a394406b877cf59c93c841dbf79b3062403ce9bda64b13f4"} Jul 24 09:01:11.223120 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.223070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"b3a5af2a29f495a78529d6126da9ee1da411746a4b37b0b9117da1644d91a6ac"} Jul 24 09:01:11.223257 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.223143 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"49222c819f380e6362e75aa89ca0fcf9a5282c0cabedd6b9e04fab4a81e5b11c"} Jul 24 09:01:11.223257 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.223180 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"540c421fec0d4541c669c80a629f842efcb96089e3e80baabcb25b71d9a20dc2"} Jul 24 09:01:11.234916 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.234873 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zfhlc" podStartSLOduration=4.664157453 podStartE2EDuration="23.234860882s" totalImagesPullingTime="18.570703429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:11.23450563 +0000 UTC m=+24.459519253" watchObservedRunningTime="2026-07-24 09:01:11.234860882 +0000 UTC m=+24.459874504" Jul 24 09:01:11.251236 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:11.251210 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 09:01:12.007366 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:12.007242 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T09:01:11.251230135Z","UUID":"9d0490ef-78a3-45c2-a455-15ba0b8d215d","Handler":null,"Name":"","Endpoint":""} Jul 24 09:01:12.009450 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:12.009426 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 09:01:12.009582 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:12.009474 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 09:01:12.104717 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:12.104685 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:12.104885 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:12.104832 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:12.104948 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:12.104886 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:12.105014 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:12.104996 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:12.226827 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:12.226791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" event={"ID":"e05dfa0d-ccac-44da-a18a-923316c63c29","Type":"ContainerStarted","Data":"626888c10c17d5770c53057ef7bc85f471df8ff60816ed2102bd4237c3e7d383"} Jul 24 09:01:13.104667 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:13.104638 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:13.104835 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:13.104743 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:13.233740 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:13.233633 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"d543a90384a2dea3455ec943d1b0e3e16b98c0b3848a0e9d549243f2e17ae685"} Jul 24 09:01:13.403356 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:13.403234 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:01:13.403999 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:13.403981 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:01:14.105419 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:14.105204 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:14.105610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:14.105205 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:14.105610 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:14.105536 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:14.105727 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:14.105664 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:14.236457 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:14.236424 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:01:14.237235 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:14.237215 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfrml" Jul 24 09:01:15.105060 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.104887 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:15.105197 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:15.105135 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:15.242648 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.242533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" event={"ID":"f239f931-1d0b-46d0-9cec-4bb5eb586232","Type":"ContainerStarted","Data":"f9a6baf716a2ecf61f6fcbcfc68a6495ff337465cd60c57dd6b40b750f6b2d1e"} Jul 24 09:01:15.243359 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.242801 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:01:15.243359 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.242875 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:01:15.245376 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.245214 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72" containerID="3d783f03231ce46f0d4440fc86ddcdf90419fb95eda59d2139d890acce37e469" exitCode=0 Jul 24 09:01:15.245376 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.245254 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerDied","Data":"3d783f03231ce46f0d4440fc86ddcdf90419fb95eda59d2139d890acce37e469"} Jul 24 09:01:15.262266 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.262244 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:01:15.273064 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:15.273023 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" podStartSLOduration=8.658822584 podStartE2EDuration="27.273007858s" totalImagesPullingTime="18.614185274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:15.271900524 +0000 UTC m=+28.496914146" watchObservedRunningTime="2026-07-24 09:01:15.273007858 +0000 UTC m=+28.498021479" Jul 24 09:01:16.105179 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:16.105151 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:16.105383 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:16.105185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:16.105383 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:16.105254 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:16.105383 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:16.105361 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:16.250110 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:16.250062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" event={"ID":"e05dfa0d-ccac-44da-a18a-923316c63c29","Type":"ContainerStarted","Data":"890215b5a681a9920902ad733ad50d58dff10ff09d2e93dfb716cfe2b7ea2514"} Jul 24 09:01:16.250926 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:16.250906 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:01:16.268008 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:16.267961 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:01:16.298405 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:16.298361 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljhkm" podStartSLOduration=4.298607012 podStartE2EDuration="28.298346129s" totalImagesPullingTime="23.999739117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:16.269352089 +0000 UTC m=+29.494365715" watchObservedRunningTime="2026-07-24 09:01:16.298346129 +0000 UTC m=+29.523359795" Jul 24 09:01:17.104838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:17.104807 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:17.104995 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:17.104909 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:17.254727 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:17.254695 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72" containerID="b76c954a6ef153004963743a5e18abc18506c5ae764f36b4d0946aa02c6a2b23" exitCode=0 Jul 24 09:01:17.255185 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:17.254779 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerDied","Data":"b76c954a6ef153004963743a5e18abc18506c5ae764f36b4d0946aa02c6a2b23"} Jul 24 09:01:18.105251 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:18.105218 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:18.105461 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:18.105310 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:18.105461 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:18.105324 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:18.105461 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:18.105450 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:19.104396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:19.104361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:19.104782 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:19.104460 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:19.260864 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:19.260831 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72" containerID="a6b008b55800238600f3ec85e26557de1b8482d1155e27908f757b876400d00b" exitCode=0 Jul 24 09:01:19.260996 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:19.260878 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerDied","Data":"a6b008b55800238600f3ec85e26557de1b8482d1155e27908f757b876400d00b"} Jul 24 09:01:20.105150 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:20.105119 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:20.105574 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:20.105223 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:20.105574 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:20.105273 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:20.105574 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:20.105377 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:21.104466 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:21.104430 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:21.104656 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.104564 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:21.697545 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:21.697509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:21.698009 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.697627 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 09:01:21.698009 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.697693 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret podName:15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a nodeName:}" failed. No retries permitted until 2026-07-24 09:01:53.697675436 +0000 UTC m=+66.922689039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret") pod "global-pull-secret-syncer-gct5x" (UID: "15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a") : object "kube-system"/"original-pull-secret" not registered Jul 24 09:01:21.798361 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:21.798313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:21.798534 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:21.798408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:21.798534 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.798485 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:01:21.798627 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.798563 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs podName:a2e0a09d-1e5e-4fac-90e7-73ea46d77967 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:53.798541693 +0000 UTC m=+67.023555297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs") pod "network-metrics-daemon-ctznw" (UID: "a2e0a09d-1e5e-4fac-90e7-73ea46d77967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 09:01:21.798627 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.798570 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 09:01:21.798627 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.798617 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 09:01:21.798727 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.798633 2554 projected.go:196] Error preparing data for projected volume kube-api-access-2xzg6 for pod openshift-network-diagnostics/network-check-target-x6xwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:01:21.798727 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:21.798676 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6 podName:50c412dc-0d5c-441b-bd97-3ba337ac75a5 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:53.798665261 +0000 UTC m=+67.023678861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xzg6" (UniqueName: "kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6") pod "network-check-target-x6xwp" (UID: "50c412dc-0d5c-441b-bd97-3ba337ac75a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 09:01:22.105157 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:22.105130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:22.105344 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:22.105130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:22.105344 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:22.105238 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:22.105344 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:22.105314 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:23.105101 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:23.105071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:23.105505 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:23.105183 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:24.108110 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:24.108078 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:24.108584 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:24.108116 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:24.108584 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:24.108210 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:24.108584 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:24.108318 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:25.104600 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:25.104564 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:25.104783 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:25.104666 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:25.277016 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:25.276983 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72" containerID="2a8f101ea204a6659e0db2ffe5c9622ee806d357f83acff03b5c1995666672a4" exitCode=0 Jul 24 09:01:25.277374 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:25.277058 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerDied","Data":"2a8f101ea204a6659e0db2ffe5c9622ee806d357f83acff03b5c1995666672a4"} Jul 24 09:01:26.104968 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:26.104931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:26.105130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:26.104939 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:26.105130 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:26.105048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:26.105201 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:26.105150 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:26.281755 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:26.281718 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72" containerID="8b771c929bdc5af521f2a8050b873db9f2fe6df52db31d0d62238b0821ae47f0" exitCode=0 Jul 24 09:01:26.282104 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:26.281785 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerDied","Data":"8b771c929bdc5af521f2a8050b873db9f2fe6df52db31d0d62238b0821ae47f0"} Jul 24 09:01:27.105033 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:27.104997 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:27.105184 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:27.105093 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:27.287427 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:27.287389 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787dc" event={"ID":"f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72","Type":"ContainerStarted","Data":"855d9529f7a8637d4599c225c6f51f79e1a6811297a22d466b8608a217aa8c42"} Jul 24 09:01:27.313787 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:27.313739 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-787dc" podStartSLOduration=8.433546949 podStartE2EDuration="39.313724082s" totalImagesPullingTime="30.880177133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:27.313133152 +0000 UTC m=+40.538146773" watchObservedRunningTime="2026-07-24 09:01:27.313724082 +0000 UTC m=+40.538737704" Jul 24 09:01:28.107643 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:28.107615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:28.107819 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:28.107712 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:28.107819 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:28.107763 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:28.107887 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:28.107846 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:29.104984 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:29.104952 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:29.105401 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:29.105045 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:30.107172 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:30.107143 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:30.107577 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:30.107238 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:30.107577 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:30.107306 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:30.107577 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:30.107381 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:31.105072 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:31.105035 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:31.105248 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:31.105141 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:32.108348 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:32.108319 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:32.108348 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:32.108341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:32.108765 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:32.108437 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:32.108765 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:32.108551 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:33.104767 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:33.104735 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:33.105020 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:33.104839 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:34.105514 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:34.105477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:34.106006 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:34.105474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:34.106006 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:34.105603 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:34.106006 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:34.105712 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:35.105373 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:35.105343 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:35.105535 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:35.105445 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:36.108521 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.108341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:36.109106 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.108355 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:36.109106 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:36.108710 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:36.109106 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:36.108769 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:36.110358 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.110330 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ctznw"] Jul 24 09:01:36.114176 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.114148 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x6xwp"] Jul 24 09:01:36.114342 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.114251 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:36.114403 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:36.114378 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:36.114894 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.114874 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gct5x"] Jul 24 09:01:36.306129 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.306101 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:36.306305 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:36.306101 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:36.306305 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:36.306230 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:36.306448 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:36.306344 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:38.106412 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:38.106368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:38.106412 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:38.106402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:38.107003 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:38.106505 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:38.107003 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:38.106519 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:38.107003 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:38.106587 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:38.107003 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:38.106644 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:40.105004 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.104969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:40.105595 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.104977 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:40.105595 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:40.105077 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gct5x" podUID="15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a" Jul 24 09:01:40.105595 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.105112 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:40.105595 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:40.105191 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctznw" podUID="a2e0a09d-1e5e-4fac-90e7-73ea46d77967" Jul 24 09:01:40.105595 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:40.105226 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6xwp" podUID="50c412dc-0d5c-441b-bd97-3ba337ac75a5" Jul 24 09:01:40.560043 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.560016 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeReady" Jul 24 09:01:40.560336 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.560159 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 09:01:40.604181 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.604148 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnvjq"] Jul 24 09:01:40.625772 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.625734 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w7vq5"] Jul 24 09:01:40.626262 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.626235 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.628702 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.628681 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7b8b\"" Jul 24 09:01:40.629411 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.629386 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 09:01:40.629512 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.629389 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 09:01:40.629512 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.629396 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 09:01:40.649547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.649523 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnvjq"] Jul 24 09:01:40.649547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.649551 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7vq5"] Jul 24 09:01:40.649694 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.649645 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.652511 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.652490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 09:01:40.652610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.652547 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tqwwj\"" Jul 24 09:01:40.652669 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.652614 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 09:01:40.652759 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.652740 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 09:01:40.653114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.653094 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 09:01:40.706089 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.706056 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gcpx5"] Jul 24 09:01:40.728741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.728711 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gcpx5"] Jul 24 09:01:40.728886 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.728825 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.731146 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.731123 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 09:01:40.731239 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.731126 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vd8z6\"" Jul 24 09:01:40.731239 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.731185 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 09:01:40.738805 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6639a429-4492-4af2-9e2f-efdb4bb9c283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.738895 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00614971-67b3-4425-b2c1-cd701009be3c-cert\") pod \"ingress-canary-dnvjq\" (UID: \"00614971-67b3-4425-b2c1-cd701009be3c\") " pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.738895 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pks\" (UniqueName: \"kubernetes.io/projected/00614971-67b3-4425-b2c1-cd701009be3c-kube-api-access-j5pks\") pod \"ingress-canary-dnvjq\" (UID: \"00614971-67b3-4425-b2c1-cd701009be3c\") " pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.738977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6639a429-4492-4af2-9e2f-efdb4bb9c283-crio-socket\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.738977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738937 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6639a429-4492-4af2-9e2f-efdb4bb9c283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.738977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sslhv\" (UniqueName: \"kubernetes.io/projected/6639a429-4492-4af2-9e2f-efdb4bb9c283-kube-api-access-sslhv\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.739096 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.738993 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6639a429-4492-4af2-9e2f-efdb4bb9c283-data-volume\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840301 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6639a429-4492-4af2-9e2f-efdb4bb9c283-data-volume\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840301 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09c5bc87-20c6-4fe1-8636-f7d2e4203660-config-volume\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.840301 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6639a429-4492-4af2-9e2f-efdb4bb9c283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840309 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09c5bc87-20c6-4fe1-8636-f7d2e4203660-metrics-tls\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00614971-67b3-4425-b2c1-cd701009be3c-cert\") pod \"ingress-canary-dnvjq\" (UID: \"00614971-67b3-4425-b2c1-cd701009be3c\") " pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840476 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x66lk\" (UniqueName: \"kubernetes.io/projected/09c5bc87-20c6-4fe1-8636-f7d2e4203660-kube-api-access-x66lk\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pks\" (UniqueName: \"kubernetes.io/projected/00614971-67b3-4425-b2c1-cd701009be3c-kube-api-access-j5pks\") pod \"ingress-canary-dnvjq\" (UID: \"00614971-67b3-4425-b2c1-cd701009be3c\") " pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c5bc87-20c6-4fe1-8636-f7d2e4203660-tmp-dir\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840535 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6639a429-4492-4af2-9e2f-efdb4bb9c283-data-volume\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6639a429-4492-4af2-9e2f-efdb4bb9c283-crio-socket\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840877 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6639a429-4492-4af2-9e2f-efdb4bb9c283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840877 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sslhv\" (UniqueName: \"kubernetes.io/projected/6639a429-4492-4af2-9e2f-efdb4bb9c283-kube-api-access-sslhv\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.840877 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.840690 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6639a429-4492-4af2-9e2f-efdb4bb9c283-crio-socket\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.841138 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.841113 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6639a429-4492-4af2-9e2f-efdb4bb9c283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.844268 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.844159 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6639a429-4492-4af2-9e2f-efdb4bb9c283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.848310 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.848274 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslhv\" (UniqueName: \"kubernetes.io/projected/6639a429-4492-4af2-9e2f-efdb4bb9c283-kube-api-access-sslhv\") pod \"insights-runtime-extractor-w7vq5\" (UID: \"6639a429-4492-4af2-9e2f-efdb4bb9c283\") " pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.857573 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.857551 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00614971-67b3-4425-b2c1-cd701009be3c-cert\") pod \"ingress-canary-dnvjq\" (UID: \"00614971-67b3-4425-b2c1-cd701009be3c\") " pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.857652 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.857631 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pks\" (UniqueName: \"kubernetes.io/projected/00614971-67b3-4425-b2c1-cd701009be3c-kube-api-access-j5pks\") pod \"ingress-canary-dnvjq\" (UID: \"00614971-67b3-4425-b2c1-cd701009be3c\") " pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.935402 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.935371 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnvjq" Jul 24 09:01:40.941024 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.940993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09c5bc87-20c6-4fe1-8636-f7d2e4203660-metrics-tls\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.941157 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.941042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x66lk\" (UniqueName: \"kubernetes.io/projected/09c5bc87-20c6-4fe1-8636-f7d2e4203660-kube-api-access-x66lk\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.941157 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.941082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c5bc87-20c6-4fe1-8636-f7d2e4203660-tmp-dir\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.941222 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.941160 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09c5bc87-20c6-4fe1-8636-f7d2e4203660-config-volume\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.941477 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.941457 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09c5bc87-20c6-4fe1-8636-f7d2e4203660-tmp-dir\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.941665 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.941646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09c5bc87-20c6-4fe1-8636-f7d2e4203660-config-volume\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.942915 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.942892 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lw45r"] Jul 24 09:01:40.943764 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.943745 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09c5bc87-20c6-4fe1-8636-f7d2e4203660-metrics-tls\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.949455 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.949439 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x66lk\" (UniqueName: \"kubernetes.io/projected/09c5bc87-20c6-4fe1-8636-f7d2e4203660-kube-api-access-x66lk\") pod \"dns-default-gcpx5\" (UID: \"09c5bc87-20c6-4fe1-8636-f7d2e4203660\") " pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:40.957590 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.957571 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7vq5" Jul 24 09:01:40.960107 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.960041 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lw45r"] Jul 24 09:01:40.960206 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.960114 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:40.962818 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.962795 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 09:01:40.962913 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.962818 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t2gfv\"" Jul 24 09:01:40.962913 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.962870 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 09:01:40.962913 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.962875 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 09:01:40.963033 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.962818 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 09:01:40.963033 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:40.962826 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 09:01:41.033526 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.033496 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d589d69b8-5kz4s"] Jul 24 09:01:41.037591 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.037562 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:41.041816 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.041792 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.041911 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.041829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.041911 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.041870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88bc74ca-9911-410d-b2f9-24d4c42d9d81-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.041988 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.041960 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzmmv\" (UniqueName: \"kubernetes.io/projected/88bc74ca-9911-410d-b2f9-24d4c42d9d81-kube-api-access-hzmmv\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.047574 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.047160 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.048033 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.047999 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d589d69b8-5kz4s"] Jul 24 09:01:41.049968 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.049946 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 09:01:41.050113 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050090 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8htrh\"" Jul 24 09:01:41.050224 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050174 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 09:01:41.050348 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050329 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 09:01:41.050614 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050590 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 09:01:41.050714 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 09:01:41.050785 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050725 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 09:01:41.051099 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.050938 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 09:01:41.062939 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.062528 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 09:01:41.142420 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-serving-cert\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-oauth-config\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88bc74ca-9911-410d-b2f9-24d4c42d9d81-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzmmv\" (UniqueName: \"kubernetes.io/projected/88bc74ca-9911-410d-b2f9-24d4c42d9d81-kube-api-access-hzmmv\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-service-ca\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142597 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-config\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-oauth-serving-cert\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.142838 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:41.142747 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 24 09:01:41.143315 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:41.142846 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-tls podName:88bc74ca-9911-410d-b2f9-24d4c42d9d81 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:41.642822893 +0000 UTC m=+54.867836495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-lw45r" (UID: "88bc74ca-9911-410d-b2f9-24d4c42d9d81") : secret "prometheus-operator-tls" not found Jul 24 09:01:41.143315 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.142972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.143315 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.143026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-trusted-ca-bundle\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.143315 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.143055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xhns\" (UniqueName: \"kubernetes.io/projected/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-kube-api-access-9xhns\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.143486 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.143368 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88bc74ca-9911-410d-b2f9-24d4c42d9d81-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.146447 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.146423 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.154828 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.154805 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzmmv\" (UniqueName: \"kubernetes.io/projected/88bc74ca-9911-410d-b2f9-24d4c42d9d81-kube-api-access-hzmmv\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.157053 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.157031 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnvjq"] Jul 24 09:01:41.161485 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:41.161459 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00614971_67b3_4425_b2c1_cd701009be3c.slice/crio-2ec80e0a81727c45bb4098928f4b3223a73b85e102d131bce83e40834abf791c WatchSource:0}: Error finding container 2ec80e0a81727c45bb4098928f4b3223a73b85e102d131bce83e40834abf791c: Status 404 returned error can't find the container with id 2ec80e0a81727c45bb4098928f4b3223a73b85e102d131bce83e40834abf791c Jul 24 09:01:41.164135 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.163991 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7vq5"] Jul 24 09:01:41.166758 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:41.166729 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6639a429_4492_4af2_9e2f_efdb4bb9c283.slice/crio-de552156cb4b9e5276666bc17624a5ce7455bc8c937113311b64b6c078ac1dc5 WatchSource:0}: Error finding container de552156cb4b9e5276666bc17624a5ce7455bc8c937113311b64b6c078ac1dc5: Status 404 returned error can't find the container with id de552156cb4b9e5276666bc17624a5ce7455bc8c937113311b64b6c078ac1dc5 Jul 24 09:01:41.226406 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.226375 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gcpx5"] Jul 24 09:01:41.230166 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:41.230139 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c5bc87_20c6_4fe1_8636_f7d2e4203660.slice/crio-8665793959fe6a8ad69a5d58a43eb9b3797f34cd076124184efd964abc50513e WatchSource:0}: Error finding container 8665793959fe6a8ad69a5d58a43eb9b3797f34cd076124184efd964abc50513e: Status 404 returned error can't find the container with id 8665793959fe6a8ad69a5d58a43eb9b3797f34cd076124184efd964abc50513e Jul 24 09:01:41.244151 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-config\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244250 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-oauth-serving-cert\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244250 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-trusted-ca-bundle\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244250 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xhns\" (UniqueName: \"kubernetes.io/projected/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-kube-api-access-9xhns\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244423 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-serving-cert\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244423 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244308 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-oauth-config\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244423 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-service-ca\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.244998 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.244945 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-oauth-serving-cert\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.245092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.245002 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-config\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.245172 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.245111 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-service-ca\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.245216 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.245182 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-trusted-ca-bundle\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.246923 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.246895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-oauth-config\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.247011 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.246980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-serving-cert\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.252367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.252347 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xhns\" (UniqueName: \"kubernetes.io/projected/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-kube-api-access-9xhns\") pod \"console-7d589d69b8-5kz4s\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.319227 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.319189 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnvjq" event={"ID":"00614971-67b3-4425-b2c1-cd701009be3c","Type":"ContainerStarted","Data":"2ec80e0a81727c45bb4098928f4b3223a73b85e102d131bce83e40834abf791c"} Jul 24 09:01:41.320343 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.320310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcpx5" event={"ID":"09c5bc87-20c6-4fe1-8636-f7d2e4203660","Type":"ContainerStarted","Data":"8665793959fe6a8ad69a5d58a43eb9b3797f34cd076124184efd964abc50513e"} Jul 24 09:01:41.321400 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.321377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7vq5" event={"ID":"6639a429-4492-4af2-9e2f-efdb4bb9c283","Type":"ContainerStarted","Data":"de552156cb4b9e5276666bc17624a5ce7455bc8c937113311b64b6c078ac1dc5"} Jul 24 09:01:41.372182 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.372100 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:41.500302 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.500252 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d589d69b8-5kz4s"] Jul 24 09:01:41.504010 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:41.503987 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88934311_c11e_4f7c_8807_6fd6fbf4ee9e.slice/crio-b8ee140f6e0e6f3a317eb092562b0635d3f966e61524c556a7f28ee1d64dd527 WatchSource:0}: Error finding container b8ee140f6e0e6f3a317eb092562b0635d3f966e61524c556a7f28ee1d64dd527: Status 404 returned error can't find the container with id b8ee140f6e0e6f3a317eb092562b0635d3f966e61524c556a7f28ee1d64dd527 Jul 24 09:01:41.648330 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.648231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.651484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.651455 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88bc74ca-9911-410d-b2f9-24d4c42d9d81-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lw45r\" (UID: \"88bc74ca-9911-410d-b2f9-24d4c42d9d81\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:41.871097 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:41.870645 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" Jul 24 09:01:42.060259 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.060227 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lw45r"] Jul 24 09:01:42.107548 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.106450 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:42.107548 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.107068 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:42.108559 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.107916 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:42.112340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.111936 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 09:01:42.112340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.111993 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 09:01:42.112340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.111939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4csjh\"" Jul 24 09:01:42.113970 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.113456 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j27b2\"" Jul 24 09:01:42.113970 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.113681 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 09:01:42.113970 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.113893 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 09:01:42.330160 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.330089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" event={"ID":"88bc74ca-9911-410d-b2f9-24d4c42d9d81","Type":"ContainerStarted","Data":"31236e0a45d3766665791b7ceffb79dac7febec228cbe253d69978468a0b4cc8"} Jul 24 09:01:42.334045 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:42.333989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d589d69b8-5kz4s" event={"ID":"88934311-c11e-4f7c-8807-6fd6fbf4ee9e","Type":"ContainerStarted","Data":"b8ee140f6e0e6f3a317eb092562b0635d3f966e61524c556a7f28ee1d64dd527"} Jul 24 09:01:48.276191 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:48.276164 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9f4x" Jul 24 09:01:50.362426 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.362384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" event={"ID":"88bc74ca-9911-410d-b2f9-24d4c42d9d81","Type":"ContainerStarted","Data":"d1dd736d309b2c637f142d58f3572a3fce71f4a2d5adbb574d591a59b896dace"} Jul 24 09:01:50.362872 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.362457 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" event={"ID":"88bc74ca-9911-410d-b2f9-24d4c42d9d81","Type":"ContainerStarted","Data":"dd3089b9c113805f37fb60aa274718680b5041fdbb0937d6e18c56997e9489d4"} Jul 24 09:01:50.365121 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.364974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d589d69b8-5kz4s" event={"ID":"88934311-c11e-4f7c-8807-6fd6fbf4ee9e","Type":"ContainerStarted","Data":"0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d"} Jul 24 09:01:50.367478 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.367449 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcpx5" event={"ID":"09c5bc87-20c6-4fe1-8636-f7d2e4203660","Type":"ContainerStarted","Data":"c02803f0e86875d43711513bc943b6741abf754988e7eaf08a315cd11ca7b07e"} Jul 24 09:01:50.367606 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.367503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcpx5" event={"ID":"09c5bc87-20c6-4fe1-8636-f7d2e4203660","Type":"ContainerStarted","Data":"2b2d7345bdd14d6b545bad806e554b5a5cd4f507eb685185a9cd6fbc7ee35542"} Jul 24 09:01:50.367606 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.367534 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gcpx5" Jul 24 09:01:50.369054 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.369030 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7vq5" event={"ID":"6639a429-4492-4af2-9e2f-efdb4bb9c283","Type":"ContainerStarted","Data":"5332ebc07307bea7575d577fc104a972fb265ba3d957f8898866f8e424fc33c0"} Jul 24 09:01:50.370892 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.370852 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnvjq" event={"ID":"00614971-67b3-4425-b2c1-cd701009be3c","Type":"ContainerStarted","Data":"1bf96add479411b117d89cafee4ae533b570fc18a388879f20aacd0ed066967b"} Jul 24 09:01:50.383121 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.383007 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-lw45r" podStartSLOduration=3.142033885 podStartE2EDuration="10.382989287s" totalImagesPullingTime="7.240955402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:50.382066359 +0000 UTC m=+63.607079982" watchObservedRunningTime="2026-07-24 09:01:50.382989287 +0000 UTC m=+63.608002912" Jul 24 09:01:50.400319 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.400251 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnvjq" podStartSLOduration=2.250817032 podStartE2EDuration="10.400235386s" totalImagesPullingTime="8.149418354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:50.400041508 +0000 UTC m=+63.625055142" watchObservedRunningTime="2026-07-24 09:01:50.400235386 +0000 UTC m=+63.625249005" Jul 24 09:01:50.420124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.420069 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d589d69b8-5kz4s" podStartSLOduration=1.588982638 podStartE2EDuration="9.420054737s" totalImagesPullingTime="7.831072099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:50.418430639 +0000 UTC m=+63.643444262" watchObservedRunningTime="2026-07-24 09:01:50.420054737 +0000 UTC m=+63.645068361" Jul 24 09:01:50.441557 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:50.441499 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gcpx5" podStartSLOduration=2.360822065 podStartE2EDuration="10.441476734s" totalImagesPullingTime="8.080654669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:01:50.440949416 +0000 UTC m=+63.665963062" watchObservedRunningTime="2026-07-24 09:01:50.441476734 +0000 UTC m=+63.666490357" Jul 24 09:01:51.372521 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:51.372491 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:51.372964 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:51.372553 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:51.380701 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:51.380673 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:52.387042 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.387009 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:01:52.463641 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.463609 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf"] Jul 24 09:01:52.475753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.475725 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.478465 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.478433 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-79bgs\"" Jul 24 09:01:52.478465 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.478459 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 09:01:52.478638 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.478478 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 09:01:52.484726 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.484700 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf"] Jul 24 09:01:52.489348 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.489326 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8"] Jul 24 09:01:52.491362 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.491343 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.493842 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.493822 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7nxwk\"" Jul 24 09:01:52.494154 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.494130 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 09:01:52.494154 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.494148 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 09:01:52.494549 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.494532 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 09:01:52.510193 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.510167 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8"] Jul 24 09:01:52.518353 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.518329 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vvw6f"] Jul 24 09:01:52.521414 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.521388 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.523907 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.523887 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 09:01:52.524074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.524058 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 09:01:52.524140 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.524099 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 09:01:52.524185 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.524154 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5gk78\"" Jul 24 09:01:52.544719 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s4fv\" (UniqueName: \"kubernetes.io/projected/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-api-access-8s4fv\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.544839 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544759 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.544839 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.544839 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544821 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.545009 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2wc4\" (UniqueName: \"kubernetes.io/projected/d942d7f9-dd5b-4ec9-8044-d18261849ec5-kube-api-access-z2wc4\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.545009 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.545009 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.544995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.545135 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.545038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.545135 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.545111 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.545198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.545136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d942d7f9-dd5b-4ec9-8044-d18261849ec5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.646237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.646237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d942d7f9-dd5b-4ec9-8044-d18261849ec5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.646237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s4fv\" (UniqueName: \"kubernetes.io/projected/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-api-access-8s4fv\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646339 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-textfile\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c58b28f-4a28-4923-9b5c-1089d4abdf14-metrics-client-ca\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:52.646424 2554 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 09:01:52.646547 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:52.646504 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-tls podName:d942d7f9-dd5b-4ec9-8044-d18261849ec5 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:53.1464801 +0000 UTC m=+66.371493704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-7qskf" (UID: "d942d7f9-dd5b-4ec9-8044-d18261849ec5") : secret "openshift-state-metrics-tls" not found Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wc4\" (UniqueName: \"kubernetes.io/projected/d942d7f9-dd5b-4ec9-8044-d18261849ec5-kube-api-access-z2wc4\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646744 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646793 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-wtmp\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqbt\" (UniqueName: \"kubernetes.io/projected/0c58b28f-4a28-4923-9b5c-1089d4abdf14-kube-api-access-5fqbt\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646948 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-sys\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646973 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.647012 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.646981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-root\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.647486 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.647026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-tls\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.647486 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.647052 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.647486 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.647057 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d942d7f9-dd5b-4ec9-8044-d18261849ec5-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.647486 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.647399 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.647719 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.647674 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.649436 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.649414 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.649568 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.649474 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.649568 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.649528 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.655583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.655545 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s4fv\" (UniqueName: \"kubernetes.io/projected/bc2e71e9-8140-45b4-a84e-8c761ce72bb1-kube-api-access-8s4fv\") pod \"kube-state-metrics-56d9f944b4-27jh8\" (UID: \"bc2e71e9-8140-45b4-a84e-8c761ce72bb1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.655785 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.655749 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2wc4\" (UniqueName: \"kubernetes.io/projected/d942d7f9-dd5b-4ec9-8044-d18261849ec5-kube-api-access-z2wc4\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:52.747854 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.747814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748040 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.747869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-wtmp\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748040 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.747907 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqbt\" (UniqueName: \"kubernetes.io/projected/0c58b28f-4a28-4923-9b5c-1089d4abdf14-kube-api-access-5fqbt\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748040 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.747934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-sys\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748040 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.747979 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-root\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748040 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-tls\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748075 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-wtmp\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748108 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-root\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-textfile\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c58b28f-4a28-4923-9b5c-1089d4abdf14-metrics-client-ca\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748075 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c58b28f-4a28-4923-9b5c-1089d4abdf14-sys\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748586 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-textfile\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748586 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.748770 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.748725 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c58b28f-4a28-4923-9b5c-1089d4abdf14-metrics-client-ca\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.750736 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.750714 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-tls\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.750916 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.750896 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c58b28f-4a28-4923-9b5c-1089d4abdf14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.756307 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.756247 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqbt\" (UniqueName: \"kubernetes.io/projected/0c58b28f-4a28-4923-9b5c-1089d4abdf14-kube-api-access-5fqbt\") pod \"node-exporter-vvw6f\" (UID: \"0c58b28f-4a28-4923-9b5c-1089d4abdf14\") " pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.801229 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.801193 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" Jul 24 09:01:52.831631 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:52.831596 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvw6f" Jul 24 09:01:52.899540 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:52.899504 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c58b28f_4a28_4923_9b5c_1089d4abdf14.slice/crio-3263324901dfa48653aea3de939a2bb957b88c1624382be1182710e457985303 WatchSource:0}: Error finding container 3263324901dfa48653aea3de939a2bb957b88c1624382be1182710e457985303: Status 404 returned error can't find the container with id 3263324901dfa48653aea3de939a2bb957b88c1624382be1182710e457985303 Jul 24 09:01:53.019609 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.019577 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8"] Jul 24 09:01:53.022354 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:53.022314 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2e71e9_8140_45b4_a84e_8c761ce72bb1.slice/crio-1c1020e5316888ef744bb10e8bece736a24aad974bffbcf285b81986b1e93d2c WatchSource:0}: Error finding container 1c1020e5316888ef744bb10e8bece736a24aad974bffbcf285b81986b1e93d2c: Status 404 returned error can't find the container with id 1c1020e5316888ef744bb10e8bece736a24aad974bffbcf285b81986b1e93d2c Jul 24 09:01:53.150863 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.150771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:53.153177 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.153149 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d942d7f9-dd5b-4ec9-8044-d18261849ec5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7qskf\" (UID: \"d942d7f9-dd5b-4ec9-8044-d18261849ec5\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:53.323827 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.323792 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:01:53.327597 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.327573 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.329757 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.329727 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 09:01:53.329883 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.329843 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 09:01:53.330219 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330088 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 09:01:53.330219 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330143 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 09:01:53.330219 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330092 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 09:01:53.330507 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330386 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 09:01:53.330507 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330411 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2bpnl\"" Jul 24 09:01:53.330507 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 09:01:53.330507 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330437 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 09:01:53.330507 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.330421 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 09:01:53.344978 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.344955 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:01:53.386645 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.386615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" Jul 24 09:01:53.387328 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.387299 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvw6f" event={"ID":"0c58b28f-4a28-4923-9b5c-1089d4abdf14","Type":"ContainerStarted","Data":"3263324901dfa48653aea3de939a2bb957b88c1624382be1182710e457985303"} Jul 24 09:01:53.388498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.388473 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" event={"ID":"bc2e71e9-8140-45b4-a84e-8c761ce72bb1","Type":"ContainerStarted","Data":"1c1020e5316888ef744bb10e8bece736a24aad974bffbcf285b81986b1e93d2c"} Jul 24 09:01:53.390363 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.390336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7vq5" event={"ID":"6639a429-4492-4af2-9e2f-efdb4bb9c283","Type":"ContainerStarted","Data":"516c3d5414ef5d763984c53097c55ec557af59846d19584096aa5d8d486f6d5d"} Jul 24 09:01:53.453237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.452851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8t2\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-kube-api-access-bg8t2\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.452943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453212 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453882 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453882 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453882 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453827 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-config-out\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.453882 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453883 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.454124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453906 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-web-config\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.454124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.454124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.453967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.454124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.454006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.547169 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.547120 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf"] Jul 24 09:01:53.553418 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:53.553392 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd942d7f9_dd5b_4ec9_8044_d18261849ec5.slice/crio-22d19c87aa022ac500f95c86fd5046adfd01ddf99264066cdf2895b67128a61b WatchSource:0}: Error finding container 22d19c87aa022ac500f95c86fd5046adfd01ddf99264066cdf2895b67128a61b: Status 404 returned error can't find the container with id 22d19c87aa022ac500f95c86fd5046adfd01ddf99264066cdf2895b67128a61b Jul 24 09:01:53.554634 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.554602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.554749 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.554653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.554749 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.554681 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.554749 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.554709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-config-out\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.554749 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.554747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.554975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-web-config\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555102 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555355 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8t2\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-kube-api-access-bg8t2\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.555547 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.556718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.556350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.557231 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.557053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.558256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.558231 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.559574 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.559516 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.559923 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.559860 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.560700 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.560603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-web-config\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.561011 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.560988 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.561539 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.561239 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-config-out\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.561721 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.561697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.562016 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.561997 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.562223 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.562204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.568996 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.568978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8t2\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-kube-api-access-bg8t2\") pod \"alertmanager-main-0\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.637330 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.637302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:01:53.758077 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.757707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:53.760512 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.760302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 09:01:53.773083 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.772987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a-original-pull-secret\") pod \"global-pull-secret-syncer-gct5x\" (UID: \"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a\") " pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:53.818965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.818937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:01:53.826048 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.826016 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gct5x" Jul 24 09:01:53.858852 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.858810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:53.859037 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.858880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:53.861824 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.861620 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 09:01:53.861824 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.861648 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 09:01:53.871779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.871751 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 09:01:53.872469 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.872425 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e0a09d-1e5e-4fac-90e7-73ea46d77967-metrics-certs\") pod \"network-metrics-daemon-ctznw\" (UID: \"a2e0a09d-1e5e-4fac-90e7-73ea46d77967\") " pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:53.883227 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:53.883177 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xzg6\" (UniqueName: \"kubernetes.io/projected/50c412dc-0d5c-441b-bd97-3ba337ac75a5-kube-api-access-2xzg6\") pod \"network-check-target-x6xwp\" (UID: \"50c412dc-0d5c-441b-bd97-3ba337ac75a5\") " pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:54.014707 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:54.014263 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e252e65_be70_482d_a857_afaa987c4d8f.slice/crio-d1db173583ef518e9d6edd62c020f779719a89319b356c0e9172a1fbd9633b7c WatchSource:0}: Error finding container d1db173583ef518e9d6edd62c020f779719a89319b356c0e9172a1fbd9633b7c: Status 404 returned error can't find the container with id d1db173583ef518e9d6edd62c020f779719a89319b356c0e9172a1fbd9633b7c Jul 24 09:01:54.137894 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.137828 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4csjh\"" Jul 24 09:01:54.146044 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.145835 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctznw" Jul 24 09:01:54.148500 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.148354 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j27b2\"" Jul 24 09:01:54.156611 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.156376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:01:54.167910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.167746 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gct5x"] Jul 24 09:01:54.172340 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:54.172299 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c4edb8_bba6_4d94_b6a0_9ecf3a93e53a.slice/crio-080b938138553d597f24d23f395cab1875d1c25c1f56fd43cdb81f624724642d WatchSource:0}: Error finding container 080b938138553d597f24d23f395cab1875d1c25c1f56fd43cdb81f624724642d: Status 404 returned error can't find the container with id 080b938138553d597f24d23f395cab1875d1c25c1f56fd43cdb81f624724642d Jul 24 09:01:54.325659 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.325571 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ctznw"] Jul 24 09:01:54.351969 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.351932 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x6xwp"] Jul 24 09:01:54.402321 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.402256 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"d1db173583ef518e9d6edd62c020f779719a89319b356c0e9172a1fbd9633b7c"} Jul 24 09:01:54.404333 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.404309 2554 generic.go:356] "Generic (PLEG): container finished" podID="0c58b28f-4a28-4923-9b5c-1089d4abdf14" containerID="b0e68032ca2cad6581054aa348c88d482397c849bdc377fd0611cf11643fca0e" exitCode=0 Jul 24 09:01:54.404461 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.404362 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvw6f" event={"ID":"0c58b28f-4a28-4923-9b5c-1089d4abdf14","Type":"ContainerDied","Data":"b0e68032ca2cad6581054aa348c88d482397c849bdc377fd0611cf11643fca0e"} Jul 24 09:01:54.406311 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.406239 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gct5x" event={"ID":"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a","Type":"ContainerStarted","Data":"080b938138553d597f24d23f395cab1875d1c25c1f56fd43cdb81f624724642d"} Jul 24 09:01:54.409865 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.409579 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" event={"ID":"d942d7f9-dd5b-4ec9-8044-d18261849ec5","Type":"ContainerStarted","Data":"7c506f56e9d27a8596e60690ff0222421730d428caa75554d230e2b3465ca6e4"} Jul 24 09:01:54.409865 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.409669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" event={"ID":"d942d7f9-dd5b-4ec9-8044-d18261849ec5","Type":"ContainerStarted","Data":"a4bdf050827ce96a5467c05b9f316db4792a2778e54c8369b071471245fabc56"} Jul 24 09:01:54.409865 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:54.409702 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" event={"ID":"d942d7f9-dd5b-4ec9-8044-d18261849ec5","Type":"ContainerStarted","Data":"22d19c87aa022ac500f95c86fd5046adfd01ddf99264066cdf2895b67128a61b"} Jul 24 09:01:54.732131 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:54.732055 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c412dc_0d5c_441b_bd97_3ba337ac75a5.slice/crio-95204ccbc4b6b1a4fe805cdc51f44a6cd08fbca97634df9ad585dd264da06ad6 WatchSource:0}: Error finding container 95204ccbc4b6b1a4fe805cdc51f44a6cd08fbca97634df9ad585dd264da06ad6: Status 404 returned error can't find the container with id 95204ccbc4b6b1a4fe805cdc51f44a6cd08fbca97634df9ad585dd264da06ad6 Jul 24 09:01:54.732890 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:01:54.732846 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e0a09d_1e5e_4fac_90e7_73ea46d77967.slice/crio-a95e64fee68e8c072f0549a83505ef50e605b473c62e03af1e4a54bc1e0595bb WatchSource:0}: Error finding container a95e64fee68e8c072f0549a83505ef50e605b473c62e03af1e4a54bc1e0595bb: Status 404 returned error can't find the container with id a95e64fee68e8c072f0549a83505ef50e605b473c62e03af1e4a54bc1e0595bb Jul 24 09:01:55.365016 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.364939 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd"] Jul 24 09:01:55.386704 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.386666 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd"] Jul 24 09:01:55.386858 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.386789 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.391141 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.390899 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 09:01:55.391141 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.390961 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 09:01:55.391141 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.390983 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 09:01:55.391141 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.390910 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 09:01:55.391494 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.391255 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e96mbhtv9ec2e\"" Jul 24 09:01:55.391494 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.391365 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jl68f\"" Jul 24 09:01:55.391494 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.391437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 09:01:55.414749 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.414696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctznw" event={"ID":"a2e0a09d-1e5e-4fac-90e7-73ea46d77967","Type":"ContainerStarted","Data":"a95e64fee68e8c072f0549a83505ef50e605b473c62e03af1e4a54bc1e0595bb"} Jul 24 09:01:55.416266 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.416240 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x6xwp" event={"ID":"50c412dc-0d5c-441b-bd97-3ba337ac75a5","Type":"ContainerStarted","Data":"95204ccbc4b6b1a4fe805cdc51f44a6cd08fbca97634df9ad585dd264da06ad6"} Jul 24 09:01:55.475299 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-tls\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475299 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-grpc-tls\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38f2be3-f4b8-4795-a45c-2871daac496d-metrics-client-ca\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.475689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.475589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m69x\" (UniqueName: \"kubernetes.io/projected/b38f2be3-f4b8-4795-a45c-2871daac496d-kube-api-access-9m69x\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m69x\" (UniqueName: \"kubernetes.io/projected/b38f2be3-f4b8-4795-a45c-2871daac496d-kube-api-access-9m69x\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-tls\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576868 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-grpc-tls\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576958 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.576987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38f2be3-f4b8-4795-a45c-2871daac496d-metrics-client-ca\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.577114 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.577023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.578649 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.577913 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38f2be3-f4b8-4795-a45c-2871daac496d-metrics-client-ca\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.582067 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.581147 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.582067 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.581198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.583168 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.583104 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.583168 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.583137 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-grpc-tls\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.583867 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.583827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-tls\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.585444 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.585349 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b38f2be3-f4b8-4795-a45c-2871daac496d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.585817 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.585785 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m69x\" (UniqueName: \"kubernetes.io/projected/b38f2be3-f4b8-4795-a45c-2871daac496d-kube-api-access-9m69x\") pod \"thanos-querier-864cf9f4d8-tdbsd\" (UID: \"b38f2be3-f4b8-4795-a45c-2871daac496d\") " pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:55.699829 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:55.699750 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:01:56.755662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.754346 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-647d6d75d8-rvk72"] Jul 24 09:01:56.767901 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.767826 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.770092 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.768519 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647d6d75d8-rvk72"] Jul 24 09:01:56.774454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.773882 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 09:01:56.774454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.773938 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ha2qs78ip7as\"" Jul 24 09:01:56.774454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.774069 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 09:01:56.774454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.774139 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5xt2l\"" Jul 24 09:01:56.774454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.773882 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 09:01:56.774918 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.774898 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 09:01:56.889265 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj6qt\" (UniqueName: \"kubernetes.io/projected/d17ab182-40be-4928-8913-3ad5adccff58-kube-api-access-tj6qt\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.889466 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-secret-metrics-server-tls\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.889466 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d17ab182-40be-4928-8913-3ad5adccff58-audit-log\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.889466 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-client-ca-bundle\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.889638 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-secret-metrics-server-client-certs\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.889638 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17ab182-40be-4928-8913-3ad5adccff58-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.889638 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.889604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d17ab182-40be-4928-8913-3ad5adccff58-metrics-server-audit-profiles\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.990971 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.990881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-client-ca-bundle\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.990971 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.990929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-secret-metrics-server-client-certs\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.990971 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.990961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17ab182-40be-4928-8913-3ad5adccff58-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.991263 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.991006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d17ab182-40be-4928-8913-3ad5adccff58-metrics-server-audit-profiles\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.991263 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.991043 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj6qt\" (UniqueName: \"kubernetes.io/projected/d17ab182-40be-4928-8913-3ad5adccff58-kube-api-access-tj6qt\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.991263 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.991082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-secret-metrics-server-tls\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.991263 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.991126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d17ab182-40be-4928-8913-3ad5adccff58-audit-log\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.992229 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.992203 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d17ab182-40be-4928-8913-3ad5adccff58-metrics-server-audit-profiles\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.992757 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.992709 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17ab182-40be-4928-8913-3ad5adccff58-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.993129 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.993077 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d17ab182-40be-4928-8913-3ad5adccff58-audit-log\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.994720 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.994676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-client-ca-bundle\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.997161 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.997117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-secret-metrics-server-tls\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:56.997965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:56.997923 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d17ab182-40be-4928-8913-3ad5adccff58-secret-metrics-server-client-certs\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:57.001321 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.001273 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj6qt\" (UniqueName: \"kubernetes.io/projected/d17ab182-40be-4928-8913-3ad5adccff58-kube-api-access-tj6qt\") pod \"metrics-server-647d6d75d8-rvk72\" (UID: \"d17ab182-40be-4928-8913-3ad5adccff58\") " pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:57.082345 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.082070 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l"] Jul 24 09:01:57.084407 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.084334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:01:57.090657 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.090633 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.095163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.093814 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l"] Jul 24 09:01:57.095163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.094002 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ptdlv\"" Jul 24 09:01:57.095163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.094194 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 09:01:57.193203 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.193168 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecec7a3e-c63c-4109-91ec-cb2e672192c1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.193415 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.193234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5wd\" (UniqueName: \"kubernetes.io/projected/ecec7a3e-c63c-4109-91ec-cb2e672192c1-kube-api-access-gz5wd\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.239468 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.239435 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6745799699-9mmc9"] Jul 24 09:01:57.251353 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.251318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.254223 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.254155 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6745799699-9mmc9"] Jul 24 09:01:57.294086 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.294036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecec7a3e-c63c-4109-91ec-cb2e672192c1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.294265 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.294104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5wd\" (UniqueName: \"kubernetes.io/projected/ecec7a3e-c63c-4109-91ec-cb2e672192c1-kube-api-access-gz5wd\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.294534 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:57.294502 2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 24 09:01:57.294662 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:01:57.294593 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecec7a3e-c63c-4109-91ec-cb2e672192c1-monitoring-plugin-cert podName:ecec7a3e-c63c-4109-91ec-cb2e672192c1 nodeName:}" failed. No retries permitted until 2026-07-24 09:01:57.794571133 +0000 UTC m=+71.019584734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ecec7a3e-c63c-4109-91ec-cb2e672192c1-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-gxx7l" (UID: "ecec7a3e-c63c-4109-91ec-cb2e672192c1") : secret "monitoring-plugin-cert" not found Jul 24 09:01:57.305079 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.305035 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5wd\" (UniqueName: \"kubernetes.io/projected/ecec7a3e-c63c-4109-91ec-cb2e672192c1-kube-api-access-gz5wd\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.395010 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.394924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-service-ca\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.395010 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.394967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd8tt\" (UniqueName: \"kubernetes.io/projected/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-kube-api-access-wd8tt\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.395238 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.395087 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-serving-cert\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.395238 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.395120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-oauth-config\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.395238 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.395170 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-oauth-serving-cert\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.395238 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.395194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-trusted-ca-bundle\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.395454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.395265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-config\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.495792 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495738 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-config\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.495792 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-service-ca\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496046 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8tt\" (UniqueName: \"kubernetes.io/projected/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-kube-api-access-wd8tt\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496046 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-serving-cert\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496046 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-oauth-config\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496046 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-oauth-serving-cert\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496046 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.495969 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-trusted-ca-bundle\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496631 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.496607 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-config\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.496912 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.496885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-service-ca\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.497001 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.496936 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-trusted-ca-bundle\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.497001 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.496936 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-oauth-serving-cert\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.498689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.498668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-serving-cert\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.498822 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.498698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-oauth-config\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.507316 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.507271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd8tt\" (UniqueName: \"kubernetes.io/projected/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-kube-api-access-wd8tt\") pod \"console-6745799699-9mmc9\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.563359 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.563320 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:01:57.639259 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.639217 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk"] Jul 24 09:01:57.643395 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.643364 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.646777 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.646686 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 09:01:57.647055 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.647029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 09:01:57.647174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.647108 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 09:01:57.647530 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.647319 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p2b85\"" Jul 24 09:01:57.647530 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.647378 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 09:01:57.647530 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.647378 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 09:01:57.654155 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.653801 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 09:01:57.664584 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.664558 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk"] Jul 24 09:01:57.798876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.798834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gbt6\" (UniqueName: \"kubernetes.io/projected/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-kube-api-access-6gbt6\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.798886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.798931 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-secret-telemeter-client\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.798970 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.799011 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecec7a3e-c63c-4109-91ec-cb2e672192c1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.799043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-telemeter-client-tls\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.799073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-serving-certs-ca-bundle\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.799107 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-federate-client-tls\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.799367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.799128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-metrics-client-ca\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.802057 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.802029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecec7a3e-c63c-4109-91ec-cb2e672192c1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gxx7l\" (UID: \"ecec7a3e-c63c-4109-91ec-cb2e672192c1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:57.900642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900524 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-secret-telemeter-client\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-telemeter-client-tls\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-serving-certs-ca-bundle\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900659 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-federate-client-tls\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900681 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-metrics-client-ca\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gbt6\" (UniqueName: \"kubernetes.io/projected/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-kube-api-access-6gbt6\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.900965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.900775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.901783 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.901448 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-metrics-client-ca\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.901783 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.901715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-serving-certs-ca-bundle\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.901980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.901957 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.903801 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.903758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-telemeter-client-tls\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.904141 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.904117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-secret-telemeter-client\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.904226 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.904124 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.904423 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.904395 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-federate-client-tls\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.911019 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.910975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gbt6\" (UniqueName: \"kubernetes.io/projected/00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4-kube-api-access-6gbt6\") pod \"telemeter-client-74bdf4bb55-ch9lk\" (UID: \"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4\") " pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:57.957908 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:57.957872 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" Jul 24 09:01:58.005264 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.005235 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:01:58.571763 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.570154 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:01:58.582024 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.581987 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.584953 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.584927 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 09:01:58.585088 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.584927 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 09:01:58.586505 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.586485 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 09:01:58.586942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.586921 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 09:01:58.587036 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.586990 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 09:01:58.587206 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.587190 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 09:01:58.587359 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.587191 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-blzhm\"" Jul 24 09:01:58.587359 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.587237 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 09:01:58.589580 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.589563 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 09:01:58.590035 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.589904 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 09:01:58.590273 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.590147 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0ba5ui6dimgr\"" Jul 24 09:01:58.592737 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.592712 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 09:01:58.592848 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.592772 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 09:01:58.593086 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.593061 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 09:01:58.594161 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.594142 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 09:01:58.599367 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.599344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 09:01:58.603519 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.603498 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:01:58.707675 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707675 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707681 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707699 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-web-config\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707770 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grh7d\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-kube-api-access-grh7d\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.707910 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707884 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.707957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-config\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708143 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-config-out\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708309 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708346 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.708484 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.708414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.809719 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809662 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-web-config\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809855 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809883 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grh7d\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-kube-api-access-grh7d\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.809997 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-config\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810133 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.810197 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.811256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-config-out\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.811256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.811256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.811256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.811256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.810482 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.811256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.811168 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.812266 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.812235 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.813119 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.812894 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.813840 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.813754 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.813932 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.813856 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.814207 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.814184 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.814514 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.814490 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.814603 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.814513 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.815157 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.815132 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.818188 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.818164 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-web-config\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.818432 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.818411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-config-out\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.818891 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.818849 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.818992 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.818922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.818992 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.818972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-config\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.819412 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.819390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.819486 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.819410 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.819818 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.819788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.822071 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.822017 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.822175 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.822158 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grh7d\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-kube-api-access-grh7d\") pod \"prometheus-k8s-0\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:01:58.895509 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:01:58.895446 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:02:00.382422 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:00.382390 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gcpx5" Jul 24 09:02:01.261121 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.256598 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6745799699-9mmc9"] Jul 24 09:02:01.271964 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.271860 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd"] Jul 24 09:02:01.306565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.306371 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l"] Jul 24 09:02:01.315359 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:02:01.315331 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7a5c5a_6d11_4055_9c75_0bc45da3a2b1.slice/crio-e3483b3d342eb0752fc85f6ecb51e5c1ae28019cd60692d18d3ba98d62769e26 WatchSource:0}: Error finding container e3483b3d342eb0752fc85f6ecb51e5c1ae28019cd60692d18d3ba98d62769e26: Status 404 returned error can't find the container with id e3483b3d342eb0752fc85f6ecb51e5c1ae28019cd60692d18d3ba98d62769e26 Jul 24 09:02:01.315542 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:02:01.315522 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecec7a3e_c63c_4109_91ec_cb2e672192c1.slice/crio-75c44f64f5acafa841c82c31ee6ce0dd2e7f94d070da282b7df05ac509a8e909 WatchSource:0}: Error finding container 75c44f64f5acafa841c82c31ee6ce0dd2e7f94d070da282b7df05ac509a8e909: Status 404 returned error can't find the container with id 75c44f64f5acafa841c82c31ee6ce0dd2e7f94d070da282b7df05ac509a8e909 Jul 24 09:02:01.323982 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:02:01.323662 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38f2be3_f4b8_4795_a45c_2871daac496d.slice/crio-92e75136c3208a8e061b1380c55ad317b676db0f25fd6af1f0c8ad193e23f610 WatchSource:0}: Error finding container 92e75136c3208a8e061b1380c55ad317b676db0f25fd6af1f0c8ad193e23f610: Status 404 returned error can't find the container with id 92e75136c3208a8e061b1380c55ad317b676db0f25fd6af1f0c8ad193e23f610 Jul 24 09:02:01.368539 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.368419 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:02:01.454144 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.453612 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="b963bf9534c1c00b29d8654d44210ea72fc1a5e7a25a61eac6a2d91632197686" exitCode=0 Jul 24 09:02:01.454144 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.453698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"b963bf9534c1c00b29d8654d44210ea72fc1a5e7a25a61eac6a2d91632197686"} Jul 24 09:02:01.463890 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.463673 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctznw" event={"ID":"a2e0a09d-1e5e-4fac-90e7-73ea46d77967","Type":"ContainerStarted","Data":"c749467220914d9783c421eb36fdd80148fdf79a4ecb24ca8ff6332a80dff6e9"} Jul 24 09:02:01.466598 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.466371 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvw6f" event={"ID":"0c58b28f-4a28-4923-9b5c-1089d4abdf14","Type":"ContainerStarted","Data":"00d1cd787620c137c9c4cb8ea3b5be7d832652bf132c5ae99e7d840773336a88"} Jul 24 09:02:01.466598 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.466429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvw6f" event={"ID":"0c58b28f-4a28-4923-9b5c-1089d4abdf14","Type":"ContainerStarted","Data":"06fcea9ade8934b827d23240b54f1896a6478be5836abb1d34e98dcd641026c0"} Jul 24 09:02:01.470766 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.470635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" event={"ID":"bc2e71e9-8140-45b4-a84e-8c761ce72bb1","Type":"ContainerStarted","Data":"5557046f0b98e352012e1cb4ec8ebceabb1ccbf98b5e4fdbea65c50dd1ede694"} Jul 24 09:02:01.470766 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.470702 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" event={"ID":"bc2e71e9-8140-45b4-a84e-8c761ce72bb1","Type":"ContainerStarted","Data":"18d67c020ae3153c8d49e786766cb01b3cea8589b1fff4a60501a624bc055ce4"} Jul 24 09:02:01.476345 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.476033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gct5x" event={"ID":"15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a","Type":"ContainerStarted","Data":"9325e40c2edc5219ee9d07c133e4f1d96edbf43e34b8a00a30444f282193aaea"} Jul 24 09:02:01.480028 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.479003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6745799699-9mmc9" event={"ID":"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1","Type":"ContainerStarted","Data":"a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc"} Jul 24 09:02:01.480028 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.479053 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6745799699-9mmc9" event={"ID":"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1","Type":"ContainerStarted","Data":"e3483b3d342eb0752fc85f6ecb51e5c1ae28019cd60692d18d3ba98d62769e26"} Jul 24 09:02:01.484394 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.484125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7vq5" event={"ID":"6639a429-4492-4af2-9e2f-efdb4bb9c283","Type":"ContainerStarted","Data":"bb05dff784dbeb3ae5e48f0c6eef825ca68b8e3e0fa0f8ff3c780cc5ba2e4513"} Jul 24 09:02:01.490433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.490405 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" event={"ID":"d942d7f9-dd5b-4ec9-8044-d18261849ec5","Type":"ContainerStarted","Data":"29949b66a7d213aaa79d2e6a4c18c8b65e4cfb024b1c50eb14c6a10fb8acdc5b"} Jul 24 09:02:01.492858 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.492712 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x6xwp" event={"ID":"50c412dc-0d5c-441b-bd97-3ba337ac75a5","Type":"ContainerStarted","Data":"8b95db543684b46207135a43e20f2acd0e600d9513502875c629f111649b1885"} Jul 24 09:02:01.492858 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.492783 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:02:01.494411 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.494244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"58cb29d622b2ffaeb4e732c9f613959db8f4a6b5efc20ee44527096c10ecfd49"} Jul 24 09:02:01.495972 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.495932 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"92e75136c3208a8e061b1380c55ad317b676db0f25fd6af1f0c8ad193e23f610"} Jul 24 09:02:01.497594 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.497471 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" event={"ID":"ecec7a3e-c63c-4109-91ec-cb2e672192c1","Type":"ContainerStarted","Data":"75c44f64f5acafa841c82c31ee6ce0dd2e7f94d070da282b7df05ac509a8e909"} Jul 24 09:02:01.557374 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.557244 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x6xwp" podStartSLOduration=67.358767248 podStartE2EDuration="1m13.557223s" totalImagesPullingTime="6.198455752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:01.547008668 +0000 UTC m=+74.772022291" watchObservedRunningTime="2026-07-24 09:02:01.557223 +0000 UTC m=+74.782236618" Jul 24 09:02:01.557907 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.557887 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647d6d75d8-rvk72"] Jul 24 09:02:01.581252 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.581220 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk"] Jul 24 09:02:01.589133 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.589008 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gct5x" podStartSLOduration=66.742187462 podStartE2EDuration="1m13.5889954s" totalImagesPullingTime="6.846807938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:01.58781797 +0000 UTC m=+74.812831591" watchObservedRunningTime="2026-07-24 09:02:01.5889954 +0000 UTC m=+74.814009021" Jul 24 09:02:01.592384 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:02:01.592344 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17ab182_40be_4928_8913_3ad5adccff58.slice/crio-4f06d860c471634f0f7c44073d2318b2f342ed7b9073f4afba13c2e86bacb849 WatchSource:0}: Error finding container 4f06d860c471634f0f7c44073d2318b2f342ed7b9073f4afba13c2e86bacb849: Status 404 returned error can't find the container with id 4f06d860c471634f0f7c44073d2318b2f342ed7b9073f4afba13c2e86bacb849 Jul 24 09:02:01.592619 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:02:01.592592 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ec8f3f_a26d_4bee_b9fb_93726b2fbeb4.slice/crio-c5dbf57eee74561e7342e71286cb406855999d5d3754817ee6643037e3ad5b62 WatchSource:0}: Error finding container c5dbf57eee74561e7342e71286cb406855999d5d3754817ee6643037e3ad5b62: Status 404 returned error can't find the container with id c5dbf57eee74561e7342e71286cb406855999d5d3754817ee6643037e3ad5b62 Jul 24 09:02:01.636612 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.636557 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7qskf" podStartSLOduration=4.204350034 podStartE2EDuration="9.636542331s" totalImagesPullingTime="5.432192297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:01.635479305 +0000 UTC m=+74.860492926" watchObservedRunningTime="2026-07-24 09:02:01.636542331 +0000 UTC m=+74.861555986" Jul 24 09:02:01.686604 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.686550 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6745799699-9mmc9" podStartSLOduration=4.686534244 podStartE2EDuration="4.686534244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:01.685652452 +0000 UTC m=+74.910666073" watchObservedRunningTime="2026-07-24 09:02:01.686534244 +0000 UTC m=+74.911547865" Jul 24 09:02:01.744702 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.744580 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vvw6f" podStartSLOduration=8.481837793 podStartE2EDuration="9.744557725s" totalImagesPullingTime="1.161043287s" totalInitContainerRuntime="101.676645ms" isStatefulPod=true podCreationTimestamp="2026-07-24 09:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:01.714109063 +0000 UTC m=+74.939122709" watchObservedRunningTime="2026-07-24 09:02:01.744557725 +0000 UTC m=+74.969571347" Jul 24 09:02:01.744946 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:01.744913 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w7vq5" podStartSLOduration=2.422484616 podStartE2EDuration="21.744899966s" totalImagesPullingTime="19.32241535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:01:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:01.742918552 +0000 UTC m=+74.967932174" watchObservedRunningTime="2026-07-24 09:02:01.744899966 +0000 UTC m=+74.969913590" Jul 24 09:02:02.511003 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.510077 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctznw" event={"ID":"a2e0a09d-1e5e-4fac-90e7-73ea46d77967","Type":"ContainerStarted","Data":"084056bc5d228d2f918438a62e2c4d13461f108e72fd6e04d56afc154ab65e75"} Jul 24 09:02:02.514633 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.514486 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" exitCode=0 Jul 24 09:02:02.514633 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.514589 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} Jul 24 09:02:02.520407 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.520379 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" event={"ID":"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4","Type":"ContainerStarted","Data":"c5dbf57eee74561e7342e71286cb406855999d5d3754817ee6643037e3ad5b62"} Jul 24 09:02:02.528132 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.528033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" event={"ID":"bc2e71e9-8140-45b4-a84e-8c761ce72bb1","Type":"ContainerStarted","Data":"aa68c49644039bfeee2f17d28bf2de8372c9aae3150b1d946739e7e54f293ff6"} Jul 24 09:02:02.536945 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.533918 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" event={"ID":"d17ab182-40be-4928-8913-3ad5adccff58","Type":"ContainerStarted","Data":"4f06d860c471634f0f7c44073d2318b2f342ed7b9073f4afba13c2e86bacb849"} Jul 24 09:02:02.581757 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.580878 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ctznw" podStartSLOduration=68.343302854 podStartE2EDuration="1m14.580861829s" totalImagesPullingTime="6.237558975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:02.53685478 +0000 UTC m=+75.761868403" watchObservedRunningTime="2026-07-24 09:02:02.580861829 +0000 UTC m=+75.805875450" Jul 24 09:02:02.607196 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:02.605995 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-27jh8" podStartSLOduration=4.451879649 podStartE2EDuration="10.605971263s" totalImagesPullingTime="6.154091614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:02.602096822 +0000 UTC m=+75.827110458" watchObservedRunningTime="2026-07-24 09:02:02.605971263 +0000 UTC m=+75.830984888" Jul 24 09:02:06.560454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.560198 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} Jul 24 09:02:06.567498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.567339 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"4cc7368364924b6964ef8a5c0f1ad86108da52cbc7eeea81ad9148d7341dacfb"} Jul 24 09:02:06.567498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.567431 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"1139cdb4d89ea4d9e9eacf6d1782ae1a91d093ec5cb7948239207b18eb77ec63"} Jul 24 09:02:06.572769 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.572685 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" event={"ID":"ecec7a3e-c63c-4109-91ec-cb2e672192c1","Type":"ContainerStarted","Data":"873b5cb4e31be18ac75810d5050f6fd47a64731870c433a37245ee74c186002c"} Jul 24 09:02:06.573689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.573634 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:02:06.577155 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.577084 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" event={"ID":"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4","Type":"ContainerStarted","Data":"ecadac6a14de11c39cbbd9212815d67417c542a71d65521b8b979e561ad6cacb"} Jul 24 09:02:06.579422 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.579391 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" event={"ID":"d17ab182-40be-4928-8913-3ad5adccff58","Type":"ContainerStarted","Data":"7a871e7c1ed4cfcfc7ee704df72c612742069907972094c4137b483550bf5442"} Jul 24 09:02:06.580729 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.580699 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" Jul 24 09:02:06.582049 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.582026 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"b01112c97a002768dd13d2b54cf059acc9409227b7788caf61f4bb17119736c0"} Jul 24 09:02:06.592762 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:06.591969 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gxx7l" podStartSLOduration=4.575208886 podStartE2EDuration="9.591949434s" totalImagesPullingTime="5.016740548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:06.589588515 +0000 UTC m=+79.814602137" watchObservedRunningTime="2026-07-24 09:02:06.591949434 +0000 UTC m=+79.816963058" Jul 24 09:02:07.563527 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.563503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:02:07.563808 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.563597 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:02:07.569731 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.569706 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:02:07.588847 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.588789 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" podStartSLOduration=6.849648784 podStartE2EDuration="11.588770889s" totalImagesPullingTime="4.739122105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:06.632487653 +0000 UTC m=+79.857501278" watchObservedRunningTime="2026-07-24 09:02:07.588770889 +0000 UTC m=+80.813784514" Jul 24 09:02:07.592835 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.592801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"ad68af8f2ef6fe6f22c3904c8c569d2a3a5665afe54f0fd515f98941cba7e43b"} Jul 24 09:02:07.592973 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.592885 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"7dd1ead52051b116dbed208e6448d7060bd5e15f1562795d33719aa8dbb56408"} Jul 24 09:02:07.592973 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.592928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"f092694fbb340cf2ca5d767a53da6fcd56e2f137519a17a18aa497c20e689cd0"} Jul 24 09:02:07.592973 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.592964 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"98f6da836b36425702552d078ba7770ea8c2c5aadd8ab27675473fc4c882cb84"} Jul 24 09:02:07.593098 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.592997 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerStarted","Data":"f9e7676dcbd30c78896dcd24824c2ab82eaa66426437315dad2871b0682d76f9"} Jul 24 09:02:07.596782 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.596626 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} Jul 24 09:02:07.596782 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.596698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} Jul 24 09:02:07.596782 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.596744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} Jul 24 09:02:07.596782 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.596784 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} Jul 24 09:02:07.597105 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.596834 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerStarted","Data":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} Jul 24 09:02:07.600243 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.600216 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"d7eab9c34df12ace6d4c9ecba18cf1408dc825787059bf0bab854414535014dd"} Jul 24 09:02:07.600395 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.600306 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"374204871fdef9df614a86344e2d1082d5c423749f5d74c4a67cf0b92a25eb81"} Jul 24 09:02:07.600395 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.600341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"cd83b8077370d50f084380baeadc2fc9500699bc366d89c30dbe2f82d6d80646"} Jul 24 09:02:07.600395 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.600388 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:02:07.600561 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.600429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" event={"ID":"b38f2be3-f4b8-4795-a45c-2871daac496d","Type":"ContainerStarted","Data":"419b08e9b6d1fc06d860a7c2b69d5c74fd8d0c41ea103dff03356802bef1e6c3"} Jul 24 09:02:07.602704 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.602669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" event={"ID":"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4","Type":"ContainerStarted","Data":"8c8e9fe5af4f74073c12477298398c7e3b2e59e4cbee4d805e4b49633077137c"} Jul 24 09:02:07.602834 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.602733 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" event={"ID":"00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4","Type":"ContainerStarted","Data":"5a56c37df808e54577d31e61b143754285b102ec6578eb2af782c34c6c858f57"} Jul 24 09:02:07.607110 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.607092 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:02:07.622662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.622534 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.59252262 podStartE2EDuration="14.622514653s" totalImagesPullingTime="11.988717729s" totalInitContainerRuntime="41.274304ms" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:07.620989636 +0000 UTC m=+80.846003283" watchObservedRunningTime="2026-07-24 09:02:07.622514653 +0000 UTC m=+80.847528277" Jul 24 09:02:07.645297 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.645202 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" podStartSLOduration=6.924889895 podStartE2EDuration="12.645180533s" totalImagesPullingTime="5.720290638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:07.643892831 +0000 UTC m=+80.868906455" watchObservedRunningTime="2026-07-24 09:02:07.645180533 +0000 UTC m=+80.870194156" Jul 24 09:02:07.694347 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.694274 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.779707157 podStartE2EDuration="9.694258577s" totalImagesPullingTime="3.878606085s" totalInitContainerRuntime="35.945335ms" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:07.692580388 +0000 UTC m=+80.917594011" watchObservedRunningTime="2026-07-24 09:02:07.694258577 +0000 UTC m=+80.919272177" Jul 24 09:02:07.699472 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.699444 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d589d69b8-5kz4s"] Jul 24 09:02:07.720967 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:07.720905 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74bdf4bb55-ch9lk" podStartSLOduration=5.982306467 podStartE2EDuration="10.720885571s" totalImagesPullingTime="4.738579104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:02:07.7200414 +0000 UTC m=+80.945055024" watchObservedRunningTime="2026-07-24 09:02:07.720885571 +0000 UTC m=+80.945899194" Jul 24 09:02:08.896325 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:08.896253 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:02:13.620881 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:13.620845 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-864cf9f4d8-tdbsd" Jul 24 09:02:17.084927 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:17.084895 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:02:17.085323 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:17.084961 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:02:20.109688 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:20.109658 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6745799699-9mmc9"] Jul 24 09:02:32.537119 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:32.537084 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x6xwp" Jul 24 09:02:32.722373 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:32.722317 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d589d69b8-5kz4s" podUID="88934311-c11e-4f7c-8807-6fd6fbf4ee9e" containerName="console" containerID="cri-o://0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d" gracePeriod=15 Jul 24 09:02:32.959238 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:32.959213 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:02:33.061932 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.061898 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-oauth-config\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.061945 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xhns\" (UniqueName: \"kubernetes.io/projected/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-kube-api-access-9xhns\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.061970 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-service-ca\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062027 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-serving-cert\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062051 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-trusted-ca-bundle\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062074 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-oauth-serving-cert\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062130 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062099 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-config\") pod \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\" (UID: \"88934311-c11e-4f7c-8807-6fd6fbf4ee9e\") " Jul 24 09:02:33.062528 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062500 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-service-ca" (OuterVolumeSpecName: "service-ca") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:33.062677 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062611 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:33.062677 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062525 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:33.062793 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.062713 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-config" (OuterVolumeSpecName: "console-config") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:33.064459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.064427 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-kube-api-access-9xhns" (OuterVolumeSpecName: "kube-api-access-9xhns") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "kube-api-access-9xhns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:02:33.064459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.064443 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:02:33.064596 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.064498 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "88934311-c11e-4f7c-8807-6fd6fbf4ee9e" (UID: "88934311-c11e-4f7c-8807-6fd6fbf4ee9e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163200 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-serving-cert\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163224 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-trusted-ca-bundle\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163236 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-oauth-serving-cert\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163245 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163253 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-console-oauth-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163262 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xhns\" (UniqueName: \"kubernetes.io/projected/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-kube-api-access-9xhns\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.163274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.163270 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88934311-c11e-4f7c-8807-6fd6fbf4ee9e-service-ca\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:33.721300 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.721251 2554 generic.go:356] "Generic (PLEG): container finished" podID="88934311-c11e-4f7c-8807-6fd6fbf4ee9e" containerID="0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d" exitCode=0 Jul 24 09:02:33.721700 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.721324 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d589d69b8-5kz4s" Jul 24 09:02:33.721700 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.721334 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d589d69b8-5kz4s" event={"ID":"88934311-c11e-4f7c-8807-6fd6fbf4ee9e","Type":"ContainerDied","Data":"0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d"} Jul 24 09:02:33.721700 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.721409 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d589d69b8-5kz4s" event={"ID":"88934311-c11e-4f7c-8807-6fd6fbf4ee9e","Type":"ContainerDied","Data":"b8ee140f6e0e6f3a317eb092562b0635d3f966e61524c556a7f28ee1d64dd527"} Jul 24 09:02:33.721700 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.721431 2554 scope.go:117] "RemoveContainer" containerID="0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d" Jul 24 09:02:33.730888 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.730804 2554 scope.go:117] "RemoveContainer" containerID="0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d" Jul 24 09:02:33.731097 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:02:33.731076 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d\": container with ID starting with 0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d not found: ID does not exist" containerID="0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d" Jul 24 09:02:33.731164 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.731111 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d"} err="failed to get container status \"0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d\": rpc error: code = NotFound desc = could not find container \"0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d\": container with ID starting with 0cbc3593caa0a3fad1c78857ba2c6afe566939b64644852e1ecefc918789ad2d not found: ID does not exist" Jul 24 09:02:33.743037 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.743016 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d589d69b8-5kz4s"] Jul 24 09:02:33.746376 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:33.746270 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d589d69b8-5kz4s"] Jul 24 09:02:34.109774 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:34.109741 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88934311-c11e-4f7c-8807-6fd6fbf4ee9e" path="/var/lib/kubelet/pods/88934311-c11e-4f7c-8807-6fd6fbf4ee9e/volumes" Jul 24 09:02:37.090395 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:37.090358 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:02:37.094215 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:37.094194 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-647d6d75d8-rvk72" Jul 24 09:02:45.129236 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.129168 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6745799699-9mmc9" podUID="0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" containerName="console" containerID="cri-o://a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc" gracePeriod=15 Jul 24 09:02:45.365063 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.365037 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:02:45.480371 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480339 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-config\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480399 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-service-ca\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480427 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd8tt\" (UniqueName: \"kubernetes.io/projected/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-kube-api-access-wd8tt\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480498 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-oauth-config\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480530 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-trusted-ca-bundle\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480734 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480612 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-oauth-serving-cert\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480734 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480641 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-serving-cert\") pod \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\" (UID: \"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1\") " Jul 24 09:02:45.480836 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480803 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-config" (OuterVolumeSpecName: "console-config") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:45.480954 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480930 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.481089 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.480950 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:45.481170 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.481084 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:45.481170 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.481090 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:02:45.482965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.482940 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:02:45.483067 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.483006 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:02:45.483067 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.483050 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-kube-api-access-wd8tt" (OuterVolumeSpecName: "kube-api-access-wd8tt") pod "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" (UID: "0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1"). InnerVolumeSpecName "kube-api-access-wd8tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:02:45.581662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.581627 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-oauth-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.581662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.581655 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-trusted-ca-bundle\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.581662 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.581666 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-oauth-serving-cert\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.581876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.581675 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-console-serving-cert\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.581876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.581685 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-service-ca\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.581876 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.581694 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd8tt\" (UniqueName: \"kubernetes.io/projected/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1-kube-api-access-wd8tt\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:02:45.784577 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.784542 2554 generic.go:356] "Generic (PLEG): container finished" podID="0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" containerID="a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc" exitCode=0 Jul 24 09:02:45.784746 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.784588 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6745799699-9mmc9" Jul 24 09:02:45.784746 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.784623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6745799699-9mmc9" event={"ID":"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1","Type":"ContainerDied","Data":"a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc"} Jul 24 09:02:45.784746 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.784675 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6745799699-9mmc9" event={"ID":"0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1","Type":"ContainerDied","Data":"e3483b3d342eb0752fc85f6ecb51e5c1ae28019cd60692d18d3ba98d62769e26"} Jul 24 09:02:45.784746 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.784696 2554 scope.go:117] "RemoveContainer" containerID="a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc" Jul 24 09:02:45.793657 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.793643 2554 scope.go:117] "RemoveContainer" containerID="a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc" Jul 24 09:02:45.793888 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:02:45.793868 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc\": container with ID starting with a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc not found: ID does not exist" containerID="a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc" Jul 24 09:02:45.793950 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.793892 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc"} err="failed to get container status \"a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc\": rpc error: code = NotFound desc = could not find container \"a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc\": container with ID starting with a3c94a607e23b9165ca900263890d3423904f06e867e47d2cb39b0ce401b0cdc not found: ID does not exist" Jul 24 09:02:45.805718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.805691 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6745799699-9mmc9"] Jul 24 09:02:45.809772 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:45.809750 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6745799699-9mmc9"] Jul 24 09:02:46.109690 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:46.109613 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" path="/var/lib/kubelet/pods/0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1/volumes" Jul 24 09:02:58.895823 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:58.895778 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:02:58.915333 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:58.915304 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:02:59.856926 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:02:59.856899 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:12.692895 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.692857 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:03:12.693490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.693267 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="alertmanager" containerID="cri-o://b01112c97a002768dd13d2b54cf059acc9409227b7788caf61f4bb17119736c0" gracePeriod=120 Jul 24 09:03:12.693490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.693341 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-metric" containerID="cri-o://7dd1ead52051b116dbed208e6448d7060bd5e15f1562795d33719aa8dbb56408" gracePeriod=120 Jul 24 09:03:12.693490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.693352 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy" containerID="cri-o://f092694fbb340cf2ca5d767a53da6fcd56e2f137519a17a18aa497c20e689cd0" gracePeriod=120 Jul 24 09:03:12.693490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.693389 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="config-reloader" containerID="cri-o://f9e7676dcbd30c78896dcd24824c2ab82eaa66426437315dad2871b0682d76f9" gracePeriod=120 Jul 24 09:03:12.693490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.693351 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-web" containerID="cri-o://98f6da836b36425702552d078ba7770ea8c2c5aadd8ab27675473fc4c882cb84" gracePeriod=120 Jul 24 09:03:12.693490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.693422 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="prom-label-proxy" containerID="cri-o://ad68af8f2ef6fe6f22c3904c8c569d2a3a5665afe54f0fd515f98941cba7e43b" gracePeriod=120 Jul 24 09:03:12.891779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891748 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="ad68af8f2ef6fe6f22c3904c8c569d2a3a5665afe54f0fd515f98941cba7e43b" exitCode=0 Jul 24 09:03:12.891779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891773 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="7dd1ead52051b116dbed208e6448d7060bd5e15f1562795d33719aa8dbb56408" exitCode=0 Jul 24 09:03:12.891779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891781 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="f092694fbb340cf2ca5d767a53da6fcd56e2f137519a17a18aa497c20e689cd0" exitCode=0 Jul 24 09:03:12.891779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891789 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="f9e7676dcbd30c78896dcd24824c2ab82eaa66426437315dad2871b0682d76f9" exitCode=0 Jul 24 09:03:12.891779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891797 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="b01112c97a002768dd13d2b54cf059acc9409227b7788caf61f4bb17119736c0" exitCode=0 Jul 24 09:03:12.892072 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891825 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"ad68af8f2ef6fe6f22c3904c8c569d2a3a5665afe54f0fd515f98941cba7e43b"} Jul 24 09:03:12.892072 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891901 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"7dd1ead52051b116dbed208e6448d7060bd5e15f1562795d33719aa8dbb56408"} Jul 24 09:03:12.892072 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"f092694fbb340cf2ca5d767a53da6fcd56e2f137519a17a18aa497c20e689cd0"} Jul 24 09:03:12.892072 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891956 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"f9e7676dcbd30c78896dcd24824c2ab82eaa66426437315dad2871b0682d76f9"} Jul 24 09:03:12.892072 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:12.891985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"b01112c97a002768dd13d2b54cf059acc9409227b7788caf61f4bb17119736c0"} Jul 24 09:03:13.899506 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:13.899473 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e252e65-be70-482d-a857-afaa987c4d8f" containerID="98f6da836b36425702552d078ba7770ea8c2c5aadd8ab27675473fc4c882cb84" exitCode=0 Jul 24 09:03:13.899944 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:13.899556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"98f6da836b36425702552d078ba7770ea8c2c5aadd8ab27675473fc4c882cb84"} Jul 24 09:03:13.940451 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:13.940423 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:14.037942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.037849 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg8t2\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-kube-api-access-bg8t2\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.037942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.037895 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-main-db\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.037942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.037921 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.037961 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-main-tls\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.037993 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-tls-assets\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038022 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-metrics-client-ca\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038054 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038106 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-config-out\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038135 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-cluster-tls-config\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038169 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-web-config\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038227 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-config-volume\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038245 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 09:03:14.038610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038266 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-trusted-ca-bundle\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038327 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8e252e65-be70-482d-a857-afaa987c4d8f\" (UID: \"8e252e65-be70-482d-a857-afaa987c4d8f\") " Jul 24 09:03:14.038610 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038607 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-main-db\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.038862 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.038639 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:14.039435 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.039369 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:14.041459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.041426 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:03:14.041564 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.041538 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.042097 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.042066 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.042314 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.042259 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-kube-api-access-bg8t2" (OuterVolumeSpecName: "kube-api-access-bg8t2") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "kube-api-access-bg8t2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:03:14.042314 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.042273 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-config-out" (OuterVolumeSpecName: "config-out") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 09:03:14.042471 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.042340 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.042726 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.042694 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-config-volume" (OuterVolumeSpecName: "config-volume") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.042825 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.042768 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.045842 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.045820 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.052292 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.052251 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-web-config" (OuterVolumeSpecName: "web-config") pod "8e252e65-be70-482d-a857-afaa987c4d8f" (UID: "8e252e65-be70-482d-a857-afaa987c4d8f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:14.139980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.139945 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.139980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.139975 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg8t2\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-kube-api-access-bg8t2\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.139992 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140005 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-main-tls\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140018 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e252e65-be70-482d-a857-afaa987c4d8f-tls-assets\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140029 2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-metrics-client-ca\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140041 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140055 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e252e65-be70-482d-a857-afaa987c4d8f-config-out\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140068 2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-cluster-tls-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140079 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-web-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140091 2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e252e65-be70-482d-a857-afaa987c4d8f-config-volume\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.140163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.140102 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e252e65-be70-482d-a857-afaa987c4d8f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:14.906644 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.906608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e252e65-be70-482d-a857-afaa987c4d8f","Type":"ContainerDied","Data":"d1db173583ef518e9d6edd62c020f779719a89319b356c0e9172a1fbd9633b7c"} Jul 24 09:03:14.906644 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.906633 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:14.907108 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.906684 2554 scope.go:117] "RemoveContainer" containerID="ad68af8f2ef6fe6f22c3904c8c569d2a3a5665afe54f0fd515f98941cba7e43b" Jul 24 09:03:14.914539 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.914517 2554 scope.go:117] "RemoveContainer" containerID="7dd1ead52051b116dbed208e6448d7060bd5e15f1562795d33719aa8dbb56408" Jul 24 09:03:14.921403 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.921378 2554 scope.go:117] "RemoveContainer" containerID="f092694fbb340cf2ca5d767a53da6fcd56e2f137519a17a18aa497c20e689cd0" Jul 24 09:03:14.928429 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.928406 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:03:14.930381 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.930353 2554 scope.go:117] "RemoveContainer" containerID="98f6da836b36425702552d078ba7770ea8c2c5aadd8ab27675473fc4c882cb84" Jul 24 09:03:14.931547 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.931529 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:03:14.936941 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.936921 2554 scope.go:117] "RemoveContainer" containerID="f9e7676dcbd30c78896dcd24824c2ab82eaa66426437315dad2871b0682d76f9" Jul 24 09:03:14.943512 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.943492 2554 scope.go:117] "RemoveContainer" containerID="b01112c97a002768dd13d2b54cf059acc9409227b7788caf61f4bb17119736c0" Jul 24 09:03:14.950492 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.950355 2554 scope.go:117] "RemoveContainer" containerID="b963bf9534c1c00b29d8654d44210ea72fc1a5e7a25a61eac6a2d91632197686" Jul 24 09:03:14.958980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.958961 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:03:14.959385 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959370 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="alertmanager" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959387 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="alertmanager" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959396 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="config-reloader" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959401 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="config-reloader" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959408 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="init-config-reloader" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959414 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="init-config-reloader" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959423 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88934311-c11e-4f7c-8807-6fd6fbf4ee9e" containerName="console" Jul 24 09:03:14.959433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959428 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="88934311-c11e-4f7c-8807-6fd6fbf4ee9e" containerName="console" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959438 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="prom-label-proxy" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959443 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="prom-label-proxy" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959450 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959457 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959461 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-metric" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959467 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-metric" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959473 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-web" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959478 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-web" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959491 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" containerName="console" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959496 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" containerName="console" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959549 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="alertmanager" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959558 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e7a5c5a-6d11-4055-9c75-0bc45da3a2b1" containerName="console" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959564 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-web" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959570 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959576 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="88934311-c11e-4f7c-8807-6fd6fbf4ee9e" containerName="console" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959582 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="kube-rbac-proxy-metric" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959587 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="prom-label-proxy" Jul 24 09:03:14.959635 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.959593 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" containerName="config-reloader" Jul 24 09:03:14.965978 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.965962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:14.968500 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968476 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 09:03:14.968500 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968494 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 09:03:14.968650 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968543 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 09:03:14.968719 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968705 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2bpnl\"" Jul 24 09:03:14.968820 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968806 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 09:03:14.968879 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968842 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 09:03:14.968948 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.968931 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 09:03:14.969078 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.969062 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 09:03:14.969247 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.969232 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 09:03:14.978306 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.977354 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 09:03:14.982742 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:14.982717 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:03:15.048529 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65c32511-8c2a-4877-ba34-86c77c5054cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048529 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf944\" (UniqueName: \"kubernetes.io/projected/65c32511-8c2a-4877-ba34-86c77c5054cc-kube-api-access-vf944\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048529 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048509 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048738 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048738 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65c32511-8c2a-4877-ba34-86c77c5054cc-config-out\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048738 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65c32511-8c2a-4877-ba34-86c77c5054cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048738 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048854 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65c32511-8c2a-4877-ba34-86c77c5054cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048854 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048854 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65c32511-8c2a-4877-ba34-86c77c5054cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048854 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048966 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-web-config\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.048966 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.048890 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149705 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149705 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65c32511-8c2a-4877-ba34-86c77c5054cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-web-config\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65c32511-8c2a-4877-ba34-86c77c5054cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf944\" (UniqueName: \"kubernetes.io/projected/65c32511-8c2a-4877-ba34-86c77c5054cc-kube-api-access-vf944\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.149963 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65c32511-8c2a-4877-ba34-86c77c5054cc-config-out\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.150370 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.149983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65c32511-8c2a-4877-ba34-86c77c5054cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.150370 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.150007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.150370 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.150045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65c32511-8c2a-4877-ba34-86c77c5054cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.150847 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.150819 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65c32511-8c2a-4877-ba34-86c77c5054cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.151273 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.151244 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65c32511-8c2a-4877-ba34-86c77c5054cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153009 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.152870 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153009 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.152929 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153009 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.152987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-web-config\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153444 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.153151 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65c32511-8c2a-4877-ba34-86c77c5054cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153444 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.153165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153444 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.153376 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65c32511-8c2a-4877-ba34-86c77c5054cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153642 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.153492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65c32511-8c2a-4877-ba34-86c77c5054cc-config-out\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153717 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.153691 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.153796 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.153754 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.154878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.154861 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65c32511-8c2a-4877-ba34-86c77c5054cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.158758 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.158736 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf944\" (UniqueName: \"kubernetes.io/projected/65c32511-8c2a-4877-ba34-86c77c5054cc-kube-api-access-vf944\") pod \"alertmanager-main-0\" (UID: \"65c32511-8c2a-4877-ba34-86c77c5054cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.275454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.275419 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 09:03:15.415792 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.415763 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 09:03:15.417489 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:03:15.417464 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c32511_8c2a_4877_ba34_86c77c5054cc.slice/crio-dab8a1fc3963aa55430486e4c057f95c42ca9aaa4f68b1f83d0d8a22c57b49ba WatchSource:0}: Error finding container dab8a1fc3963aa55430486e4c057f95c42ca9aaa4f68b1f83d0d8a22c57b49ba: Status 404 returned error can't find the container with id dab8a1fc3963aa55430486e4c057f95c42ca9aaa4f68b1f83d0d8a22c57b49ba Jul 24 09:03:15.911441 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.911406 2554 generic.go:356] "Generic (PLEG): container finished" podID="65c32511-8c2a-4877-ba34-86c77c5054cc" containerID="7d7a95682575f5c64ab2c7f4c5347a4e11f79867b63630813e07bec28ec28c2d" exitCode=0 Jul 24 09:03:15.911835 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.911491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerDied","Data":"7d7a95682575f5c64ab2c7f4c5347a4e11f79867b63630813e07bec28ec28c2d"} Jul 24 09:03:15.911835 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:15.911568 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"dab8a1fc3963aa55430486e4c057f95c42ca9aaa4f68b1f83d0d8a22c57b49ba"} Jul 24 09:03:16.110481 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.110458 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e252e65-be70-482d-a857-afaa987c4d8f" path="/var/lib/kubelet/pods/8e252e65-be70-482d-a857-afaa987c4d8f/volumes" Jul 24 09:03:16.924137 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924101 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:03:16.924613 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924543 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="prometheus" containerID="cri-o://b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" gracePeriod=600 Jul 24 09:03:16.924613 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924562 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" gracePeriod=600 Jul 24 09:03:16.924613 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924571 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="thanos-sidecar" containerID="cri-o://685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" gracePeriod=600 Jul 24 09:03:16.924613 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924585 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy" containerID="cri-o://ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" gracePeriod=600 Jul 24 09:03:16.924803 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924562 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-web" containerID="cri-o://dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" gracePeriod=600 Jul 24 09:03:16.924803 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.924686 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="config-reloader" containerID="cri-o://401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" gracePeriod=600 Jul 24 09:03:16.927741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.926492 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"e0f86cf56351317cdf6e39e051f05af1315cb81d66082a61c81ed1fbc25e7f69"} Jul 24 09:03:16.927741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.926572 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"3800f8a883aa4fa212a03e685d0169692defb782fe48c797318e143d33bf898f"} Jul 24 09:03:16.927741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.926616 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"a3d8f7ae8374279ea9c8141f1abf9eea1b47f95e308bce56ccfa8ff672c937bb"} Jul 24 09:03:16.927741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.926656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"fd80deb2411946910012af57a297f62d04c2ef7bf4d024e456867b8c7b40767b"} Jul 24 09:03:16.927741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.926695 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"98b3e6b50ddf327e69b1c68af1b5e4af8ac05124b3210babe861ae5bc407236c"} Jul 24 09:03:16.927741 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.926736 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65c32511-8c2a-4877-ba34-86c77c5054cc","Type":"ContainerStarted","Data":"c0fcc784f7f41b56940ff0e74992dce172e95db040904aa5621757a47da786b6"} Jul 24 09:03:16.981866 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:16.981798 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.966601555 podStartE2EDuration="2.981774355s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.1728ms" isStatefulPod=false podCreationTimestamp="2026-07-24 09:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:03:16.980393602 +0000 UTC m=+150.205407223" watchObservedRunningTime="2026-07-24 09:03:16.981774355 +0000 UTC m=+150.206787979" Jul 24 09:03:17.176239 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.176170 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:17.269259 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269225 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269457 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269274 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-0\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269457 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269341 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-2\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269452 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-config\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269509 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-kubelet-serving-ca-bundle\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269560 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grh7d\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-kube-api-access-grh7d\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269595 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.269627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269609 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-trusted-ca-bundle\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269638 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-config-out\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269665 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-kube-rbac-proxy\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269690 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-metrics-client-certs\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269714 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269736 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-grpc-tls\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269783 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-web-config\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269810 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-db\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269834 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-serving-certs-ca-bundle\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.269873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269866 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-tls-assets\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.270272 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269885 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-1\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.270272 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269907 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-tls\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.270272 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269925 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-metrics-client-ca\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.270272 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.269944 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-thanos-prometheus-http-client-file\") pod \"58e27da3-8d42-483c-bd98-2af33e78602d\" (UID: \"58e27da3-8d42-483c-bd98-2af33e78602d\") " Jul 24 09:03:17.270272 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.270246 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.270924 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.270892 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.271135 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.270936 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.271245 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.271219 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.271592 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.271565 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.272433 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.272302 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.272689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.272577 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-config" (OuterVolumeSpecName: "config") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.272689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.272607 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.272689 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.272659 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:03:17.273634 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.273606 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-config-out" (OuterVolumeSpecName: "config-out") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 09:03:17.273726 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.273649 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:03:17.274150 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.274125 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 09:03:17.274663 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.274593 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.274763 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.274739 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.274932 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.274909 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.275165 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.275103 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.275309 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.275268 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.275646 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.275620 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-kube-api-access-grh7d" (OuterVolumeSpecName: "kube-api-access-grh7d") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "kube-api-access-grh7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:03:17.276044 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.276022 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.283852 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.283831 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-web-config" (OuterVolumeSpecName: "web-config") pod "58e27da3-8d42-483c-bd98-2af33e78602d" (UID: "58e27da3-8d42-483c-bd98-2af33e78602d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:03:17.371532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371493 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371525 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371532 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371536 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grh7d\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-kube-api-access-grh7d\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371546 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371555 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-config-out\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371563 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-kube-rbac-proxy\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371571 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-metrics-client-certs\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371579 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371589 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-grpc-tls\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371597 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-web-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371606 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-db\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371614 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371623 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58e27da3-8d42-483c-bd98-2af33e78602d-tls-assets\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371631 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371638 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371646 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-configmap-metrics-client-ca\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371655 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371663 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58e27da3-8d42-483c-bd98-2af33e78602d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.371753 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.371671 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58e27da3-8d42-483c-bd98-2af33e78602d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:03:17.933896 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933863 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" exitCode=0 Jul 24 09:03:17.933896 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933886 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" exitCode=0 Jul 24 09:03:17.933896 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933894 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" exitCode=0 Jul 24 09:03:17.933896 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933902 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" exitCode=0 Jul 24 09:03:17.933896 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933907 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" exitCode=0 Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933913 2554 generic.go:356] "Generic (PLEG): container finished" podID="58e27da3-8d42-483c-bd98-2af33e78602d" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" exitCode=0 Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933942 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.933951 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934069 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934095 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934120 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} Jul 24 09:03:17.934396 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58e27da3-8d42-483c-bd98-2af33e78602d","Type":"ContainerDied","Data":"58cb29d622b2ffaeb4e732c9f613959db8f4a6b5efc20ee44527096c10ecfd49"} Jul 24 09:03:17.934904 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.934111 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.942863 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.942830 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.949968 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.949949 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.956998 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.956979 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.959576 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.959556 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:03:17.963248 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.963227 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:03:17.965013 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.964997 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.971900 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.971879 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.979122 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.979093 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.985991 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.985970 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.986241 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.986223 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.986327 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.986258 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} err="failed to get container status \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" Jul 24 09:03:17.986400 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.986337 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.986633 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.986616 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.986674 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.986641 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} err="failed to get container status \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" Jul 24 09:03:17.986674 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.986658 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.986901 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.986880 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.986950 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.986905 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} err="failed to get container status \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" Jul 24 09:03:17.986950 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.986921 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.987125 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.987108 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.987167 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987129 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} err="failed to get container status \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" Jul 24 09:03:17.987167 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987142 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.987370 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.987351 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.987459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987371 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} err="failed to get container status \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" Jul 24 09:03:17.987459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987384 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.987617 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.987595 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.987661 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987623 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} err="failed to get container status \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" Jul 24 09:03:17.987661 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987637 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.987855 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:03:17.987839 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.987914 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987858 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} err="failed to get container status \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" Jul 24 09:03:17.987914 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.987871 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.988065 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988050 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} err="failed to get container status \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" Jul 24 09:03:17.988116 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988067 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.988243 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988226 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} err="failed to get container status \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" Jul 24 09:03:17.988243 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988242 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.988444 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988428 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} err="failed to get container status \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" Jul 24 09:03:17.988531 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988444 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.988612 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988597 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} err="failed to get container status \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" Jul 24 09:03:17.988651 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988613 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.988799 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988783 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} err="failed to get container status \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" Jul 24 09:03:17.988799 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988798 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.988979 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988951 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} err="failed to get container status \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" Jul 24 09:03:17.988979 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.988973 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.989183 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.989166 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} err="failed to get container status \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" Jul 24 09:03:17.989183 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.989182 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.989415 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.989399 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} err="failed to get container status \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" Jul 24 09:03:17.989466 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.989415 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.989699 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.989676 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} err="failed to get container status \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" Jul 24 09:03:17.989781 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.989702 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.990189 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.990162 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} err="failed to get container status \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" Jul 24 09:03:17.990189 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.990187 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.990554 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.990521 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} err="failed to get container status \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" Jul 24 09:03:17.990654 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.990556 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.990887 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.990866 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} err="failed to get container status \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" Jul 24 09:03:17.990971 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.990889 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.991124 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991102 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} err="failed to get container status \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" Jul 24 09:03:17.991174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991125 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.991384 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991365 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} err="failed to get container status \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" Jul 24 09:03:17.991451 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991385 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.991593 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991566 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} err="failed to get container status \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" Jul 24 09:03:17.991641 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991602 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.991855 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991835 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} err="failed to get container status \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" Jul 24 09:03:17.991942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.991856 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.992103 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992084 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:03:17.992148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992103 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} err="failed to get container status \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" Jul 24 09:03:17.992148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992121 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.992380 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992354 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} err="failed to get container status \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" Jul 24 09:03:17.992417 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992382 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.992452 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992419 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="init-config-reloader" Jul 24 09:03:17.992452 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992432 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="init-config-reloader" Jul 24 09:03:17.992452 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992442 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="thanos-sidecar" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992452 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="thanos-sidecar" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992468 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="prometheus" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992478 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="prometheus" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992488 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-thanos" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992496 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-thanos" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992507 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="config-reloader" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992514 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="config-reloader" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992527 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992536 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992559 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-web" Jul 24 09:03:17.992565 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992568 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-web" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992594 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} err="failed to get container status \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992619 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992627 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="prometheus" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992637 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="config-reloader" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992647 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-web" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992657 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy-thanos" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992665 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="kube-rbac-proxy" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992674 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" containerName="thanos-sidecar" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992830 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} err="failed to get container status \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.992844 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993059 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} err="failed to get container status \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" Jul 24 09:03:17.993074 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993080 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.993733 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993459 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} err="failed to get container status \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" Jul 24 09:03:17.993733 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993483 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.993823 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993730 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} err="failed to get container status \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" Jul 24 09:03:17.993823 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993746 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.994006 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.993987 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} err="failed to get container status \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" Jul 24 09:03:17.994079 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994007 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.994276 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994254 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} err="failed to get container status \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" Jul 24 09:03:17.994393 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994275 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.994594 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994569 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} err="failed to get container status \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" Jul 24 09:03:17.994594 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994592 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.994892 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994859 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} err="failed to get container status \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" Jul 24 09:03:17.994980 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.994900 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.995170 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995151 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} err="failed to get container status \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" Jul 24 09:03:17.995250 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995172 2554 scope.go:117] "RemoveContainer" containerID="8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0" Jul 24 09:03:17.995447 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995429 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0"} err="failed to get container status \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": rpc error: code = NotFound desc = could not find container \"8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0\": container with ID starting with 8c1add9f668dea0dac4957321f5a97094d5fc94cb2276d185df3f7dee58bbbd0 not found: ID does not exist" Jul 24 09:03:17.995447 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995446 2554 scope.go:117] "RemoveContainer" containerID="ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c" Jul 24 09:03:17.995672 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995658 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c"} err="failed to get container status \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": rpc error: code = NotFound desc = could not find container \"ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c\": container with ID starting with ef9665e9ca71e84da37f763c4c127738ab9cc4dc1037f1f8b69ceadfc44ece9c not found: ID does not exist" Jul 24 09:03:17.995722 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995672 2554 scope.go:117] "RemoveContainer" containerID="dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b" Jul 24 09:03:17.995885 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995865 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b"} err="failed to get container status \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": rpc error: code = NotFound desc = could not find container \"dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b\": container with ID starting with dba20855225f61a30ef5518316c82a51df8fd0507e15a034376197e5d81e9a1b not found: ID does not exist" Jul 24 09:03:17.995885 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.995884 2554 scope.go:117] "RemoveContainer" containerID="685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4" Jul 24 09:03:17.996099 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996083 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4"} err="failed to get container status \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": rpc error: code = NotFound desc = could not find container \"685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4\": container with ID starting with 685caa35d1ae429a3d6df1942fb5ccfbfc6ebb2c315e17f157c41c0d96b202f4 not found: ID does not exist" Jul 24 09:03:17.996099 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996099 2554 scope.go:117] "RemoveContainer" containerID="401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f" Jul 24 09:03:17.996315 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996265 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f"} err="failed to get container status \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": rpc error: code = NotFound desc = could not find container \"401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f\": container with ID starting with 401ff43d57a62b67aebcc6b66216dc43f2a299e8ac1d2cacdfb701912bc78f2f not found: ID does not exist" Jul 24 09:03:17.996315 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996309 2554 scope.go:117] "RemoveContainer" containerID="b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2" Jul 24 09:03:17.996541 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996524 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2"} err="failed to get container status \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": rpc error: code = NotFound desc = could not find container \"b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2\": container with ID starting with b77f024e49f434d43707c30691161d4f34dbd6ca9b5b2e70ae0b34965669e6b2 not found: ID does not exist" Jul 24 09:03:17.996541 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996541 2554 scope.go:117] "RemoveContainer" containerID="89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c" Jul 24 09:03:17.996740 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.996724 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c"} err="failed to get container status \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": rpc error: code = NotFound desc = could not find container \"89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c\": container with ID starting with 89e1798df04d49d4ec1871071fdba494a5803fe026903065c3fa936472d6012c not found: ID does not exist" Jul 24 09:03:17.998358 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:17.998341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.000919 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.000898 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 09:03:18.000919 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.000912 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 09:03:18.000919 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.000925 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0ba5ui6dimgr\"" Jul 24 09:03:18.001148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.000925 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 09:03:18.001148 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.000968 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 09:03:18.001253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.001221 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-blzhm\"" Jul 24 09:03:18.001356 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.001328 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 09:03:18.001556 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.001543 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 09:03:18.001948 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.001926 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 09:03:18.002026 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.001959 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 09:03:18.002026 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.001983 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 09:03:18.002205 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.002189 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 09:03:18.002276 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.002233 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 09:03:18.002276 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.002244 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 09:03:18.004361 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.004342 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 09:03:18.006999 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.006969 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 09:03:18.012520 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.012499 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:03:18.077526 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077434 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9faa4103-2f1c-447e-925a-37cdc5558666-config-out\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077526 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077466 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077526 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077526 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077634 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077653 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077724 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077821 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.077878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078149 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.077996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x8wf\" (UniqueName: \"kubernetes.io/projected/9faa4103-2f1c-447e-925a-37cdc5558666-kube-api-access-6x8wf\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078149 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-web-config\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078149 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078087 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9faa4103-2f1c-447e-925a-37cdc5558666-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078149 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078122 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-config\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078346 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078346 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078437 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078437 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078406 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078437 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.078607 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.078458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.114925 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.111700 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e27da3-8d42-483c-bd98-2af33e78602d" path="/var/lib/kubelet/pods/58e27da3-8d42-483c-bd98-2af33e78602d/volumes" Jul 24 09:03:18.179552 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179524 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179581 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179598 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x8wf\" (UniqueName: \"kubernetes.io/projected/9faa4103-2f1c-447e-925a-37cdc5558666-kube-api-access-6x8wf\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179617 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-web-config\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9faa4103-2f1c-447e-925a-37cdc5558666-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-config\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.179696 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179871 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9faa4103-2f1c-447e-925a-37cdc5558666-config-out\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.179985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180039 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.180009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180630 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.180053 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180630 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.180252 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180630 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.180273 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.180784 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.180758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.181144 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.181116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.181339 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.181252 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.181898 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.181873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.182617 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.182485 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.183977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.182879 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-web-config\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.183977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.182893 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.183977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.182926 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.183977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.182944 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9faa4103-2f1c-447e-925a-37cdc5558666-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.183977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.182962 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.183977 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.183772 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.184806 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.184436 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-config\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.185210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.185144 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9faa4103-2f1c-447e-925a-37cdc5558666-config-out\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.185360 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.185342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.185622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.185596 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.185793 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.185774 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9faa4103-2f1c-447e-925a-37cdc5558666-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.186341 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.186320 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9faa4103-2f1c-447e-925a-37cdc5558666-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.188357 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.188340 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x8wf\" (UniqueName: \"kubernetes.io/projected/9faa4103-2f1c-447e-925a-37cdc5558666-kube-api-access-6x8wf\") pod \"prometheus-k8s-0\" (UID: \"9faa4103-2f1c-447e-925a-37cdc5558666\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.309657 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.309619 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:03:18.446258 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.446232 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 09:03:18.448727 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:03:18.448693 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9faa4103_2f1c_447e_925a_37cdc5558666.slice/crio-9cb2ce143c316132120a0c11656b5df746eb99f6c3b345eca9adbf143620a340 WatchSource:0}: Error finding container 9cb2ce143c316132120a0c11656b5df746eb99f6c3b345eca9adbf143620a340: Status 404 returned error can't find the container with id 9cb2ce143c316132120a0c11656b5df746eb99f6c3b345eca9adbf143620a340 Jul 24 09:03:18.938942 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.938903 2554 generic.go:356] "Generic (PLEG): container finished" podID="9faa4103-2f1c-447e-925a-37cdc5558666" containerID="d1165bcee142bb8f713a63dfd00338eaeff8709bffcc994070920b39d41bd148" exitCode=0 Jul 24 09:03:18.939368 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.938992 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerDied","Data":"d1165bcee142bb8f713a63dfd00338eaeff8709bffcc994070920b39d41bd148"} Jul 24 09:03:18.939368 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:18.939085 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"9cb2ce143c316132120a0c11656b5df746eb99f6c3b345eca9adbf143620a340"} Jul 24 09:03:19.947849 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.947814 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"6de28824176f6e9e3c66640cf47b408a968f052fea87a7836a85dfe489f3f46a"} Jul 24 09:03:19.948235 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.947877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"7fb1c4e6155dca1dbf8ad6f463637e3fe5772f5a877fabe3a8d13db5169c1a68"} Jul 24 09:03:19.948235 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.947903 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"ec68f615543375f9f666ff8d0954c3e9324ea1ebeac58ba97eeafaadc87bc1d1"} Jul 24 09:03:19.948235 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.947933 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"2348d0b28c1dc181b5e77cc090b2be43ab685ba908485ace6a502e954d5a44f7"} Jul 24 09:03:19.948235 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.947957 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"5d576dd98b9449d87704b60cbe117b08f5e96890d37042d84c3e989105ddc943"} Jul 24 09:03:19.948235 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.947980 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9faa4103-2f1c-447e-925a-37cdc5558666","Type":"ContainerStarted","Data":"3d73f6d84cd7d3f307128ddd32d67e334e589de4eeee197d62744c54703de1bb"} Jul 24 09:03:19.977601 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:19.977543 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9593200360000003 podStartE2EDuration="2.977522056s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.20202ms" isStatefulPod=false podCreationTimestamp="2026-07-24 09:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:03:19.976335498 +0000 UTC m=+153.201349119" watchObservedRunningTime="2026-07-24 09:03:19.977522056 +0000 UTC m=+153.202535701" Jul 24 09:03:23.309988 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:03:23.309950 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:04:18.310542 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:04:18.310494 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:04:18.326084 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:04:18.326056 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:04:19.200723 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:04:19.200696 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 09:05:12.327107 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.327023 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ktw48"] Jul 24 09:05:12.330015 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.330000 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.332627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.332602 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 09:05:12.332627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.332621 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 09:05:12.333432 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.333413 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tbxfs\"" Jul 24 09:05:12.339931 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.339911 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ktw48"] Jul 24 09:05:12.367031 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.367003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ktw48\" (UID: \"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.367174 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.367038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5qh4\" (UniqueName: \"kubernetes.io/projected/b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7-kube-api-access-n5qh4\") pod \"cert-manager-cainjector-559cdd8c87-ktw48\" (UID: \"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.468028 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.467995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ktw48\" (UID: \"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.468205 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.468050 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5qh4\" (UniqueName: \"kubernetes.io/projected/b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7-kube-api-access-n5qh4\") pod \"cert-manager-cainjector-559cdd8c87-ktw48\" (UID: \"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.476526 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.476502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ktw48\" (UID: \"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.476639 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.476503 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5qh4\" (UniqueName: \"kubernetes.io/projected/b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7-kube-api-access-n5qh4\") pod \"cert-manager-cainjector-559cdd8c87-ktw48\" (UID: \"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.648226 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.648150 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" Jul 24 09:05:12.790656 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:12.790631 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ktw48"] Jul 24 09:05:12.793127 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:05:12.793089 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9efd61c_a6f0_4ea3_aedd_9975a5ac36e7.slice/crio-093ab4465b791cdeb3c710974db250a8af76c201a35a82a077d599b9c61a5e7e WatchSource:0}: Error finding container 093ab4465b791cdeb3c710974db250a8af76c201a35a82a077d599b9c61a5e7e: Status 404 returned error can't find the container with id 093ab4465b791cdeb3c710974db250a8af76c201a35a82a077d599b9c61a5e7e Jul 24 09:05:13.400769 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:13.400722 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" event={"ID":"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7","Type":"ContainerStarted","Data":"093ab4465b791cdeb3c710974db250a8af76c201a35a82a077d599b9c61a5e7e"} Jul 24 09:05:16.416127 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:16.416093 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" event={"ID":"b9efd61c-a6f0-4ea3-aedd-9975a5ac36e7","Type":"ContainerStarted","Data":"214005120af3df78d1bc43b882416036ed9b6cfc092440e99fb7f87ac8c9e19d"} Jul 24 09:05:16.431210 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:16.431163 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ktw48" podStartSLOduration=1.557837648 podStartE2EDuration="4.431145002s" totalImagesPullingTime="2.873307354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:05:16.429669377 +0000 UTC m=+269.654683001" watchObservedRunningTime="2026-07-24 09:05:16.431145002 +0000 UTC m=+269.656158625" Jul 24 09:05:29.937810 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:29.937772 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kdz8b"] Jul 24 09:05:29.943704 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:29.943525 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:29.946360 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:29.946329 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wn6h4\"" Jul 24 09:05:29.951419 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:29.951394 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kdz8b"] Jul 24 09:05:30.018950 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.018906 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa3a8293-48eb-44f0-9cc8-5c05ae651c85-bound-sa-token\") pod \"cert-manager-55b4d954d5-kdz8b\" (UID: \"aa3a8293-48eb-44f0-9cc8-5c05ae651c85\") " pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.019136 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.018980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5x72\" (UniqueName: \"kubernetes.io/projected/aa3a8293-48eb-44f0-9cc8-5c05ae651c85-kube-api-access-m5x72\") pod \"cert-manager-55b4d954d5-kdz8b\" (UID: \"aa3a8293-48eb-44f0-9cc8-5c05ae651c85\") " pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.120413 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.120374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa3a8293-48eb-44f0-9cc8-5c05ae651c85-bound-sa-token\") pod \"cert-manager-55b4d954d5-kdz8b\" (UID: \"aa3a8293-48eb-44f0-9cc8-5c05ae651c85\") " pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.120574 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.120462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5x72\" (UniqueName: \"kubernetes.io/projected/aa3a8293-48eb-44f0-9cc8-5c05ae651c85-kube-api-access-m5x72\") pod \"cert-manager-55b4d954d5-kdz8b\" (UID: \"aa3a8293-48eb-44f0-9cc8-5c05ae651c85\") " pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.128671 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.128646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa3a8293-48eb-44f0-9cc8-5c05ae651c85-bound-sa-token\") pod \"cert-manager-55b4d954d5-kdz8b\" (UID: \"aa3a8293-48eb-44f0-9cc8-5c05ae651c85\") " pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.128827 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.128809 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5x72\" (UniqueName: \"kubernetes.io/projected/aa3a8293-48eb-44f0-9cc8-5c05ae651c85-kube-api-access-m5x72\") pod \"cert-manager-55b4d954d5-kdz8b\" (UID: \"aa3a8293-48eb-44f0-9cc8-5c05ae651c85\") " pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.253916 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.253826 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kdz8b" Jul 24 09:05:30.383965 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.383939 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kdz8b"] Jul 24 09:05:30.386247 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:05:30.386215 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa3a8293_48eb_44f0_9cc8_5c05ae651c85.slice/crio-ad632c7ce5fd7f9a73271beb268ba7d24dc04dc5756c4b46feec109b7c26b239 WatchSource:0}: Error finding container ad632c7ce5fd7f9a73271beb268ba7d24dc04dc5756c4b46feec109b7c26b239: Status 404 returned error can't find the container with id ad632c7ce5fd7f9a73271beb268ba7d24dc04dc5756c4b46feec109b7c26b239 Jul 24 09:05:30.471536 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.471495 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kdz8b" event={"ID":"aa3a8293-48eb-44f0-9cc8-5c05ae651c85","Type":"ContainerStarted","Data":"603792ec433aff0d66756de9b0b44504d5979bf0856eb6672a6edf87899f7124"} Jul 24 09:05:30.471728 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.471546 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kdz8b" event={"ID":"aa3a8293-48eb-44f0-9cc8-5c05ae651c85","Type":"ContainerStarted","Data":"ad632c7ce5fd7f9a73271beb268ba7d24dc04dc5756c4b46feec109b7c26b239"} Jul 24 09:05:30.488223 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:30.488172 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kdz8b" podStartSLOduration=1.488155668 podStartE2EDuration="1.488155668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:05:30.486868234 +0000 UTC m=+283.711881851" watchObservedRunningTime="2026-07-24 09:05:30.488155668 +0000 UTC m=+283.713169289" Jul 24 09:05:47.946905 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:05:47.946873 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 09:07:31.193838 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.193796 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7"] Jul 24 09:07:31.197420 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.197395 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.200418 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.200392 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 09:07:31.200537 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.200467 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 24 09:07:31.201480 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.201461 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 24 09:07:31.201598 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.201502 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 09:07:31.201598 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.201504 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-k5j2r\"" Jul 24 09:07:31.217833 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.217812 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7"] Jul 24 09:07:31.284318 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.284251 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.284498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.284366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.284498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.284390 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spldt\" (UniqueName: \"kubernetes.io/projected/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kube-api-access-spldt\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.385027 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.384992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.385214 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.385040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spldt\" (UniqueName: \"kubernetes.io/projected/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kube-api-access-spldt\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.385214 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.385117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.385790 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.385765 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.387948 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.387918 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.394745 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.394718 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spldt\" (UniqueName: \"kubernetes.io/projected/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kube-api-access-spldt\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.506191 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.506102 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:31.639863 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.639713 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7"] Jul 24 09:07:31.642662 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:07:31.642624 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b30a094_0c8c_44aa_99b0_b35f96dc49ac.slice/crio-c3a600091f131d6e4e53d985a9efe2dce98ce901559dc91d4754050cfa592127 WatchSource:0}: Error finding container c3a600091f131d6e4e53d985a9efe2dce98ce901559dc91d4754050cfa592127: Status 404 returned error can't find the container with id c3a600091f131d6e4e53d985a9efe2dce98ce901559dc91d4754050cfa592127 Jul 24 09:07:31.644622 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.644603 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 09:07:31.963779 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:31.963739 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" event={"ID":"6b30a094-0c8c-44aa-99b0-b35f96dc49ac","Type":"ContainerStarted","Data":"c3a600091f131d6e4e53d985a9efe2dce98ce901559dc91d4754050cfa592127"} Jul 24 09:07:34.979021 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:34.978979 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" event={"ID":"6b30a094-0c8c-44aa-99b0-b35f96dc49ac","Type":"ContainerStarted","Data":"a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199"} Jul 24 09:07:34.979509 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:34.979046 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:07:34.997670 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:34.997622 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" podStartSLOduration=1.387541794 podStartE2EDuration="3.99760628s" totalImagesPullingTime="2.610064486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:07:34.99557007 +0000 UTC m=+408.220583714" watchObservedRunningTime="2026-07-24 09:07:34.99760628 +0000 UTC m=+408.222619924" Jul 24 09:07:50.988789 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:07:50.988758 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:09:04.456256 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.456214 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7"] Jul 24 09:09:04.456733 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.456424 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" podUID="6b30a094-0c8c-44aa-99b0-b35f96dc49ac" containerName="manager" containerID="cri-o://a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199" gracePeriod=30 Jul 24 09:09:04.718498 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.718440 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:09:04.795201 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.795165 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-cert\") pod \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " Jul 24 09:09:04.795201 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.795209 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kubeflow-trainer-config\") pod \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " Jul 24 09:09:04.795490 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.795276 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spldt\" (UniqueName: \"kubernetes.io/projected/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kube-api-access-spldt\") pod \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\" (UID: \"6b30a094-0c8c-44aa-99b0-b35f96dc49ac\") " Jul 24 09:09:04.797427 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.797394 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-cert" (OuterVolumeSpecName: "cert") pod "6b30a094-0c8c-44aa-99b0-b35f96dc49ac" (UID: "6b30a094-0c8c-44aa-99b0-b35f96dc49ac"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 09:09:04.797539 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.797439 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kube-api-access-spldt" (OuterVolumeSpecName: "kube-api-access-spldt") pod "6b30a094-0c8c-44aa-99b0-b35f96dc49ac" (UID: "6b30a094-0c8c-44aa-99b0-b35f96dc49ac"). InnerVolumeSpecName "kube-api-access-spldt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:09:04.799729 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.799705 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "6b30a094-0c8c-44aa-99b0-b35f96dc49ac" (UID: "6b30a094-0c8c-44aa-99b0-b35f96dc49ac"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 09:09:04.896152 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.896117 2554 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-cert\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:09:04.896152 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.896146 2554 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kubeflow-trainer-config\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:09:04.896152 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:04.896156 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spldt\" (UniqueName: \"kubernetes.io/projected/6b30a094-0c8c-44aa-99b0-b35f96dc49ac-kube-api-access-spldt\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:09:05.344100 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.344067 2554 generic.go:356] "Generic (PLEG): container finished" podID="6b30a094-0c8c-44aa-99b0-b35f96dc49ac" containerID="a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199" exitCode=0 Jul 24 09:09:05.344274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.344108 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" Jul 24 09:09:05.344274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.344111 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" event={"ID":"6b30a094-0c8c-44aa-99b0-b35f96dc49ac","Type":"ContainerDied","Data":"a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199"} Jul 24 09:09:05.344274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.344211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7" event={"ID":"6b30a094-0c8c-44aa-99b0-b35f96dc49ac","Type":"ContainerDied","Data":"c3a600091f131d6e4e53d985a9efe2dce98ce901559dc91d4754050cfa592127"} Jul 24 09:09:05.344274 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.344234 2554 scope.go:117] "RemoveContainer" containerID="a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199" Jul 24 09:09:05.353014 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.352994 2554 scope.go:117] "RemoveContainer" containerID="a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199" Jul 24 09:09:05.353336 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:09:05.353316 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199\": container with ID starting with a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199 not found: ID does not exist" containerID="a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199" Jul 24 09:09:05.353409 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.353349 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199"} err="failed to get container status \"a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199\": rpc error: code = NotFound desc = could not find container \"a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199\": container with ID starting with a45e00473b5b811b922f760eff46ea9f7e2b70f9d3900fccd58bb2f721b48199 not found: ID does not exist" Jul 24 09:09:05.371427 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.371398 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7"] Jul 24 09:09:05.376163 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.376138 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bmjw7"] Jul 24 09:09:05.383172 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.383147 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6nnlt/must-gather-js2zm"] Jul 24 09:09:05.383513 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.383500 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b30a094-0c8c-44aa-99b0-b35f96dc49ac" containerName="manager" Jul 24 09:09:05.383563 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.383515 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b30a094-0c8c-44aa-99b0-b35f96dc49ac" containerName="manager" Jul 24 09:09:05.386085 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.384071 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b30a094-0c8c-44aa-99b0-b35f96dc49ac" containerName="manager" Jul 24 09:09:05.391686 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.391660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.393948 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.393925 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6nnlt/must-gather-js2zm"] Jul 24 09:09:05.394253 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.394236 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6nnlt\"/\"openshift-service-ca.crt\"" Jul 24 09:09:05.394340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.394236 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6nnlt\"/\"default-dockercfg-ksdcv\"" Jul 24 09:09:05.394340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.394320 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6nnlt\"/\"kube-root-ca.crt\"" Jul 24 09:09:05.399037 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.398846 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66m9p\" (UniqueName: \"kubernetes.io/projected/bf84fb3e-3988-49e8-bf82-a6867c8a4326-kube-api-access-66m9p\") pod \"must-gather-js2zm\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.399037 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.398886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf84fb3e-3988-49e8-bf82-a6867c8a4326-must-gather-output\") pod \"must-gather-js2zm\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.499553 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.499517 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66m9p\" (UniqueName: \"kubernetes.io/projected/bf84fb3e-3988-49e8-bf82-a6867c8a4326-kube-api-access-66m9p\") pod \"must-gather-js2zm\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.499553 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.499557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf84fb3e-3988-49e8-bf82-a6867c8a4326-must-gather-output\") pod \"must-gather-js2zm\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.500005 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.499894 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf84fb3e-3988-49e8-bf82-a6867c8a4326-must-gather-output\") pod \"must-gather-js2zm\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.507317 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.507274 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66m9p\" (UniqueName: \"kubernetes.io/projected/bf84fb3e-3988-49e8-bf82-a6867c8a4326-kube-api-access-66m9p\") pod \"must-gather-js2zm\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.702004 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.701913 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:09:05.829459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:05.829300 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6nnlt/must-gather-js2zm"] Jul 24 09:09:05.831862 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:09:05.831837 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf84fb3e_3988_49e8_bf82_a6867c8a4326.slice/crio-9ed80d14e643d415001e0cea2aa4922fa9c2caa0f3b85a825d3507a881fd2c8a WatchSource:0}: Error finding container 9ed80d14e643d415001e0cea2aa4922fa9c2caa0f3b85a825d3507a881fd2c8a: Status 404 returned error can't find the container with id 9ed80d14e643d415001e0cea2aa4922fa9c2caa0f3b85a825d3507a881fd2c8a Jul 24 09:09:06.110023 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:06.109989 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b30a094-0c8c-44aa-99b0-b35f96dc49ac" path="/var/lib/kubelet/pods/6b30a094-0c8c-44aa-99b0-b35f96dc49ac/volumes" Jul 24 09:09:06.349904 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:06.349860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nnlt/must-gather-js2zm" event={"ID":"bf84fb3e-3988-49e8-bf82-a6867c8a4326","Type":"ContainerStarted","Data":"9ed80d14e643d415001e0cea2aa4922fa9c2caa0f3b85a825d3507a881fd2c8a"} Jul 24 09:09:12.381913 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:12.381833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nnlt/must-gather-js2zm" event={"ID":"bf84fb3e-3988-49e8-bf82-a6867c8a4326","Type":"ContainerStarted","Data":"af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223"} Jul 24 09:09:12.381913 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:12.381874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nnlt/must-gather-js2zm" event={"ID":"bf84fb3e-3988-49e8-bf82-a6867c8a4326","Type":"ContainerStarted","Data":"5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108"} Jul 24 09:09:12.397360 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:12.397307 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6nnlt/must-gather-js2zm" podStartSLOduration=1.450533035 podStartE2EDuration="7.397274173s" totalImagesPullingTime="5.946741138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 09:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:09:12.396859303 +0000 UTC m=+505.621872922" watchObservedRunningTime="2026-07-24 09:09:12.397274173 +0000 UTC m=+505.622287793" Jul 24 09:09:57.598410 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:57.598367 2554 generic.go:356] "Generic (PLEG): container finished" podID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerID="5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108" exitCode=0 Jul 24 09:09:57.598410 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:57.598419 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nnlt/must-gather-js2zm" event={"ID":"bf84fb3e-3988-49e8-bf82-a6867c8a4326","Type":"ContainerDied","Data":"5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108"} Jul 24 09:09:57.598948 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:57.598728 2554 scope.go:117] "RemoveContainer" containerID="5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108" Jul 24 09:09:58.196859 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:09:58.196831 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6nnlt_must-gather-js2zm_bf84fb3e-3988-49e8-bf82-a6867c8a4326/gather/0.log" Jul 24 09:10:01.377672 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:01.377644 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gct5x_15c4edb8-bba6-4d94-b6a0-9ecf3a93e53a/global-pull-secret-syncer/0.log" Jul 24 09:10:01.492468 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:01.492441 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kfrml_c06a0dde-8ef7-4bb1-9c33-8775bdfd2b9b/konnectivity-agent/0.log" Jul 24 09:10:01.570404 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:01.570369 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-101.ec2.internal_ed436c2c06eb421aaa817d4e8a2cf780/haproxy/0.log" Jul 24 09:10:03.582715 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.582679 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6nnlt/must-gather-js2zm"] Jul 24 09:10:03.583243 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.582876 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-6nnlt/must-gather-js2zm" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="copy" containerID="cri-o://af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223" gracePeriod=2 Jul 24 09:10:03.587443 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.586908 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6nnlt/must-gather-js2zm"] Jul 24 09:10:03.829543 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.829520 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6nnlt_must-gather-js2zm_bf84fb3e-3988-49e8-bf82-a6867c8a4326/copy/0.log" Jul 24 09:10:03.832175 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.832157 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:10:03.834501 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:10:03.834453 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-js2zm\" is forbidden: User \"system:node:ip-10-0-135-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6nnlt\": no relationship found between node 'ip-10-0-135-101.ec2.internal' and this object" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:10:03.952550 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.952510 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66m9p\" (UniqueName: \"kubernetes.io/projected/bf84fb3e-3988-49e8-bf82-a6867c8a4326-kube-api-access-66m9p\") pod \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " Jul 24 09:10:03.952745 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.952575 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf84fb3e-3988-49e8-bf82-a6867c8a4326-must-gather-output\") pod \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\" (UID: \"bf84fb3e-3988-49e8-bf82-a6867c8a4326\") " Jul 24 09:10:03.953685 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.953658 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf84fb3e-3988-49e8-bf82-a6867c8a4326-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bf84fb3e-3988-49e8-bf82-a6867c8a4326" (UID: "bf84fb3e-3988-49e8-bf82-a6867c8a4326"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 09:10:03.954684 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:03.954658 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf84fb3e-3988-49e8-bf82-a6867c8a4326-kube-api-access-66m9p" (OuterVolumeSpecName: "kube-api-access-66m9p") pod "bf84fb3e-3988-49e8-bf82-a6867c8a4326" (UID: "bf84fb3e-3988-49e8-bf82-a6867c8a4326"). InnerVolumeSpecName "kube-api-access-66m9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 09:10:04.053740 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.053700 2554 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf84fb3e-3988-49e8-bf82-a6867c8a4326-must-gather-output\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:10:04.053740 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.053730 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66m9p\" (UniqueName: \"kubernetes.io/projected/bf84fb3e-3988-49e8-bf82-a6867c8a4326-kube-api-access-66m9p\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\"" Jul 24 09:10:04.110209 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.110129 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" path="/var/lib/kubelet/pods/bf84fb3e-3988-49e8-bf82-a6867c8a4326/volumes" Jul 24 09:10:04.628212 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.628183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6nnlt_must-gather-js2zm_bf84fb3e-3988-49e8-bf82-a6867c8a4326/copy/0.log" Jul 24 09:10:04.628631 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.628536 2554 generic.go:356] "Generic (PLEG): container finished" podID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerID="af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223" exitCode=143 Jul 24 09:10:04.628631 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.628579 2554 scope.go:117] "RemoveContainer" containerID="af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223" Jul 24 09:10:04.628631 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.628585 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nnlt/must-gather-js2zm" Jul 24 09:10:04.636015 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.635997 2554 scope.go:117] "RemoveContainer" containerID="5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108" Jul 24 09:10:04.647626 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.647607 2554 scope.go:117] "RemoveContainer" containerID="af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223" Jul 24 09:10:04.647900 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:10:04.647877 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223\": container with ID starting with af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223 not found: ID does not exist" containerID="af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223" Jul 24 09:10:04.647938 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.647908 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223"} err="failed to get container status \"af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223\": rpc error: code = NotFound desc = could not find container \"af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223\": container with ID starting with af56f19cb8645828871460b3a987140237cc7ca2425c834678e4404ed34bf223 not found: ID does not exist" Jul 24 09:10:04.647938 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.647926 2554 scope.go:117] "RemoveContainer" containerID="5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108" Jul 24 09:10:04.648152 ip-10-0-135-101 kubenswrapper[2554]: E0724 09:10:04.648134 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108\": container with ID starting with 5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108 not found: ID does not exist" containerID="5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108" Jul 24 09:10:04.648186 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:04.648159 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108"} err="failed to get container status \"5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108\": rpc error: code = NotFound desc = could not find container \"5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108\": container with ID starting with 5088c2a32a850364c9719bd7959ec11dc53b0b55639175e75f75ad47b111f108 not found: ID does not exist" Jul 24 09:10:05.634221 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.634182 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/alertmanager/0.log" Jul 24 09:10:05.662203 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.662179 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/config-reloader/0.log" Jul 24 09:10:05.696255 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.696193 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/kube-rbac-proxy-web/0.log" Jul 24 09:10:05.750198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.750167 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/kube-rbac-proxy/0.log" Jul 24 09:10:05.791581 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.791553 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/kube-rbac-proxy-metric/0.log" Jul 24 09:10:05.816691 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.816669 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/prom-label-proxy/0.log" Jul 24 09:10:05.843492 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.843470 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65c32511-8c2a-4877-ba34-86c77c5054cc/init-config-reloader/0.log" Jul 24 09:10:05.975041 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:05.974945 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-27jh8_bc2e71e9-8140-45b4-a84e-8c761ce72bb1/kube-state-metrics/0.log" Jul 24 09:10:06.050564 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.050532 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-27jh8_bc2e71e9-8140-45b4-a84e-8c761ce72bb1/kube-rbac-proxy-main/0.log" Jul 24 09:10:06.095867 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.095845 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-27jh8_bc2e71e9-8140-45b4-a84e-8c761ce72bb1/kube-rbac-proxy-self/0.log" Jul 24 09:10:06.128695 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.128667 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-647d6d75d8-rvk72_d17ab182-40be-4928-8913-3ad5adccff58/metrics-server/0.log" Jul 24 09:10:06.158804 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.158772 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-gxx7l_ecec7a3e-c63c-4109-91ec-cb2e672192c1/monitoring-plugin/0.log" Jul 24 09:10:06.384748 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.384725 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvw6f_0c58b28f-4a28-4923-9b5c-1089d4abdf14/node-exporter/0.log" Jul 24 09:10:06.409553 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.409522 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvw6f_0c58b28f-4a28-4923-9b5c-1089d4abdf14/kube-rbac-proxy/0.log" Jul 24 09:10:06.433321 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.433270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvw6f_0c58b28f-4a28-4923-9b5c-1089d4abdf14/init-textfile/0.log" Jul 24 09:10:06.465588 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.465558 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7qskf_d942d7f9-dd5b-4ec9-8044-d18261849ec5/kube-rbac-proxy-main/0.log" Jul 24 09:10:06.494037 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.494007 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7qskf_d942d7f9-dd5b-4ec9-8044-d18261849ec5/kube-rbac-proxy-self/0.log" Jul 24 09:10:06.525299 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.525267 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7qskf_d942d7f9-dd5b-4ec9-8044-d18261849ec5/openshift-state-metrics/0.log" Jul 24 09:10:06.603427 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.603340 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/prometheus/0.log" Jul 24 09:10:06.638149 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.638119 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/config-reloader/0.log" Jul 24 09:10:06.670334 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.670309 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/thanos-sidecar/0.log" Jul 24 09:10:06.707590 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.707569 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/kube-rbac-proxy-web/0.log" Jul 24 09:10:06.734506 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.734484 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/kube-rbac-proxy/0.log" Jul 24 09:10:06.773108 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.773079 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/kube-rbac-proxy-thanos/0.log" Jul 24 09:10:06.805878 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.805853 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9faa4103-2f1c-447e-925a-37cdc5558666/init-config-reloader/0.log" Jul 24 09:10:06.846167 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.846140 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-lw45r_88bc74ca-9911-410d-b2f9-24d4c42d9d81/prometheus-operator/0.log" Jul 24 09:10:06.872051 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.871986 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-lw45r_88bc74ca-9911-410d-b2f9-24d4c42d9d81/kube-rbac-proxy/0.log" Jul 24 09:10:06.938703 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.938677 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74bdf4bb55-ch9lk_00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4/telemeter-client/0.log" Jul 24 09:10:06.968189 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.968166 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74bdf4bb55-ch9lk_00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4/reload/0.log" Jul 24 09:10:06.993198 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:06.993169 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74bdf4bb55-ch9lk_00ec8f3f-a26d-4bee-b9fb-93726b2fbeb4/kube-rbac-proxy/0.log" Jul 24 09:10:07.031524 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:07.031494 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864cf9f4d8-tdbsd_b38f2be3-f4b8-4795-a45c-2871daac496d/thanos-query/0.log" Jul 24 09:10:07.058933 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:07.058894 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864cf9f4d8-tdbsd_b38f2be3-f4b8-4795-a45c-2871daac496d/kube-rbac-proxy-web/0.log" Jul 24 09:10:07.088847 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:07.088821 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864cf9f4d8-tdbsd_b38f2be3-f4b8-4795-a45c-2871daac496d/kube-rbac-proxy/0.log" Jul 24 09:10:07.113583 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:07.113558 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864cf9f4d8-tdbsd_b38f2be3-f4b8-4795-a45c-2871daac496d/prom-label-proxy/0.log" Jul 24 09:10:07.145570 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:07.145510 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864cf9f4d8-tdbsd_b38f2be3-f4b8-4795-a45c-2871daac496d/kube-rbac-proxy-rules/0.log" Jul 24 09:10:07.178653 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:07.178627 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864cf9f4d8-tdbsd_b38f2be3-f4b8-4795-a45c-2871daac496d/kube-rbac-proxy-metrics/0.log" Jul 24 09:10:08.637819 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.637784 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp"] Jul 24 09:10:08.638324 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.638302 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="copy" Jul 24 09:10:08.638324 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.638322 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="copy" Jul 24 09:10:08.638454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.638339 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="gather" Jul 24 09:10:08.638454 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.638347 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="gather" Jul 24 09:10:08.638558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.638469 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="copy" Jul 24 09:10:08.638558 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.638488 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf84fb3e-3988-49e8-bf82-a6867c8a4326" containerName="gather" Jul 24 09:10:08.643559 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.643537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.646231 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.646214 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rt75z\"/\"default-dockercfg-5jhxc\"" Jul 24 09:10:08.646482 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.646464 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rt75z\"/\"openshift-service-ca.crt\"" Jul 24 09:10:08.647215 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.647194 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rt75z\"/\"kube-root-ca.crt\"" Jul 24 09:10:08.650389 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.650355 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp"] Jul 24 09:10:08.695241 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.695206 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-lib-modules\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.695241 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.695242 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-podres\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.695500 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.695334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-proc\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.695500 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.695387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-sys\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.695500 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.695406 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8c9n\" (UniqueName: \"kubernetes.io/projected/5e7a0277-df7e-4100-82e8-2d66326fccc2-kube-api-access-j8c9n\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796461 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-sys\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796461 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8c9n\" (UniqueName: \"kubernetes.io/projected/5e7a0277-df7e-4100-82e8-2d66326fccc2-kube-api-access-j8c9n\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796501 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-lib-modules\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-podres\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-sys\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-proc\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796666 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-proc\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-podres\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.796716 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.796680 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e7a0277-df7e-4100-82e8-2d66326fccc2-lib-modules\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.805054 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.805021 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8c9n\" (UniqueName: \"kubernetes.io/projected/5e7a0277-df7e-4100-82e8-2d66326fccc2-kube-api-access-j8c9n\") pod \"perf-node-gather-daemonset-g5wzp\" (UID: \"5e7a0277-df7e-4100-82e8-2d66326fccc2\") " pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:08.954459 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:08.954349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:09.082947 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:09.082922 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp"] Jul 24 09:10:09.085179 ip-10-0-135-101 kubenswrapper[2554]: W0724 09:10:09.085146 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e7a0277_df7e_4100_82e8_2d66326fccc2.slice/crio-6b6f22e42046fa78c3e58755075285cfdfc4435cf110d4684bc1387f83ad4e3b WatchSource:0}: Error finding container 6b6f22e42046fa78c3e58755075285cfdfc4435cf110d4684bc1387f83ad4e3b: Status 404 returned error can't find the container with id 6b6f22e42046fa78c3e58755075285cfdfc4435cf110d4684bc1387f83ad4e3b Jul 24 09:10:09.650906 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:09.650868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" event={"ID":"5e7a0277-df7e-4100-82e8-2d66326fccc2","Type":"ContainerStarted","Data":"c102debb9ab5d562379cffe4c82ac7c63ca0380e6f0817f2fbc7abdd1e90b154"} Jul 24 09:10:09.651340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:09.650929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" event={"ID":"5e7a0277-df7e-4100-82e8-2d66326fccc2","Type":"ContainerStarted","Data":"6b6f22e42046fa78c3e58755075285cfdfc4435cf110d4684bc1387f83ad4e3b"} Jul 24 09:10:09.651340 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:09.651007 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:09.667737 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:09.667688 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" podStartSLOduration=1.6676734290000002 podStartE2EDuration="1.667673429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 09:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 09:10:09.666909787 +0000 UTC m=+562.891923410" watchObservedRunningTime="2026-07-24 09:10:09.667673429 +0000 UTC m=+562.892687050" Jul 24 09:10:10.483126 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:10.483089 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gcpx5_09c5bc87-20c6-4fe1-8636-f7d2e4203660/dns/0.log" Jul 24 09:10:10.503623 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:10.503596 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gcpx5_09c5bc87-20c6-4fe1-8636-f7d2e4203660/kube-rbac-proxy/0.log" Jul 24 09:10:10.572585 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:10.572559 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2858_0e58a784-5951-40d4-92b0-cf6fe5bad774/dns-node-resolver/0.log" Jul 24 09:10:11.169611 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:11.169580 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzm7c_56c58aa5-e6a2-4804-8f5a-aed5751fde00/node-ca/0.log" Jul 24 09:10:12.388589 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:12.388553 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnvjq_00614971-67b3-4425-b2c1-cd701009be3c/serve-healthcheck-canary/0.log" Jul 24 09:10:13.053644 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:13.053611 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7vq5_6639a429-4492-4af2-9e2f-efdb4bb9c283/kube-rbac-proxy/0.log" Jul 24 09:10:13.076595 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:13.076567 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7vq5_6639a429-4492-4af2-9e2f-efdb4bb9c283/exporter/0.log" Jul 24 09:10:13.098581 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:13.098555 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7vq5_6639a429-4492-4af2-9e2f-efdb4bb9c283/extractor/0.log" Jul 24 09:10:15.664877 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:15.664848 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rt75z/perf-node-gather-daemonset-g5wzp" Jul 24 09:10:19.973596 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:19.973518 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/kube-multus-additional-cni-plugins/0.log" Jul 24 09:10:20.001627 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.001607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/egress-router-binary-copy/0.log" Jul 24 09:10:20.026534 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.026503 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/cni-plugins/0.log" Jul 24 09:10:20.065712 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.065681 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/bond-cni-plugin/0.log" Jul 24 09:10:20.129571 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.129536 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/routeoverride-cni/0.log" Jul 24 09:10:20.172701 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.172670 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/whereabouts-cni-bincopy/0.log" Jul 24 09:10:20.201457 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.201428 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-787dc_f4f0e0e0-f5d9-4f80-9e7c-ba05f4ab9f72/whereabouts-cni/0.log" Jul 24 09:10:20.578201 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.578159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kj5f4_5c13b14a-81ba-4718-9ca3-35d736c972a7/kube-multus/0.log" Jul 24 09:10:20.679509 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.679479 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ctznw_a2e0a09d-1e5e-4fac-90e7-73ea46d77967/network-metrics-daemon/0.log" Jul 24 09:10:20.698237 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:20.698211 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ctznw_a2e0a09d-1e5e-4fac-90e7-73ea46d77967/kube-rbac-proxy/0.log" Jul 24 09:10:21.948501 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:21.948470 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/ovn-controller/0.log" Jul 24 09:10:21.969923 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:21.969896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/ovn-acl-logging/0.log" Jul 24 09:10:21.995306 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:21.995270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/kube-rbac-proxy-node/0.log" Jul 24 09:10:22.016873 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:22.016847 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 09:10:22.039919 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:22.039896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/northd/0.log" Jul 24 09:10:22.061136 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:22.061110 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/nbdb/0.log" Jul 24 09:10:22.084961 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:22.084942 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/sbdb/0.log" Jul 24 09:10:22.124434 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:22.124407 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9f4x_f239f931-1d0b-46d0-9cec-4bb5eb586232/ovnkube-controller/0.log" Jul 24 09:10:23.166694 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:23.166663 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-x6xwp_50c412dc-0d5c-441b-bd97-3ba337ac75a5/network-check-target-container/0.log" Jul 24 09:10:24.052166 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:24.052137 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zfhlc_ea0b9cf8-6b7b-45f6-8ea1-7433de538519/iptables-alerter/0.log" Jul 24 09:10:24.687718 ip-10-0-135-101 kubenswrapper[2554]: I0724 09:10:24.687689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hxxcj_e78b0558-fd5c-4b81-9229-6bb4646e6157/tuned/0.log"