Jul 24 04:00:21.349173 ip-10-0-134-57 systemd[1]: Starting Kubernetes Kubelet... Jul 24 04:00:21.665786 ip-10-0-134-57 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 04:00:21.665786 ip-10-0-134-57 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 04:00:21.665786 ip-10-0-134-57 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 04:00:21.665786 ip-10-0-134-57 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 04:00:21.665786 ip-10-0-134-57 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 04:00:21.666637 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.666572 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 04:00:21.670357 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670343 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:21.670357 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670356 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670360 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670363 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670366 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670370 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670373 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670375 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670378 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670381 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670383 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670386 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670389 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670391 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670394 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670396 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670399 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670402 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670404 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670407 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670410 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:21.670424 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670415 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670418 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670420 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670423 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670425 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670429 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670432 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670435 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670438 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670441 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670443 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670446 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670448 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670451 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670454 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670456 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670459 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670461 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670464 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670466 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:21.670894 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670468 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670471 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670473 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670476 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670480 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670483 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670486 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670489 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670491 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670494 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670496 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670499 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670501 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670504 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670509 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670513 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670516 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670518 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670521 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:21.671375 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670524 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670526 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670529 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670531 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670533 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670536 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670539 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670541 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670544 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670546 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670549 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670551 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670554 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670556 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670559 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670561 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670564 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670566 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670570 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670572 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670574 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:21.671850 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670577 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670579 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670582 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670584 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670587 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670589 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670594 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670596 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670599 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670602 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670604 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670607 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670609 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670613 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670617 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670620 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670623 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.670626 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671290 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:21.672668 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671297 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671300 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671303 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671306 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671309 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671312 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671314 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671317 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671319 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671322 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671324 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671327 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671329 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671332 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671334 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671337 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671339 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671342 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671345 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671348 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:21.673344 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671352 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671354 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671357 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671359 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671362 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671364 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671367 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671369 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671372 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671375 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671377 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671380 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671382 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671386 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671390 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671393 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671396 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671399 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671402 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:21.674119 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671405 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671407 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671410 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671412 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671415 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671418 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671420 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671423 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671425 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671428 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671430 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671433 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671436 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671438 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671441 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671444 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671446 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671449 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671452 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671454 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:21.674786 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671457 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671459 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671462 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671464 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671467 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671469 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671471 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671474 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671477 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671479 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671481 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671484 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671487 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671489 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671492 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671494 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671497 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671499 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671501 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671504 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:21.675514 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671506 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671509 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671511 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671514 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671517 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671520 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671522 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671527 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671531 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671534 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671537 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671541 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671544 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671547 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671550 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671553 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671556 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671558 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671561 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671897 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:21.676240 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671902 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671905 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671907 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671910 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671912 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671915 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671937 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671940 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671942 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671945 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671949 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671953 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671956 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671959 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671962 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671966 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671970 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671973 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671976 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:21.676947 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671979 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671983 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671985 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671988 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671992 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671994 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.671997 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672000 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672002 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672005 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672009 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672012 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672015 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672017 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672020 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672023 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672025 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672029 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672031 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:21.677631 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672034 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672036 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672039 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672042 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672045 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672048 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672051 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672053 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672056 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672059 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672062 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672065 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672067 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672070 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672073 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672076 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672078 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672081 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672084 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672086 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:21.678301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672089 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672091 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672094 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672096 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672099 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672102 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672106 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672109 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672111 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672114 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672117 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672119 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672122 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672125 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672127 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672130 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672132 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672135 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672137 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:21.679005 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672140 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672143 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672145 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672148 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672151 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672153 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672156 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672159 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672162 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672164 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672167 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672169 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672172 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672174 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672177 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672179 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672182 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672184 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672187 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672189 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:21.679670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.672191 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672255 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672265 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672272 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672278 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672284 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672289 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672295 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672304 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672308 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672311 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672314 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672317 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672320 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672326 2577 flags.go:64] FLAG: --cgroup-root="" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672328 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672331 2577 flags.go:64] FLAG: --client-ca-file="" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672334 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672337 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672341 2577 flags.go:64] FLAG: --cluster-domain="" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672344 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672347 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672350 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672354 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 04:00:21.680411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672357 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672360 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672363 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672366 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672369 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672372 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672374 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672378 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672380 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672384 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672387 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672390 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672393 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672396 2577 flags.go:64] FLAG: --enable-server="true" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672399 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672855 2577 flags.go:64] FLAG: --event-burst="100" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672859 2577 flags.go:64] FLAG: --event-qps="50" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672863 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672866 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672869 2577 flags.go:64] FLAG: --eviction-hard="" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672873 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672876 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672881 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672884 2577 flags.go:64] FLAG: --eviction-soft="" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672887 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 04:00:21.681249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672890 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672893 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672896 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672898 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672901 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672905 2577 flags.go:64] FLAG: --feature-gates="" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672909 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672912 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672915 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672932 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672935 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672938 2577 flags.go:64] FLAG: --help="false" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672941 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-57.ec2.internal" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672944 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672947 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672950 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672953 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672957 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672960 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672962 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672965 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672968 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672971 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672974 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 04:00:21.682129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672977 2577 flags.go:64] FLAG: --kube-reserved="" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672980 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672982 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672987 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672990 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672994 2577 flags.go:64] FLAG: --lock-file="" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.672997 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673000 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673003 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673008 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673011 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673014 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673017 2577 flags.go:64] FLAG: --logging-format="text" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673020 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673024 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673027 2577 flags.go:64] FLAG: --manifest-url="" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673030 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673034 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673037 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673041 2577 flags.go:64] FLAG: --max-pods="110" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673044 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673047 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673049 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673052 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673055 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 04:00:21.682959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673058 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673061 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673067 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673071 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673074 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673077 2577 flags.go:64] FLAG: --pod-cidr="" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673080 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673084 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673087 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673090 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673094 2577 flags.go:64] FLAG: --port="10250" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673097 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673100 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-008ef12d25203857d" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673104 2577 flags.go:64] FLAG: --qos-reserved="" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673107 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673110 2577 flags.go:64] FLAG: --register-node="true" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673113 2577 flags.go:64] FLAG: --register-with-taints="" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673116 2577 flags.go:64] FLAG: --registry-burst="10" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673119 2577 flags.go:64] FLAG: --registry-qps="5" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673122 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673125 2577 flags.go:64] FLAG: --reserved-memory="" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673128 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673132 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673135 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673138 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 04:00:21.683835 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673140 2577 flags.go:64] FLAG: --runonce="false" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673143 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673146 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673153 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673156 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673159 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673162 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673165 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673168 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673170 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673173 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673176 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673179 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673182 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673185 2577 flags.go:64] FLAG: --system-cgroups="" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673187 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673193 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673198 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673200 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673204 2577 flags.go:64] FLAG: --tls-min-version="" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673208 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673211 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673213 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673216 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673219 2577 flags.go:64] FLAG: --v="2" Jul 24 04:00:21.684741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673223 2577 flags.go:64] FLAG: --version="false" Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673227 2577 flags.go:64] FLAG: --vmodule="" Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673230 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.673233 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673341 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673347 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673351 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673354 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673357 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673360 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673363 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673365 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673368 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673371 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673373 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673376 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673379 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673381 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673384 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673386 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:21.685664 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673389 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673392 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673394 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673398 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673405 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673410 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673413 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673416 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673419 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673421 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673424 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673426 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673429 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673432 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673434 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673437 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673440 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673442 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673446 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:21.686371 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673448 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673450 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673453 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673455 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673458 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673460 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673463 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673465 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673468 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673470 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673473 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673475 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673478 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673480 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673483 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673485 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673488 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673493 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673496 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673499 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:21.687074 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673502 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673505 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673508 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673511 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673513 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673516 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673519 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673521 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673524 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673526 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673529 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673532 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673563 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673716 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673723 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673728 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673732 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673737 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673742 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:21.687759 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673747 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673752 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673756 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673761 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673766 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673771 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673775 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673786 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673790 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673795 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673800 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673805 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673809 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673814 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673819 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673823 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673827 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673831 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673836 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673844 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:21.688442 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673849 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673853 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673857 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673861 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.673866 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.674395 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.680651 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.680665 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.681287 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.681296 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681349 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681353 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681357 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681360 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681364 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:21.689164 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681367 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681370 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681373 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681377 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681379 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681382 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681385 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681388 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681391 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681393 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681396 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681398 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681401 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681404 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681406 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681409 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681412 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681414 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681418 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681420 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:21.689718 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681423 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681426 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681428 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681431 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681434 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681437 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681440 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681443 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681445 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681448 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681451 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681453 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681456 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681458 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681462 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681465 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681468 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681471 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681473 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681476 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:21.690570 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681479 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681482 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681484 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681487 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681489 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681492 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681495 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681497 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681500 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681503 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681506 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681508 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681511 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681515 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681519 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681522 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681525 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681528 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681531 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:21.691301 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681533 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681536 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681539 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681541 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681544 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681546 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681549 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681551 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681554 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681556 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681559 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681561 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681564 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681566 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681571 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681574 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681577 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681580 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681583 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:21.692016 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681586 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681588 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681591 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681594 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681598 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681601 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681603 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681606 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681609 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681612 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681614 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681617 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681620 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681622 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681625 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:21.692685 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681627 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.681632 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681735 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681739 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681742 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681745 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681749 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681753 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681756 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681759 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681762 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681765 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681768 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681771 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681774 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:21.693261 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681777 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681780 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681782 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681785 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681788 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681791 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681793 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681796 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681799 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681801 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681804 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681807 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681809 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681812 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681815 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681817 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681820 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681822 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681825 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681827 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:21.693826 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681830 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681832 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681835 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681837 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681840 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681842 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681845 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681847 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681850 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681852 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681855 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681858 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681861 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681863 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681866 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681869 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681872 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681874 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681877 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681879 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:21.694547 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681882 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681884 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681887 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681889 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681892 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681894 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681897 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681899 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681902 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681904 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681907 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681909 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681912 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681914 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681930 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681934 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681936 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681939 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681941 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681944 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:21.695245 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681946 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681949 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681951 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681954 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681957 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681960 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681962 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681965 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681970 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681973 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681975 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681978 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681981 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681983 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681986 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681989 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681991 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681994 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681996 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:21.695976 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.681999 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.682001 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.682005 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.682008 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.682012 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.682016 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:21.682019 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.682023 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.682108 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.684557 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.685671 2577 server.go:1019] "Starting client certificate rotation" Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.685774 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.685805 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 04:00:21.696640 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.687781 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 04:00:21.697273 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.689414 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 04:00:21.698847 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.698834 2577 log.go:25] "Validated CRI v1 runtime API" Jul 24 04:00:21.701811 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.701793 2577 log.go:25] "Validated CRI v1 image API" Jul 24 04:00:21.702620 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.702604 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 04:00:21.704518 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.704500 2577 fs.go:135] Filesystem UUIDs: map[239b3457-e889-4b82-ab98-b35098ce3b2f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f19e3de5-e212-46a7-883f-9a7f6521b480:/dev/nvme0n1p3] Jul 24 04:00:21.704592 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.704518 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 04:00:21.709217 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.709117 2577 manager.go:216] Machine: {Timestamp:2026-07-24 04:00:21.708012012 +0000 UTC m=+0.263445588 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099530 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec296174f66f585a98aa54b2ff7cc0fd SystemUUID:ec296174-f66f-585a-98aa-54b2ff7cc0fd BootID:79545d46-d1f1-4556-b6cf-cf0ff92b5468 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:b9:df:ec:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:b9:df:ec:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:25:14:75:7e:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 04:00:21.709217 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.709214 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 04:00:21.709353 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.709275 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 04:00:21.710998 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.710976 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 04:00:21.711116 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.710999 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 04:00:21.711626 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.711615 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 04:00:21.711666 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.711627 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 04:00:21.711666 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.711634 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 04:00:21.712212 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.712201 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 04:00:21.713429 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.713417 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 04:00:21.714751 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.714736 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 04:00:21.717115 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717103 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 24 04:00:21.717227 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717217 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 04:00:21.717273 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717247 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 24 04:00:21.717273 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717263 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 04:00:21.717273 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717273 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 04:00:21.717376 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717282 2577 kubelet.go:398] "Adding apiserver pod source" Jul 24 04:00:21.717376 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717290 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 04:00:21.717642 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717621 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 04:00:21.717722 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.717647 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 04:00:21.719300 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.719281 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 04:00:21.720626 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.720609 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 04:00:21.720690 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.720657 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 04:00:21.721291 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721279 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 04:00:21.721336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721295 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 04:00:21.721336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721301 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 04:00:21.721336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721307 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 04:00:21.721336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721315 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 04:00:21.721336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721321 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 04:00:21.721533 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721523 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 04:00:21.721533 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721532 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 04:00:21.721610 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721539 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 04:00:21.721610 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721545 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 04:00:21.721610 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721558 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 04:00:21.721610 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.721565 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 04:00:21.722122 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.722113 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 04:00:21.722122 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.722121 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 04:00:21.725145 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.725105 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 04:00:21.725295 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.725273 2577 server.go:1268] "Started kubelet" Jul 24 04:00:21.725479 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.725453 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 04:00:21.725675 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.725649 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 04:00:21.725675 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.725649 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 04:00:21.725819 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.725649 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 04:00:21.725819 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.725709 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 04:00:21.726702 ip-10-0-134-57 systemd[1]: Started Kubernetes Kubelet. Jul 24 04:00:21.728405 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.728383 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 04:00:21.730778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.730761 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 24 04:00:21.730899 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.730882 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 04:00:21.734665 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.734650 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ts8l6" Jul 24 04:00:21.735855 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.735840 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 04:00:21.735914 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.735130 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-57.ec2.internal.18c51dd38abd7ea2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-57.ec2.internal,UID:ip-10-0-134-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-57.ec2.internal,},FirstTimestamp:2026-07-24 04:00:21.725249186 +0000 UTC m=+0.280682763,LastTimestamp:2026-07-24 04:00:21.725249186 +0000 UTC m=+0.280682763,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-57.ec2.internal,}" Jul 24 04:00:21.736437 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.736416 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 04:00:21.736535 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.736502 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:21.736985 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.736968 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 04:00:21.736985 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.736969 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 04:00:21.737132 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.736993 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 04:00:21.737132 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737113 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 24 04:00:21.737132 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737122 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 24 04:00:21.737284 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737174 2577 factory.go:55] Registering systemd factory Jul 24 04:00:21.737284 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737186 2577 factory.go:223] Registration of the systemd container factory successfully Jul 24 04:00:21.737356 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737347 2577 factory.go:153] Registering CRI-O factory Jul 24 04:00:21.737389 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737358 2577 factory.go:223] Registration of the crio container factory successfully Jul 24 04:00:21.737420 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737405 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 04:00:21.737449 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737427 2577 factory.go:103] Registering Raw factory Jul 24 04:00:21.737449 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737442 2577 manager.go:1196] Started watching for new ooms in manager Jul 24 04:00:21.737845 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.737833 2577 manager.go:349] Starting recovery of all containers Jul 24 04:00:21.743642 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.743619 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ts8l6" Jul 24 04:00:21.745360 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.745337 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 04:00:21.745442 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.745396 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 04:00:21.749171 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.749158 2577 manager.go:354] Recovery completed Jul 24 04:00:21.751621 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.751600 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 24 04:00:21.754902 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.754886 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.756671 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.756655 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.756735 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.756685 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.756735 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.756697 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.757255 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757242 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 04:00:21.757255 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757253 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 04:00:21.757255 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757253 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.757387 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757267 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 24 04:00:21.757953 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757939 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.758003 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757964 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.758003 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.757974 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.758818 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.758752 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-57.ec2.internal.18c51dd38c9cf2a4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-57.ec2.internal,UID:ip-10-0-134-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-57.ec2.internal,},FirstTimestamp:2026-07-24 04:00:21.756670628 +0000 UTC m=+0.312104207,LastTimestamp:2026-07-24 04:00:21.756670628 +0000 UTC m=+0.312104207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-57.ec2.internal,}" Jul 24 04:00:21.759447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.759433 2577 policy_none.go:49] "None policy: Start" Jul 24 04:00:21.759447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.759449 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 04:00:21.759550 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.759459 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 04:00:21.761467 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.761456 2577 policy_none.go:47] "Start" Jul 24 04:00:21.795549 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795441 2577 manager.go:337] "Starting Device Plugin manager" Jul 24 04:00:21.795628 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.795559 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 04:00:21.795628 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795569 2577 server.go:87] "Starting device plugin registration server" Jul 24 04:00:21.795747 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795736 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 04:00:21.795805 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795747 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 04:00:21.795874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795857 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 04:00:21.795973 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795960 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 04:00:21.796016 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.795974 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 04:00:21.796397 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.796381 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 04:00:21.796492 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.796419 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:21.868831 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.868809 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 04:00:21.870957 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.869915 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 04:00:21.870957 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.869977 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 04:00:21.870957 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.869996 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 04:00:21.870957 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.870039 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 04:00:21.872052 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.872036 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:21.896765 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.896747 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.897456 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.897430 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.897456 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.897455 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.897568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.897465 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.897568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.897484 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-57.ec2.internal" Jul 24 04:00:21.904891 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.904876 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-57.ec2.internal" Jul 24 04:00:21.904986 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.904897 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-57.ec2.internal\": node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:21.919386 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.919346 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:21.971074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.971052 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal"] Jul 24 04:00:21.971177 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.971108 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.971855 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.971840 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.971947 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.971868 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.971947 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.971878 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.974192 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974179 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.974303 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:21.974340 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974314 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.974829 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974815 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.974911 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974838 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.974911 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974858 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.974911 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974869 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.974911 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974841 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.975074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.974938 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.977165 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.977151 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jul 24 04:00:21.977244 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.977174 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:21.977822 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.977808 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:21.977898 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.977836 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:21.977898 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:21.977850 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:21.990445 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.990428 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-57.ec2.internal\" not found" node="ip-10-0-134-57.ec2.internal" Jul 24 04:00:21.994219 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:21.994205 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-57.ec2.internal\" not found" node="ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.020348 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.020329 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.037989 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.037965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e800257637da25c0996475e6fab19858-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"e800257637da25c0996475e6fab19858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.038096 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.037996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e800257637da25c0996475e6fab19858-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"e800257637da25c0996475e6fab19858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.038096 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.038024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06bbd3a05c6f4492e95c3f38f3847691-config\") pod \"kube-apiserver-proxy-ip-10-0-134-57.ec2.internal\" (UID: \"06bbd3a05c6f4492e95c3f38f3847691\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.120681 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.120653 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.139031 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.139012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e800257637da25c0996475e6fab19858-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"e800257637da25c0996475e6fab19858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.139084 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.139038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e800257637da25c0996475e6fab19858-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"e800257637da25c0996475e6fab19858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.139084 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.139055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06bbd3a05c6f4492e95c3f38f3847691-config\") pod \"kube-apiserver-proxy-ip-10-0-134-57.ec2.internal\" (UID: \"06bbd3a05c6f4492e95c3f38f3847691\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.139084 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.139082 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06bbd3a05c6f4492e95c3f38f3847691-config\") pod \"kube-apiserver-proxy-ip-10-0-134-57.ec2.internal\" (UID: \"06bbd3a05c6f4492e95c3f38f3847691\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.139181 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.139098 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e800257637da25c0996475e6fab19858-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"e800257637da25c0996475e6fab19858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.139181 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.139111 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e800257637da25c0996475e6fab19858-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"e800257637da25c0996475e6fab19858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.221434 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.221379 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.294894 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.294863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.297126 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.297110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.322169 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.322142 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.427985 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.427962 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.534874 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.534823 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.640486 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.640466 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.687291 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.687264 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 04:00:22.687889 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.687869 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 04:00:22.741154 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:22.741128 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jul 24 04:00:22.750775 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.750747 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 03:55:22 +0000 UTC" deadline="2028-04-18 03:36:48.013930472 +0000 UTC" Jul 24 04:00:22.750775 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.750772 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15215h36m25.26316315s" Jul 24 04:00:22.823634 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.823587 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:22.837441 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.837420 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.851871 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.851855 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 04:00:22.853356 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.853335 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jul 24 04:00:22.862522 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.862503 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 04:00:22.973726 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:22.973701 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode800257637da25c0996475e6fab19858.slice/crio-d69a945042da82f57d42cddc5ea299648937dfa2e52357f06a5c16f04effbb45 WatchSource:0}: Error finding container d69a945042da82f57d42cddc5ea299648937dfa2e52357f06a5c16f04effbb45: Status 404 returned error can't find the container with id d69a945042da82f57d42cddc5ea299648937dfa2e52357f06a5c16f04effbb45 Jul 24 04:00:22.974397 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:22.974379 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bbd3a05c6f4492e95c3f38f3847691.slice/crio-cadf846d0c3d7d1bbb4941075e7d5ee3fdda94a257e8c4cff23a0e5d45b538bb WatchSource:0}: Error finding container cadf846d0c3d7d1bbb4941075e7d5ee3fdda94a257e8c4cff23a0e5d45b538bb: Status 404 returned error can't find the container with id cadf846d0c3d7d1bbb4941075e7d5ee3fdda94a257e8c4cff23a0e5d45b538bb Jul 24 04:00:22.978275 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:22.978261 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:00:23.223282 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.223185 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:23.260814 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.260785 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:23.719607 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.719526 2577 apiserver.go:52] "Watching apiserver" Jul 24 04:00:23.728011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.727957 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 04:00:23.728448 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.728421 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-95tjs","openshift-multus/network-metrics-daemon-9wqx5","openshift-network-operator/iptables-alerter-7rvzx","openshift-ovn-kubernetes/ovnkube-node-vcgwj","kube-system/global-pull-secret-syncer-mtgw2","kube-system/konnectivity-agent-lw8vp","kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mqq7q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal","openshift-multus/multus-additional-cni-plugins-6vkb7","openshift-network-diagnostics/network-check-target-jdgw2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9","openshift-dns/node-resolver-dn79f","openshift-image-registry/node-ca-xc6j8"] Jul 24 04:00:23.731137 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.731114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.733412 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.733389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.734832 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.734810 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 04:00:23.734832 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.734823 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.734993 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.734824 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 04:00:23.735348 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.735220 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.735348 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.735341 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6l4kl\"" Jul 24 04:00:23.735662 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.735640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.736264 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.736242 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.736354 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.736278 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.736354 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.736290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wnbbs\"" Jul 24 04:00:23.736428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.736404 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 04:00:23.736643 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.736628 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 04:00:23.738473 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.738451 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.738581 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.738528 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h4hf7\"" Jul 24 04:00:23.739378 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.738815 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.739378 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.738852 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 04:00:23.739378 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.738920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.740800 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.740775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.740907 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.740873 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:23.741862 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.741841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.741971 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.741877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggnv8\"" Jul 24 04:00:23.743426 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.743405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.747496 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.746477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.748376 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovn-node-metrics-cert\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748486 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748486 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-system-cni-dir\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.748486 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cnibin\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.748632 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.748632 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw2ht\" (UniqueName: \"kubernetes.io/projected/d0d07eb7-df9e-45bd-806a-55e35ff2da46-kube-api-access-hw2ht\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.748632 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04f51c19-9f38-46b6-885a-7edb62016ae3-hosts-file\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.748774 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-systemd-units\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748774 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-run-netns\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748774 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f51c19-9f38-46b6-885a-7edb62016ae3-tmp-dir\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.748774 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vt8\" (UniqueName: \"kubernetes.io/projected/907bcb51-2828-4449-8906-5892dcd6a32b-kube-api-access-99vt8\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.748980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-systemd\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-var-lib-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-env-overrides\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovnkube-script-lib\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.748980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hg2\" (UniqueName: \"kubernetes.io/projected/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-kube-api-access-l4hg2\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.748995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/907bcb51-2828-4449-8906-5892dcd6a32b-iptables-alerter-script\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-ovn\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovnkube-config\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-slash\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-etc-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-log-socket\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-os-release\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.749211 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/907bcb51-2828-4449-8906-5892dcd6a32b-host-slash\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-node-log\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dzg2\" (UniqueName: \"kubernetes.io/projected/04f51c19-9f38-46b6-885a-7edb62016ae3-kube-api-access-4dzg2\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cni-binary-copy\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.749555 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-kubelet\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749845 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-cni-bin\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749845 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-cni-netd\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.749845 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.749643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.751671 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.751651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:23.751745 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.751726 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:23.754800 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.754774 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.757323 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.757294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:23.758008 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.757977 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:23.761494 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.761421 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 04:00:23.761627 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.761558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 04:00:23.761696 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.761634 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.761751 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.761699 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 04:00:23.761751 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.761636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.761848 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.761829 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 04:00:23.762692 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.762674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.762988 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.762938 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.762988 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.762982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 04:00:23.763148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.763148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zqfm4\"" Jul 24 04:00:23.763148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763108 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 04:00:23.763302 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763162 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.763302 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763253 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 04:00:23.763406 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763391 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bmtrd\"" Jul 24 04:00:23.763462 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763444 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 04:00:23.763512 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9lwdt\"" Jul 24 04:00:23.763578 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.763559 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w9nkz\"" Jul 24 04:00:23.770856 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.770837 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 04:00:23.771015 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.770944 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.771015 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.770932 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.771245 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.771226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95vw8\"" Jul 24 04:00:23.778844 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.778825 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 04:00:23.820438 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.820419 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8dx9h" Jul 24 04:00:23.826929 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.826908 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8dx9h" Jul 24 04:00:23.838333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.838316 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 04:00:23.843915 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.843890 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:23.850802 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:23.850885 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-os-release\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.850885 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.850885 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/907bcb51-2828-4449-8906-5892dcd6a32b-host-slash\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.850885 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-node-log\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851082 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-system-cni-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.851082 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850958 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/907bcb51-2828-4449-8906-5892dcd6a32b-host-slash\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.851082 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850986 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-os-release\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851082 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-kubernetes\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.851082 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.850972 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-node-log\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851082 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-host\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-cnibin\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dkp\" (UniqueName: \"kubernetes.io/projected/220e565f-2691-4b31-93df-02875ddbd63d-kube-api-access-46dkp\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-device-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-run\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrqc9\" (UniqueName: \"kubernetes.io/projected/d300a49b-aa64-4339-8eb6-887ca1e285c5-kube-api-access-xrqc9\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cni-binary-copy\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-kubelet\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851361 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-cni-netd\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-k8s-cni-cncf-io\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysctl-d\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a9777c-0f02-43fa-b9f2-75a579ecb330-tmp\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851460 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-cni-netd\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851522 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cnibin\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cnibin\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-kubelet\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw2ht\" (UniqueName: \"kubernetes.io/projected/d0d07eb7-df9e-45bd-806a-55e35ff2da46-kube-api-access-hw2ht\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04f51c19-9f38-46b6-885a-7edb62016ae3-hosts-file\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851631 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-systemd-units\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-run-netns\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-systemd-units\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851697 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.851874 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-os-release\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851739 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04f51c19-9f38-46b6-885a-7edb62016ae3-hosts-file\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznpg\" (UniqueName: \"kubernetes.io/projected/5538d024-5890-4f7f-b9f5-addedcf72489-kube-api-access-fznpg\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f51c19-9f38-46b6-885a-7edb62016ae3-tmp-dir\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851778 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-run-netns\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vt8\" (UniqueName: \"kubernetes.io/projected/907bcb51-2828-4449-8906-5892dcd6a32b-kube-api-access-99vt8\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-systemd\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-env-overrides\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovnkube-script-lib\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hg2\" (UniqueName: \"kubernetes.io/projected/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-kube-api-access-l4hg2\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-cni-multus\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f51c19-9f38-46b6-885a-7edb62016ae3-tmp-dir\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.851803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0d07eb7-df9e-45bd-806a-55e35ff2da46-cni-binary-copy\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-systemd\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-hostroot\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/907bcb51-2828-4449-8906-5892dcd6a32b-iptables-alerter-script\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-ovn\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.852688 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovnkube-config\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-env-overrides\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-sys\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-tuned\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-ovn\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-287gh\" (UniqueName: \"kubernetes.io/projected/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-kube-api-access-287gh\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-slash\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-etc-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-socket-dir-parent\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-slash\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-netns\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852571 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-etc-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-kubelet\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852594 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovnkube-script-lib\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-multus-certs\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-registration-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852733 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-kubelet-config\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ba710-58b7-4d91-9bdf-7975c314a162-konnectivity-ca\") pod \"konnectivity-agent-lw8vp\" (UID: \"7b5ba710-58b7-4d91-9bdf-7975c314a162\") " pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysctl-conf\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmbmn\" (UniqueName: \"kubernetes.io/projected/e4a9777c-0f02-43fa-b9f2-75a579ecb330-kube-api-access-fmbmn\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852880 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovnkube-config\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/907bcb51-2828-4449-8906-5892dcd6a32b-iptables-alerter-script\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dzg2\" (UniqueName: \"kubernetes.io/projected/04f51c19-9f38-46b6-885a-7edb62016ae3-kube-api-access-4dzg2\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-sys-fs\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.852985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5538d024-5890-4f7f-b9f5-addedcf72489-cni-binary-copy\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-etc-kubernetes\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/220e565f-2691-4b31-93df-02875ddbd63d-serviceca\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysconfig\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-systemd\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-var-lib-kubelet\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-cni-bin\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.853815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853318 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-cni-bin\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovn-node-metrics-cert\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-cni-bin\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-socket-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b5ba710-58b7-4d91-9bdf-7975c314a162-agent-certs\") pod \"konnectivity-agent-lw8vp\" (UID: \"7b5ba710-58b7-4d91-9bdf-7975c314a162\") " pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-lib-modules\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-system-cni-dir\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-var-lib-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-var-lib-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-cni-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0d07eb7-df9e-45bd-806a-55e35ff2da46-system-cni-dir\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.853973 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-run-openvswitch\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-conf-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.854493 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5538d024-5890-4f7f-b9f5-addedcf72489-multus-daemon-config\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854074 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-dbus\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/220e565f-2691-4b31-93df-02875ddbd63d-host\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-modprobe-d\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-log-socket\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.855072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.854335 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-log-socket\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.857204 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.857186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-ovn-node-metrics-cert\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.859909 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.859887 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vt8\" (UniqueName: \"kubernetes.io/projected/907bcb51-2828-4449-8906-5892dcd6a32b-kube-api-access-99vt8\") pod \"iptables-alerter-7rvzx\" (UID: \"907bcb51-2828-4449-8906-5892dcd6a32b\") " pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:23.860756 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.860733 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hg2\" (UniqueName: \"kubernetes.io/projected/1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f-kube-api-access-l4hg2\") pod \"ovnkube-node-vcgwj\" (UID: \"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:23.860821 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.860760 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw2ht\" (UniqueName: \"kubernetes.io/projected/d0d07eb7-df9e-45bd-806a-55e35ff2da46-kube-api-access-hw2ht\") pod \"multus-additional-cni-plugins-6vkb7\" (UID: \"d0d07eb7-df9e-45bd-806a-55e35ff2da46\") " pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:23.860821 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.860783 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dzg2\" (UniqueName: \"kubernetes.io/projected/04f51c19-9f38-46b6-885a-7edb62016ae3-kube-api-access-4dzg2\") pod \"node-resolver-dn79f\" (UID: \"04f51c19-9f38-46b6-885a-7edb62016ae3\") " pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:23.875319 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.875279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" event={"ID":"e800257637da25c0996475e6fab19858","Type":"ContainerStarted","Data":"d69a945042da82f57d42cddc5ea299648937dfa2e52357f06a5c16f04effbb45"} Jul 24 04:00:23.876341 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.876320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" event={"ID":"06bbd3a05c6f4492e95c3f38f3847691","Type":"ContainerStarted","Data":"cadf846d0c3d7d1bbb4941075e7d5ee3fdda94a257e8c4cff23a0e5d45b538bb"} Jul 24 04:00:23.954591 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-cni-multus\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.954698 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-hostroot\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.954698 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-sys\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.954698 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-tuned\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.954698 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-287gh\" (UniqueName: \"kubernetes.io/projected/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-kube-api-access-287gh\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:23.954698 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-socket-dir-parent\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954707 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-cni-multus\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954714 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-sys\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-netns\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954763 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-netns\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-kubelet\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-multus-certs\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954795 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-hostroot\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-registration-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954896 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-socket-dir-parent\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954904 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-multus-certs\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954841 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-kubelet\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-kubelet-config\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-registration-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.955006 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.954982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ba710-58b7-4d91-9bdf-7975c314a162-konnectivity-ca\") pod \"konnectivity-agent-lw8vp\" (UID: \"7b5ba710-58b7-4d91-9bdf-7975c314a162\") " pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysctl-conf\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmbmn\" (UniqueName: \"kubernetes.io/projected/e4a9777c-0f02-43fa-b9f2-75a579ecb330-kube-api-access-fmbmn\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-sys-fs\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955049 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-kubelet-config\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-sys-fs\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955237 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysctl-conf\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5538d024-5890-4f7f-b9f5-addedcf72489-cni-binary-copy\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-etc-kubernetes\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/220e565f-2691-4b31-93df-02875ddbd63d-serviceca\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysconfig\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-etc-kubernetes\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-systemd\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-var-lib-kubelet\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955510 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-systemd\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysconfig\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955573 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-var-lib-kubelet\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.956410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-cni-bin\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955594 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ba710-58b7-4d91-9bdf-7975c314a162-konnectivity-ca\") pod \"konnectivity-agent-lw8vp\" (UID: \"7b5ba710-58b7-4d91-9bdf-7975c314a162\") " pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-socket-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-var-lib-cni-bin\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955621 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b5ba710-58b7-4d91-9bdf-7975c314a162-agent-certs\") pod \"konnectivity-agent-lw8vp\" (UID: \"7b5ba710-58b7-4d91-9bdf-7975c314a162\") " pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-lib-modules\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-cni-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.955756 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955776 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/220e565f-2691-4b31-93df-02875ddbd63d-serviceca\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955799 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-conf-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.955857 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.455811856 +0000 UTC m=+3.011245437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-conf-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-socket-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5538d024-5890-4f7f-b9f5-addedcf72489-multus-daemon-config\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.955999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-dbus\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.957346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/220e565f-2691-4b31-93df-02875ddbd63d-host\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-modprobe-d\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956090 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-dbus\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-multus-cni-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/220e565f-2691-4b31-93df-02875ddbd63d-host\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-system-cni-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-kubernetes\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956402 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-modprobe-d\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-host\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-cnibin\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dkp\" (UniqueName: \"kubernetes.io/projected/220e565f-2691-4b31-93df-02875ddbd63d-kube-api-access-46dkp\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.956487 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-host\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956522 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5538d024-5890-4f7f-b9f5-addedcf72489-multus-daemon-config\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958074 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.956549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.456530869 +0000 UTC m=+3.011964441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-kubernetes\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956172 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5538d024-5890-4f7f-b9f5-addedcf72489-cni-binary-copy\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956575 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-system-cni-dir\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-device-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-cnibin\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-run\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956620 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d300a49b-aa64-4339-8eb6-887ca1e285c5-device-dir\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956143 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-lib-modules\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrqc9\" (UniqueName: \"kubernetes.io/projected/d300a49b-aa64-4339-8eb6-887ca1e285c5-kube-api-access-xrqc9\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-k8s-cni-cncf-io\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysctl-d\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a9777c-0f02-43fa-b9f2-75a579ecb330-tmp\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-os-release\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznpg\" (UniqueName: \"kubernetes.io/projected/5538d024-5890-4f7f-b9f5-addedcf72489-kube-api-access-fznpg\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956796 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-run\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-os-release\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.958773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.956991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5538d024-5890-4f7f-b9f5-addedcf72489-host-run-k8s-cni-cncf-io\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.959447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.957041 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-sysctl-d\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.959447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.958199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4a9777c-0f02-43fa-b9f2-75a579ecb330-etc-tuned\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.959447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.958505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b5ba710-58b7-4d91-9bdf-7975c314a162-agent-certs\") pod \"konnectivity-agent-lw8vp\" (UID: \"7b5ba710-58b7-4d91-9bdf-7975c314a162\") " pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:23.959447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.959063 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a9777c-0f02-43fa-b9f2-75a579ecb330-tmp\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.963330 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.963268 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmbmn\" (UniqueName: \"kubernetes.io/projected/e4a9777c-0f02-43fa-b9f2-75a579ecb330-kube-api-access-fmbmn\") pod \"tuned-mqq7q\" (UID: \"e4a9777c-0f02-43fa-b9f2-75a579ecb330\") " pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:23.963634 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.963612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-287gh\" (UniqueName: \"kubernetes.io/projected/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-kube-api-access-287gh\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:23.965614 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.965595 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:23.965716 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.965617 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:23.965716 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.965629 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:23.965716 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:23.965701 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.465681911 +0000 UTC m=+3.021115491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:23.968585 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.968561 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrqc9\" (UniqueName: \"kubernetes.io/projected/d300a49b-aa64-4339-8eb6-887ca1e285c5-kube-api-access-xrqc9\") pod \"aws-ebs-csi-driver-node-fcnp9\" (UID: \"d300a49b-aa64-4339-8eb6-887ca1e285c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:23.970044 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.969976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznpg\" (UniqueName: \"kubernetes.io/projected/5538d024-5890-4f7f-b9f5-addedcf72489-kube-api-access-fznpg\") pod \"multus-95tjs\" (UID: \"5538d024-5890-4f7f-b9f5-addedcf72489\") " pod="openshift-multus/multus-95tjs" Jul 24 04:00:23.970139 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:23.970052 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dkp\" (UniqueName: \"kubernetes.io/projected/220e565f-2691-4b31-93df-02875ddbd63d-kube-api-access-46dkp\") pod \"node-ca-xc6j8\" (UID: \"220e565f-2691-4b31-93df-02875ddbd63d\") " pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:24.043341 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.043314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" Jul 24 04:00:24.052124 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.052105 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dn79f" Jul 24 04:00:24.062962 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.062942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rvzx" Jul 24 04:00:24.068948 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.068913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:24.077789 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.077766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" Jul 24 04:00:24.084621 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.084603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:24.092428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.092406 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xc6j8" Jul 24 04:00:24.100312 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.100291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" Jul 24 04:00:24.105072 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.105052 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95tjs" Jul 24 04:00:24.461015 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.460920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:24.461015 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.460985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:24.461247 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.461092 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:24.461247 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.461103 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:24.461247 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.461170 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.461150457 +0000 UTC m=+4.016584035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:24.461247 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.461203 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.461182871 +0000 UTC m=+4.016616452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:24.547111 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.547080 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc4b8ce_fb6a_4083_abb5_65e6e5bde47f.slice/crio-7575c12eaddadeca453676c8acb592412a083681e9b1dcc1bf0af35f754f5a81 WatchSource:0}: Error finding container 7575c12eaddadeca453676c8acb592412a083681e9b1dcc1bf0af35f754f5a81: Status 404 returned error can't find the container with id 7575c12eaddadeca453676c8acb592412a083681e9b1dcc1bf0af35f754f5a81 Jul 24 04:00:24.551464 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.551437 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd300a49b_aa64_4339_8eb6_887ca1e285c5.slice/crio-cbbda81757ca6bd5853b2c0fbf422af787aa2de4f455ce04d56128598da33014 WatchSource:0}: Error finding container cbbda81757ca6bd5853b2c0fbf422af787aa2de4f455ce04d56128598da33014: Status 404 returned error can't find the container with id cbbda81757ca6bd5853b2c0fbf422af787aa2de4f455ce04d56128598da33014 Jul 24 04:00:24.552511 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.552484 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d07eb7_df9e_45bd_806a_55e35ff2da46.slice/crio-c42ef67e0d64443805dbc703d8a87a2570b1db1be915d5c1661ea08d1db21c40 WatchSource:0}: Error finding container c42ef67e0d64443805dbc703d8a87a2570b1db1be915d5c1661ea08d1db21c40: Status 404 returned error can't find the container with id c42ef67e0d64443805dbc703d8a87a2570b1db1be915d5c1661ea08d1db21c40 Jul 24 04:00:24.553417 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.553390 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220e565f_2691_4b31_93df_02875ddbd63d.slice/crio-87724b59b72681d5730c2f65571a2b069165b85924d06e55cd49df2c3e24390a WatchSource:0}: Error finding container 87724b59b72681d5730c2f65571a2b069165b85924d06e55cd49df2c3e24390a: Status 404 returned error can't find the container with id 87724b59b72681d5730c2f65571a2b069165b85924d06e55cd49df2c3e24390a Jul 24 04:00:24.555260 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.555228 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a9777c_0f02_43fa_b9f2_75a579ecb330.slice/crio-d6c4e6cdd6aea1b0c02a305a8b79b2062515befcb5ca2a554a67e828d2e34cbe WatchSource:0}: Error finding container d6c4e6cdd6aea1b0c02a305a8b79b2062515befcb5ca2a554a67e828d2e34cbe: Status 404 returned error can't find the container with id d6c4e6cdd6aea1b0c02a305a8b79b2062515befcb5ca2a554a67e828d2e34cbe Jul 24 04:00:24.555743 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.555590 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f51c19_9f38_46b6_885a_7edb62016ae3.slice/crio-96a79aa72e812fa0ff15ef5db77abbead9243466f843be6fbc2557708e1d1148 WatchSource:0}: Error finding container 96a79aa72e812fa0ff15ef5db77abbead9243466f843be6fbc2557708e1d1148: Status 404 returned error can't find the container with id 96a79aa72e812fa0ff15ef5db77abbead9243466f843be6fbc2557708e1d1148 Jul 24 04:00:24.556533 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.556503 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907bcb51_2828_4449_8906_5892dcd6a32b.slice/crio-7d4f8d6a767119d9eabecb6590a61fc5bc01a3c3d445aab5b4dff9c3fce91a43 WatchSource:0}: Error finding container 7d4f8d6a767119d9eabecb6590a61fc5bc01a3c3d445aab5b4dff9c3fce91a43: Status 404 returned error can't find the container with id 7d4f8d6a767119d9eabecb6590a61fc5bc01a3c3d445aab5b4dff9c3fce91a43 Jul 24 04:00:24.557358 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.557334 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5538d024_5890_4f7f_b9f5_addedcf72489.slice/crio-48590f111ee396add7af23543f894fd77a507c23dd8657d7e46257c0d308f83f WatchSource:0}: Error finding container 48590f111ee396add7af23543f894fd77a507c23dd8657d7e46257c0d308f83f: Status 404 returned error can't find the container with id 48590f111ee396add7af23543f894fd77a507c23dd8657d7e46257c0d308f83f Jul 24 04:00:24.561609 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.561585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:24.561742 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.561726 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:24.561806 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.561748 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:24.561806 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.561784 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:24.561904 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:24.561846 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.561826658 +0000 UTC m=+4.117260249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:24.581110 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:00:24.581088 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5ba710_58b7_4d91_9bdf_7975c314a162.slice/crio-7ef256b1c5afe3620b5b2e05e03f2672bf7981810e13b7e1abd7f7f9e3624d78 WatchSource:0}: Error finding container 7ef256b1c5afe3620b5b2e05e03f2672bf7981810e13b7e1abd7f7f9e3624d78: Status 404 returned error can't find the container with id 7ef256b1c5afe3620b5b2e05e03f2672bf7981810e13b7e1abd7f7f9e3624d78 Jul 24 04:00:24.832529 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.832439 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:55:24 +0000 UTC" deadline="2028-04-20 21:31:49.747537316 +0000 UTC" Jul 24 04:00:24.832529 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.832485 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15281h31m24.915055035s" Jul 24 04:00:24.879319 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.879286 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" event={"ID":"e4a9777c-0f02-43fa-b9f2-75a579ecb330","Type":"ContainerStarted","Data":"d6c4e6cdd6aea1b0c02a305a8b79b2062515befcb5ca2a554a67e828d2e34cbe"} Jul 24 04:00:24.880429 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.880400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerStarted","Data":"c42ef67e0d64443805dbc703d8a87a2570b1db1be915d5c1661ea08d1db21c40"} Jul 24 04:00:24.881570 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.881549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" event={"ID":"d300a49b-aa64-4339-8eb6-887ca1e285c5","Type":"ContainerStarted","Data":"cbbda81757ca6bd5853b2c0fbf422af787aa2de4f455ce04d56128598da33014"} Jul 24 04:00:24.882730 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.882705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"7575c12eaddadeca453676c8acb592412a083681e9b1dcc1bf0af35f754f5a81"} Jul 24 04:00:24.883743 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.883725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lw8vp" event={"ID":"7b5ba710-58b7-4d91-9bdf-7975c314a162","Type":"ContainerStarted","Data":"7ef256b1c5afe3620b5b2e05e03f2672bf7981810e13b7e1abd7f7f9e3624d78"} Jul 24 04:00:24.884775 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.884746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95tjs" event={"ID":"5538d024-5890-4f7f-b9f5-addedcf72489","Type":"ContainerStarted","Data":"48590f111ee396add7af23543f894fd77a507c23dd8657d7e46257c0d308f83f"} Jul 24 04:00:24.885870 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.885851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rvzx" event={"ID":"907bcb51-2828-4449-8906-5892dcd6a32b","Type":"ContainerStarted","Data":"7d4f8d6a767119d9eabecb6590a61fc5bc01a3c3d445aab5b4dff9c3fce91a43"} Jul 24 04:00:24.887014 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.886988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xc6j8" event={"ID":"220e565f-2691-4b31-93df-02875ddbd63d","Type":"ContainerStarted","Data":"87724b59b72681d5730c2f65571a2b069165b85924d06e55cd49df2c3e24390a"} Jul 24 04:00:24.888984 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.888959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" event={"ID":"06bbd3a05c6f4492e95c3f38f3847691","Type":"ContainerStarted","Data":"4479e9d3d3a708cea1515200a3a3e8cbf291372931e9584b06a7addc6c0226fd"} Jul 24 04:00:24.890104 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.890081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dn79f" event={"ID":"04f51c19-9f38-46b6-885a-7edb62016ae3","Type":"ContainerStarted","Data":"96a79aa72e812fa0ff15ef5db77abbead9243466f843be6fbc2557708e1d1148"} Jul 24 04:00:24.903758 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:24.903700 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" podStartSLOduration=1.9036841249999998 podStartE2EDuration="1.903684125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:24.902956943 +0000 UTC m=+3.458390533" watchObservedRunningTime="2026-07-24 04:00:24.903684125 +0000 UTC m=+3.459117716" Jul 24 04:00:25.469509 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.468755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:25.469509 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.468813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:25.469509 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.468939 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:25.469509 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.469033 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.469011404 +0000 UTC m=+6.024444973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:25.469509 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.469423 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:25.469509 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.469473 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.469456312 +0000 UTC m=+6.024889882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:25.570293 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.570231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:25.570501 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.570408 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:25.570501 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.570435 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:25.570501 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.570451 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:25.570755 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.570524 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.570504798 +0000 UTC m=+6.125938381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:25.832975 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.832888 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:55:24 +0000 UTC" deadline="2028-02-04 13:15:38.397895181 +0000 UTC" Jul 24 04:00:25.832975 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.832939 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13449h15m12.564961371s" Jul 24 04:00:25.873605 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.873385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:25.873605 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.873531 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:25.873925 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.873613 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:25.873925 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.873701 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:25.873925 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:25.873773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:25.873925 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:25.873848 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:27.487593 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:27.487309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:27.488153 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:27.487635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:27.488153 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.487815 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:27.488153 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.487881 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.487860295 +0000 UTC m=+10.043294084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:27.488345 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.488314 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:27.488401 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.488363 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.488348327 +0000 UTC m=+10.043781900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:27.588512 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:27.588472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:27.589183 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.588676 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:27.589183 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.588712 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:27.589183 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.588727 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:27.589183 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.588797 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.588776466 +0000 UTC m=+10.144210052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:27.872702 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:27.872609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:27.872885 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.872735 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:27.873133 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:27.873111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:27.873238 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.873218 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:27.873334 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:27.873268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:27.873394 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:27.873336 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:29.870495 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:29.870467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:29.870983 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:29.870595 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:29.870983 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:29.870600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:29.870983 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:29.870683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:29.870983 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:29.870704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:29.870983 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:29.870780 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:31.520737 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:31.520199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:31.520737 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:31.520257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:31.520737 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.520394 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:31.520737 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.520454 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.520435513 +0000 UTC m=+18.075869081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:31.520737 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.520615 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:31.520737 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.520681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.520663536 +0000 UTC m=+18.076097115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:31.621280 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:31.621245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:31.621452 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.621394 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:31.621452 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.621421 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:31.621452 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.621434 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:31.621614 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.621487 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.621467897 +0000 UTC m=+18.176901464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:31.872040 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:31.871963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:31.872198 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:31.872084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:31.872198 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.872103 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:31.872198 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.872175 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:31.872316 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:31.872211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:31.872316 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:31.872270 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:33.870570 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:33.870543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:33.871010 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:33.870672 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:33.871010 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:33.870717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:33.871010 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:33.870794 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:33.871010 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:33.870543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:33.871010 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:33.870851 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:35.870580 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:35.870551 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:35.870580 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:35.870565 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:35.871033 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:35.870660 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:35.871033 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:35.870729 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:35.871033 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:35.870788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:35.871033 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:35.870908 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:37.871197 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:37.871159 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:37.871197 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:37.871187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:37.871739 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:37.871166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:37.871739 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:37.871280 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:37.871739 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:37.871359 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:37.871739 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:37.871454 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:39.582678 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:39.582642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:39.583139 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:39.582686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:39.583139 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.582785 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:39.583139 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.582807 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:39.583139 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.582853 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.58283592 +0000 UTC m=+34.138269486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:39.583139 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.582876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.582867217 +0000 UTC m=+34.138300782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:39.684044 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:39.684007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:39.684216 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.684140 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:39.684216 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.684165 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:39.684216 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.684175 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:39.684364 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.684232 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.684214924 +0000 UTC m=+34.239648501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:39.870649 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:39.870573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:39.870792 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:39.870576 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:39.870792 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.870700 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:39.870792 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.870779 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:39.870970 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:39.870581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:39.870970 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:39.870865 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:41.871508 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:41.871472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:41.871972 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:41.871583 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:41.871972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:41.871596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:41.871972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:41.871611 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:41.871972 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:41.871686 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:41.871972 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:41.871754 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:43.871636 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.871128 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:43.871636 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.871343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:43.871636 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:43.871441 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:43.871636 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:43.871535 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:43.871636 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.871597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:43.872582 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:43.871683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:43.931420 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.931396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dn79f" event={"ID":"04f51c19-9f38-46b6-885a-7edb62016ae3","Type":"ContainerStarted","Data":"57baeaa16cccf43f408ee97ed407c1c1a74b8e5fd83fc55e934a027c7a95833c"} Jul 24 04:00:43.933137 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.933064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" event={"ID":"e4a9777c-0f02-43fa-b9f2-75a579ecb330","Type":"ContainerStarted","Data":"3a4689596b780c311df30f97637a67b8edfe75eb332a144f499a69ed8bc7662b"} Jul 24 04:00:43.934369 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.934337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerStarted","Data":"00ac1ea76fdee165cd866cb5bfa5c2ec3c8cae70d70715f33d0a948169cf68d4"} Jul 24 04:00:43.939727 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.939630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" event={"ID":"d300a49b-aa64-4339-8eb6-887ca1e285c5","Type":"ContainerStarted","Data":"6ea93e3343d3bab2702607840e6ff54b573339ce70b993c2ce275e038252b92b"} Jul 24 04:00:43.942512 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.942395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"af5d1a6ba17654b96be933c4a903c44799dc543f6923e740cd303d592e5ee438"} Jul 24 04:00:43.942512 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.942474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"51b568771e60d1341b44c8cefd6c5a62906755d54dd6550b4caca58abfe75b7e"} Jul 24 04:00:43.942628 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.942527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"2c91a306ac466c1e3fc9e731f1d80a4ef30ec931b4cfe6bc094526c2cba3f81f"} Jul 24 04:00:43.944131 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.944108 2577 generic.go:356] "Generic (PLEG): container finished" podID="e800257637da25c0996475e6fab19858" containerID="843894005de3693f7a4ca9842da3aee5bc8ee4c52a62f7903bd4629db6f2e26f" exitCode=0 Jul 24 04:00:43.944205 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.944195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" event={"ID":"e800257637da25c0996475e6fab19858","Type":"ContainerDied","Data":"843894005de3693f7a4ca9842da3aee5bc8ee4c52a62f7903bd4629db6f2e26f"} Jul 24 04:00:43.945934 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.945897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lw8vp" event={"ID":"7b5ba710-58b7-4d91-9bdf-7975c314a162","Type":"ContainerStarted","Data":"9f83e4c6811490c079f0a2f26f279d4fc06fa6c5c94e2d5d12a93c40541ffc9e"} Jul 24 04:00:43.947672 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.947651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95tjs" event={"ID":"5538d024-5890-4f7f-b9f5-addedcf72489","Type":"ContainerStarted","Data":"701d2925aa1f0be6fec38f9075f4f3f72dc652b31b61430eafd91dfb1bf69601"} Jul 24 04:00:43.948871 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.948854 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xc6j8" event={"ID":"220e565f-2691-4b31-93df-02875ddbd63d","Type":"ContainerStarted","Data":"bd5ebe495847edb7fd90cdf19cee010a4841b06f2e08e2f903128e05e40f49e2"} Jul 24 04:00:43.949577 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.949535 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dn79f" podStartSLOduration=2.9569345719999998 podStartE2EDuration="21.949500112s" totalImagesPullingTime="18.99256554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.949446704 +0000 UTC m=+22.504880287" watchObservedRunningTime="2026-07-24 04:00:43.949500112 +0000 UTC m=+22.504933728" Jul 24 04:00:43.986400 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.986366 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xc6j8" podStartSLOduration=2.968472146 podStartE2EDuration="21.986352687s" totalImagesPullingTime="19.017880541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.986293182 +0000 UTC m=+22.541726779" watchObservedRunningTime="2026-07-24 04:00:43.986352687 +0000 UTC m=+22.541786273" Jul 24 04:00:43.986673 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:43.986654 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lw8vp" podStartSLOduration=7.099786346 podStartE2EDuration="21.986650037s" totalImagesPullingTime="14.886863691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.97020913 +0000 UTC m=+22.525642715" watchObservedRunningTime="2026-07-24 04:00:43.986650037 +0000 UTC m=+22.542083630" Jul 24 04:00:44.019954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.019804 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95tjs" podStartSLOduration=2.972231441 podStartE2EDuration="22.019789043s" totalImagesPullingTime="19.047557602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:44.019480841 +0000 UTC m=+22.574914427" watchObservedRunningTime="2026-07-24 04:00:44.019789043 +0000 UTC m=+22.575222644" Jul 24 04:00:44.020360 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.020310 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mqq7q" podStartSLOduration=2.993460008 podStartE2EDuration="22.020299388s" totalImagesPullingTime="19.02683938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:44.002907939 +0000 UTC m=+22.558341525" watchObservedRunningTime="2026-07-24 04:00:44.020299388 +0000 UTC m=+22.575732975" Jul 24 04:00:44.374691 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.374661 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:44.952322 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.952298 2577 generic.go:356] "Generic (PLEG): container finished" podID="d0d07eb7-df9e-45bd-806a-55e35ff2da46" containerID="00ac1ea76fdee165cd866cb5bfa5c2ec3c8cae70d70715f33d0a948169cf68d4" exitCode=0 Jul 24 04:00:44.952670 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.952378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerDied","Data":"00ac1ea76fdee165cd866cb5bfa5c2ec3c8cae70d70715f33d0a948169cf68d4"} Jul 24 04:00:44.955203 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.955184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"e809f31385d442fbc4c783879f96732455f5ba55382e1413b1d51dfa46e51afc"} Jul 24 04:00:44.955291 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.955238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"206a787512a91ffd5328760e5ddb5c0f7bd5fcf7977cc5a253e898d8b7cbfa77"} Jul 24 04:00:44.955291 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.955278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"7b018468ee6bcdac70550961908b44c148e1e1aec266914cbd484882df35e505"} Jul 24 04:00:44.956522 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:44.956472 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rvzx" event={"ID":"907bcb51-2828-4449-8906-5892dcd6a32b","Type":"ContainerStarted","Data":"e89ec48b7791aec6436b4bad76b729e8e6201db9e69dd20cd69c175166b56cd9"} Jul 24 04:00:45.042015 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.041861 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rvzx" podStartSLOduration=4.048547076 podStartE2EDuration="23.041847037s" totalImagesPullingTime="18.993299961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:45.041553396 +0000 UTC m=+23.596986983" watchObservedRunningTime="2026-07-24 04:00:45.041847037 +0000 UTC m=+23.597280624" Jul 24 04:00:45.087652 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.087630 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 04:00:45.810971 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.810856 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T04:00:45.087648185Z","UUID":"a00bd7df-b668-45eb-999d-4e414547455a","Handler":null,"Name":"","Endpoint":""} Jul 24 04:00:45.813840 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.813809 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 04:00:45.814003 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.813849 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 04:00:45.871199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.871173 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:45.871199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.871195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:45.871344 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.871173 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:45.871344 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:45.871318 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:45.871444 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:45.871426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:45.871496 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:45.871482 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:45.960337 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.960313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" event={"ID":"e800257637da25c0996475e6fab19858","Type":"ContainerStarted","Data":"303d0b770e9e9eef9f53c1e9b60ea463334a53311b5e5c6df608ef68b51c742f"} Jul 24 04:00:45.962013 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.961985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" event={"ID":"d300a49b-aa64-4339-8eb6-887ca1e285c5","Type":"ContainerStarted","Data":"8e631b01676e7551e504302a7926c02875336b794d478cb264c2ba42ea744fa4"} Jul 24 04:00:45.975143 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:45.975106 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" podStartSLOduration=22.975094994 podStartE2EDuration="22.975094994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:45.974890601 +0000 UTC m=+24.530324187" watchObservedRunningTime="2026-07-24 04:00:45.975094994 +0000 UTC m=+24.530528558" Jul 24 04:00:46.967875 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:46.967845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"af881fa426c668e6aea0ef41250b6d6b45a1bfc797aad52387a250aed4cb6a09"} Jul 24 04:00:47.826306 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.826211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:47.826975 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.826951 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:47.871255 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.871186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:47.871425 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.871186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:47.871425 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:47.871323 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:47.871425 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.871338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:47.871605 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:47.871484 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:47.871605 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:47.871556 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:47.972631 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.972599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" event={"ID":"d300a49b-aa64-4339-8eb6-887ca1e285c5","Type":"ContainerStarted","Data":"e8048ac2f0d527e654f44feeccedba438db3d5d8f533efd3317a7da0f2aeb50d"} Jul 24 04:00:47.973417 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.973393 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lw8vp" Jul 24 04:00:47.988778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:47.988733 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcnp9" podStartSLOduration=4.048135635 podStartE2EDuration="25.988716972s" totalImagesPullingTime="21.940581337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:47.988617083 +0000 UTC m=+26.544050669" watchObservedRunningTime="2026-07-24 04:00:47.988716972 +0000 UTC m=+26.544150560" Jul 24 04:00:49.870946 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.870800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:49.871506 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.870802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:49.871506 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:49.871047 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:49.871506 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:49.871133 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:49.871506 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.870802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:49.871506 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:49.871221 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:49.981134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.981094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" event={"ID":"1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f","Type":"ContainerStarted","Data":"d468b7999f005333f44d8d54b2291fff856f22831bb817394ac36c5a96eb6c94"} Jul 24 04:00:49.981559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.981497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:49.981652 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.981576 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:49.981652 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.981624 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:49.999650 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:49.999630 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:50.000294 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:50.000273 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:00:50.010172 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:50.010139 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" podStartSLOduration=8.910877765 podStartE2EDuration="28.010124987s" totalImagesPullingTime="19.099247222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:50.009654614 +0000 UTC m=+28.565088200" watchObservedRunningTime="2026-07-24 04:00:50.010124987 +0000 UTC m=+28.565558576" Jul 24 04:00:50.984757 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:50.984721 2577 generic.go:356] "Generic (PLEG): container finished" podID="d0d07eb7-df9e-45bd-806a-55e35ff2da46" containerID="d9e857b157e69da89d5edc67c2b7035d04a8f6de0a9fbcd0ff67dfb88fc60211" exitCode=0 Jul 24 04:00:50.985343 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:50.984810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerDied","Data":"d9e857b157e69da89d5edc67c2b7035d04a8f6de0a9fbcd0ff67dfb88fc60211"} Jul 24 04:00:51.871721 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:51.871539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:51.871892 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:51.871596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:51.871892 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:51.871803 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:51.871892 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:51.871619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:51.872079 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:51.871888 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:51.872079 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:51.871976 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:52.991569 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:52.991530 2577 generic.go:356] "Generic (PLEG): container finished" podID="d0d07eb7-df9e-45bd-806a-55e35ff2da46" containerID="ed8bcf06ab4c8bc0f88b1ca1aabe4c112cfd6b4cc31b3638e16894d26464b30a" exitCode=0 Jul 24 04:00:52.992049 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:52.991577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerDied","Data":"ed8bcf06ab4c8bc0f88b1ca1aabe4c112cfd6b4cc31b3638e16894d26464b30a"} Jul 24 04:00:53.872021 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:53.871937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:53.872211 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:53.872049 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:53.872327 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:53.872297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:53.872327 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:53.871937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:53.872506 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:53.872436 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:53.872563 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:53.872523 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:54.997864 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:54.997835 2577 generic.go:356] "Generic (PLEG): container finished" podID="d0d07eb7-df9e-45bd-806a-55e35ff2da46" containerID="c9bdd8feb11d389d02d9292fc2979a2b7c56df5a1f1927449b79f57dc947b7ad" exitCode=0 Jul 24 04:00:54.998323 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:54.997893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerDied","Data":"c9bdd8feb11d389d02d9292fc2979a2b7c56df5a1f1927449b79f57dc947b7ad"} Jul 24 04:00:55.606356 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:55.606324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:55.606537 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:55.606368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:55.606537 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.606477 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:55.606537 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.606493 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:55.606693 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.606549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs podName:de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c nodeName:}" failed. No retries permitted until 2026-07-24 04:01:27.606530272 +0000 UTC m=+66.161963840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs") pod "network-metrics-daemon-9wqx5" (UID: "de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:55.606693 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.606566 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret podName:fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:27.606557287 +0000 UTC m=+66.161990852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret") pod "global-pull-secret-syncer-mtgw2" (UID: "fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:55.707580 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:55.707535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:55.707735 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.707676 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:55.707735 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.707695 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:55.707735 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.707704 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6ftpm for pod openshift-network-diagnostics/network-check-target-jdgw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:55.707848 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.707753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm podName:a947c93c-f367-4956-a000-bc1c04644c59 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:27.707739685 +0000 UTC m=+66.263173249 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftpm" (UniqueName: "kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm") pod "network-check-target-jdgw2" (UID: "a947c93c-f367-4956-a000-bc1c04644c59") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:55.870741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:55.870646 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:55.870741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:55.870649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:55.871002 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.870771 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:55.871002 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.870885 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:55.871002 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:55.870904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:55.871159 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:55.871030 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:57.870398 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:57.870367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:57.870851 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:57.870373 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:57.870851 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:57.870491 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:57.870851 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:57.870583 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:57.870851 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:57.870627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:57.870851 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:57.870686 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:00:59.009438 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:59.009409 2577 generic.go:356] "Generic (PLEG): container finished" podID="d0d07eb7-df9e-45bd-806a-55e35ff2da46" containerID="c9e0db9682c411385d55c3d90341cacc8724802429529aa891b5f59567be475a" exitCode=0 Jul 24 04:00:59.009732 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:59.009478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerDied","Data":"c9e0db9682c411385d55c3d90341cacc8724802429529aa891b5f59567be475a"} Jul 24 04:00:59.871188 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:59.871150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:00:59.871368 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:59.871163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:00:59.871368 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:59.871243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:00:59.871368 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:59.871327 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:00:59.871543 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:00:59.871374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:00:59.871543 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:00:59.871487 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:00.014384 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:00.014357 2577 generic.go:356] "Generic (PLEG): container finished" podID="d0d07eb7-df9e-45bd-806a-55e35ff2da46" containerID="e0b4d58fc1158a5429582328bce5449466f397060dd924a46c859ba5c5e362d5" exitCode=0 Jul 24 04:01:00.014710 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:00.014393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerDied","Data":"e0b4d58fc1158a5429582328bce5449466f397060dd924a46c859ba5c5e362d5"} Jul 24 04:01:01.019967 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:01.019935 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" event={"ID":"d0d07eb7-df9e-45bd-806a-55e35ff2da46","Type":"ContainerStarted","Data":"14406e31dd361cdc8bcad8a7160cba8478e1281c47f73c6e1d0f9afbe016f095"} Jul 24 04:01:01.871295 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:01.871266 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:01.871445 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:01.871345 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:01:01.871445 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:01.871383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:01.871445 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:01.871420 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:01.871606 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:01.871448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:01.871606 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:01.871489 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:01:03.870818 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:03.870786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:03.870818 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:03.870811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:03.871251 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:03.870786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:03.871251 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:03.870904 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:03.871251 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:03.870993 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:01:03.871251 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:03.871077 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:01:05.871114 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:05.871082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:05.871472 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:05.871089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:05.871472 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:05.871181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:05.871472 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:05.871092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:05.871472 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:05.871258 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:01:05.871472 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:05.871323 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:01:07.690092 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.689821 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6vkb7" podStartSLOduration=15.388744118 podStartE2EDuration="45.689800802s" totalImagesPullingTime="30.301056684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:01.05010565 +0000 UTC m=+39.605539236" watchObservedRunningTime="2026-07-24 04:01:07.689800802 +0000 UTC m=+46.245234388" Jul 24 04:01:07.690749 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.690728 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtgw2"] Jul 24 04:01:07.690884 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.690869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:07.691037 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:07.691010 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:01:07.695090 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.695063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdgw2"] Jul 24 04:01:07.695230 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.695177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:07.695296 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:07.695274 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:07.695649 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.695623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9wqx5"] Jul 24 04:01:07.695768 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:07.695736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:07.695859 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:07.695837 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:01:08.870609 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:08.870581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:08.871029 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:08.870690 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:08.871029 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:08.870759 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:08.871029 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:08.870850 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:01:09.871154 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:09.871125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:09.871607 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:09.871228 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:01:10.870955 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:10.870869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:10.871091 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:10.870972 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdgw2" podUID="a947c93c-f367-4956-a000-bc1c04644c59" Jul 24 04:01:10.871091 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:10.871028 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:10.871174 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:10.871108 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtgw2" podUID="fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17" Jul 24 04:01:11.870906 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:11.870874 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:11.871079 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:11.870971 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wqx5" podUID="de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c" Jul 24 04:01:12.263971 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.263946 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeReady" Jul 24 04:01:12.264465 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.264046 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 04:01:12.297589 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.297509 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68c989b7d9-vhmq6"] Jul 24 04:01:12.310884 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.310861 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68c989b7d9-vhmq6"] Jul 24 04:01:12.311001 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.310963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.313628 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.313600 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtsnl\"" Jul 24 04:01:12.314231 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.314190 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 04:01:12.314321 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.314268 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 04:01:12.314385 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.314366 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfv9x"] Jul 24 04:01:12.314449 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.314430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 04:01:12.322394 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.322374 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 04:01:12.332447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.332427 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jjnx5"] Jul 24 04:01:12.332564 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.332553 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.335178 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335159 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 04:01:12.335275 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335227 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 04:01:12.335275 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 04:01:12.335472 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 04:01:12.335546 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335454 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzqn7\"" Jul 24 04:01:12.335546 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47dad4d5-8208-4794-892b-af5c4bc2802a-ca-trust-extracted\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335650 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjrm\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-kube-api-access-zdjrm\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335650 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-registry-tls\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335726 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47dad4d5-8208-4794-892b-af5c4bc2802a-installation-pull-secrets\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335726 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-bound-sa-token\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335805 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47dad4d5-8208-4794-892b-af5c4bc2802a-trusted-ca\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335805 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47dad4d5-8208-4794-892b-af5c4bc2802a-image-registry-private-configuration\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.335895 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.335835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47dad4d5-8208-4794-892b-af5c4bc2802a-registry-certificates\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.348045 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.348023 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jjnx5"] Jul 24 04:01:12.348045 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.348047 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfv9x"] Jul 24 04:01:12.348185 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.348132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.350551 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.350527 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 04:01:12.350551 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.350542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzt6l\"" Jul 24 04:01:12.350551 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.350527 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 04:01:12.350718 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.350577 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 04:01:12.414016 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.413992 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-69d74"] Jul 24 04:01:12.425129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.425108 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-69d74"] Jul 24 04:01:12.425129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.425125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.427793 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.427772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 04:01:12.427878 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.427825 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7mgjm\"" Jul 24 04:01:12.428312 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.428297 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 04:01:12.436847 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.436831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47dad4d5-8208-4794-892b-af5c4bc2802a-trusted-ca\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.436954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.436856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47dad4d5-8208-4794-892b-af5c4bc2802a-image-registry-private-configuration\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.436954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.436874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47dad4d5-8208-4794-892b-af5c4bc2802a-registry-certificates\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.436954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.436893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gs58\" (UniqueName: \"kubernetes.io/projected/3d225e5d-b717-4710-afed-6e9d1d745742-kube-api-access-2gs58\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.436954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.436908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-crio-socket\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.437142 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-data-volume\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.437142 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d225e5d-b717-4710-afed-6e9d1d745742-tmp-dir\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.437259 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47dad4d5-8208-4794-892b-af5c4bc2802a-ca-trust-extracted\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437259 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjrm\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-kube-api-access-zdjrm\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437259 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjsxv\" (UniqueName: \"kubernetes.io/projected/4d75cef4-bcf3-41dc-8902-990688a41166-kube-api-access-tjsxv\") pod \"ingress-canary-jjnx5\" (UID: \"4d75cef4-bcf3-41dc-8902-990688a41166\") " pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.437259 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d225e5d-b717-4710-afed-6e9d1d745742-metrics-tls\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.437259 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-registry-tls\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67n8f\" (UniqueName: \"kubernetes.io/projected/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-kube-api-access-67n8f\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d225e5d-b717-4710-afed-6e9d1d745742-config-volume\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47dad4d5-8208-4794-892b-af5c4bc2802a-installation-pull-secrets\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-bound-sa-token\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47dad4d5-8208-4794-892b-af5c4bc2802a-ca-trust-extracted\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d75cef4-bcf3-41dc-8902-990688a41166-cert\") pod \"ingress-canary-jjnx5\" (UID: \"4d75cef4-bcf3-41dc-8902-990688a41166\") " pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.437889 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47dad4d5-8208-4794-892b-af5c4bc2802a-registry-certificates\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.437889 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.437829 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47dad4d5-8208-4794-892b-af5c4bc2802a-trusted-ca\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.440938 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.440902 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47dad4d5-8208-4794-892b-af5c4bc2802a-installation-pull-secrets\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.441004 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.440976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47dad4d5-8208-4794-892b-af5c4bc2802a-image-registry-private-configuration\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.441078 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.441058 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-registry-tls\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.447745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.447720 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-bound-sa-token\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.447878 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.447858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjrm\" (UniqueName: \"kubernetes.io/projected/47dad4d5-8208-4794-892b-af5c4bc2802a-kube-api-access-zdjrm\") pod \"image-registry-68c989b7d9-vhmq6\" (UID: \"47dad4d5-8208-4794-892b-af5c4bc2802a\") " pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.538669 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.538669 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.538669 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67n8f\" (UniqueName: \"kubernetes.io/projected/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-kube-api-access-67n8f\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.538907 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d225e5d-b717-4710-afed-6e9d1d745742-config-volume\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.538907 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d75cef4-bcf3-41dc-8902-990688a41166-cert\") pod \"ingress-canary-jjnx5\" (UID: \"4d75cef4-bcf3-41dc-8902-990688a41166\") " pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.538907 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gs58\" (UniqueName: \"kubernetes.io/projected/3d225e5d-b717-4710-afed-6e9d1d745742-kube-api-access-2gs58\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.538907 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-crio-socket\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.538907 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-data-volume\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.538907 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d225e5d-b717-4710-afed-6e9d1d745742-tmp-dir\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.539215 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.538991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-crio-socket\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.539215 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.539050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjsxv\" (UniqueName: \"kubernetes.io/projected/4d75cef4-bcf3-41dc-8902-990688a41166-kube-api-access-tjsxv\") pod \"ingress-canary-jjnx5\" (UID: \"4d75cef4-bcf3-41dc-8902-990688a41166\") " pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.539215 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.539077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d225e5d-b717-4710-afed-6e9d1d745742-metrics-tls\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.539344 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.539213 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-data-volume\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.539344 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.539316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.539344 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.539319 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d225e5d-b717-4710-afed-6e9d1d745742-config-volume\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.540898 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.540880 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.541039 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.541022 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d75cef4-bcf3-41dc-8902-990688a41166-cert\") pod \"ingress-canary-jjnx5\" (UID: \"4d75cef4-bcf3-41dc-8902-990688a41166\") " pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.545787 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.545758 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d225e5d-b717-4710-afed-6e9d1d745742-tmp-dir\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.547557 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.547531 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d225e5d-b717-4710-afed-6e9d1d745742-metrics-tls\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.548102 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.548082 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gs58\" (UniqueName: \"kubernetes.io/projected/3d225e5d-b717-4710-afed-6e9d1d745742-kube-api-access-2gs58\") pod \"dns-default-69d74\" (UID: \"3d225e5d-b717-4710-afed-6e9d1d745742\") " pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.548206 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.548191 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjsxv\" (UniqueName: \"kubernetes.io/projected/4d75cef4-bcf3-41dc-8902-990688a41166-kube-api-access-tjsxv\") pod \"ingress-canary-jjnx5\" (UID: \"4d75cef4-bcf3-41dc-8902-990688a41166\") " pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.548390 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.548375 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67n8f\" (UniqueName: \"kubernetes.io/projected/86d73e34-7d4e-4e88-a67e-6a9005da3d3e-kube-api-access-67n8f\") pod \"insights-runtime-extractor-wfv9x\" (UID: \"86d73e34-7d4e-4e88-a67e-6a9005da3d3e\") " pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.624372 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.624345 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:12.640351 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.640332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfv9x" Jul 24 04:01:12.655614 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.655591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jjnx5" Jul 24 04:01:12.734061 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.733645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-69d74" Jul 24 04:01:12.815048 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.815021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfv9x"] Jul 24 04:01:12.819560 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.819526 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68c989b7d9-vhmq6"] Jul 24 04:01:12.819627 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.819581 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jjnx5"] Jul 24 04:01:12.821837 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:12.821810 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d75cef4_bcf3_41dc_8902_990688a41166.slice/crio-e127992bff6a9ad07af90ed3a62aa34e9587886b28397baa04d0ff7c944568ee WatchSource:0}: Error finding container e127992bff6a9ad07af90ed3a62aa34e9587886b28397baa04d0ff7c944568ee: Status 404 returned error can't find the container with id e127992bff6a9ad07af90ed3a62aa34e9587886b28397baa04d0ff7c944568ee Jul 24 04:01:12.826703 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:12.826679 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47dad4d5_8208_4794_892b_af5c4bc2802a.slice/crio-b2fba64532973977f169d8c2bf7ef80562317dc69b5ad6cba686c04962536a11 WatchSource:0}: Error finding container b2fba64532973977f169d8c2bf7ef80562317dc69b5ad6cba686c04962536a11: Status 404 returned error can't find the container with id b2fba64532973977f169d8c2bf7ef80562317dc69b5ad6cba686c04962536a11 Jul 24 04:01:12.870797 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.870779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:12.870997 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.870972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:12.873515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.873472 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j89kf\"" Jul 24 04:01:12.873515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.873486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 04:01:12.873515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.873486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 04:01:12.873754 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.873491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 04:01:12.875488 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:12.875368 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-69d74"] Jul 24 04:01:12.887888 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:12.887868 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d225e5d_b717_4710_afed_6e9d1d745742.slice/crio-7d4264ce35075c02a163ebbb08620f2f92f210d713c2a4e4ac48aa47d7ac8676 WatchSource:0}: Error finding container 7d4264ce35075c02a163ebbb08620f2f92f210d713c2a4e4ac48aa47d7ac8676: Status 404 returned error can't find the container with id 7d4264ce35075c02a163ebbb08620f2f92f210d713c2a4e4ac48aa47d7ac8676 Jul 24 04:01:13.047376 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.047340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-69d74" event={"ID":"3d225e5d-b717-4710-afed-6e9d1d745742","Type":"ContainerStarted","Data":"7d4264ce35075c02a163ebbb08620f2f92f210d713c2a4e4ac48aa47d7ac8676"} Jul 24 04:01:13.048313 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.048287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv9x" event={"ID":"86d73e34-7d4e-4e88-a67e-6a9005da3d3e","Type":"ContainerStarted","Data":"1f0b60e18f582c555b0d37ca9881e847f5fe091445360056fea03cce8da1e668"} Jul 24 04:01:13.049661 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.049638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" event={"ID":"47dad4d5-8208-4794-892b-af5c4bc2802a","Type":"ContainerStarted","Data":"03bfedabd5ff9258f7c223eab4b3d68ffeb4892221be00631b469a1bd5f6360f"} Jul 24 04:01:13.049741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.049672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" event={"ID":"47dad4d5-8208-4794-892b-af5c4bc2802a","Type":"ContainerStarted","Data":"b2fba64532973977f169d8c2bf7ef80562317dc69b5ad6cba686c04962536a11"} Jul 24 04:01:13.049741 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.049714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:13.050824 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.050760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jjnx5" event={"ID":"4d75cef4-bcf3-41dc-8902-990688a41166","Type":"ContainerStarted","Data":"e127992bff6a9ad07af90ed3a62aa34e9587886b28397baa04d0ff7c944568ee"} Jul 24 04:01:13.069161 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.069114 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" podStartSLOduration=7.069098122 podStartE2EDuration="7.069098122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:13.067371405 +0000 UTC m=+51.622804992" watchObservedRunningTime="2026-07-24 04:01:13.069098122 +0000 UTC m=+51.624531709" Jul 24 04:01:13.873730 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.873134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:13.877153 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.876809 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtpl8\"" Jul 24 04:01:13.877153 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:13.876810 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 04:01:19.070028 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.069756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jjnx5" event={"ID":"4d75cef4-bcf3-41dc-8902-990688a41166","Type":"ContainerStarted","Data":"a4d4cf0f434f7a2dd0983d9fd32840df1f692431b1684d517ec9cf01c284769f"} Jul 24 04:01:19.071538 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.071509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-69d74" event={"ID":"3d225e5d-b717-4710-afed-6e9d1d745742","Type":"ContainerStarted","Data":"829394469d9e33077ae9042801174ccc79048b8d1884792e788bb20c577844cc"} Jul 24 04:01:19.071662 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.071555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-69d74" event={"ID":"3d225e5d-b717-4710-afed-6e9d1d745742","Type":"ContainerStarted","Data":"9f0bc699e1288b1f0c2fcb2df4628b0451b8ab49f1cd5e06fadbe51e253c5324"} Jul 24 04:01:19.071662 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.071598 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-69d74" Jul 24 04:01:19.072884 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.072864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv9x" event={"ID":"86d73e34-7d4e-4e88-a67e-6a9005da3d3e","Type":"ContainerStarted","Data":"39da3d64ed3f6d071d63a0cd5b9531781b447291563397eb2ea3af6be94056e7"} Jul 24 04:01:19.086184 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.086143 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jjnx5" podStartSLOduration=1.21681646 podStartE2EDuration="7.086132482s" totalImagesPullingTime="5.869316022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:19.084724518 +0000 UTC m=+57.640158104" watchObservedRunningTime="2026-07-24 04:01:19.086132482 +0000 UTC m=+57.641566068" Jul 24 04:01:19.101608 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:19.101559 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-69d74" podStartSLOduration=1.298597485 podStartE2EDuration="7.101540907s" totalImagesPullingTime="5.802943422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:19.100559246 +0000 UTC m=+57.655992832" watchObservedRunningTime="2026-07-24 04:01:19.101540907 +0000 UTC m=+57.656974474" Jul 24 04:01:22.000994 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.000960 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcgwj" Jul 24 04:01:22.557854 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.557816 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s"] Jul 24 04:01:22.585739 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.585717 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95vdx"] Jul 24 04:01:22.585865 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.585832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.588135 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.588104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 04:01:22.588259 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.588226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 04:01:22.588334 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.588252 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 04:01:22.588428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.588412 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 04:01:22.589492 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.589478 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 04:01:22.589492 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.589485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z62k4\"" Jul 24 04:01:22.601863 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.601845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s"] Jul 24 04:01:22.601976 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.601961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.604383 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.604360 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 04:01:22.604489 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.604428 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rdgpg\"" Jul 24 04:01:22.604768 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.604734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 04:01:22.604869 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.604769 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 04:01:22.619656 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.619636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d766dac9-be04-411a-bead-62b6aa513898-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.619748 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.619680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv8tj\" (UniqueName: \"kubernetes.io/projected/d766dac9-be04-411a-bead-62b6aa513898-kube-api-access-vv8tj\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.619748 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.619710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d766dac9-be04-411a-bead-62b6aa513898-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.619827 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.619767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d766dac9-be04-411a-bead-62b6aa513898-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.720475 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d766dac9-be04-411a-bead-62b6aa513898-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.720626 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvvv4\" (UniqueName: \"kubernetes.io/projected/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-kube-api-access-jvvv4\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.720626 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv8tj\" (UniqueName: \"kubernetes.io/projected/d766dac9-be04-411a-bead-62b6aa513898-kube-api-access-vv8tj\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.720626 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-metrics-client-ca\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.720745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d766dac9-be04-411a-bead-62b6aa513898-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.720745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-sys\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.720745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-textfile\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.720849 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d766dac9-be04-411a-bead-62b6aa513898-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.720849 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-tls\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.720849 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-wtmp\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.721017 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.721017 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.721017 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.720889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-root\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.721291 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.721275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d766dac9-be04-411a-bead-62b6aa513898-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.724354 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.724336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d766dac9-be04-411a-bead-62b6aa513898-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.724460 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.724356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d766dac9-be04-411a-bead-62b6aa513898-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.728169 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.728147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv8tj\" (UniqueName: \"kubernetes.io/projected/d766dac9-be04-411a-bead-62b6aa513898-kube-api-access-vv8tj\") pod \"openshift-state-metrics-b8f49f5c6-6sj7s\" (UID: \"d766dac9-be04-411a-bead-62b6aa513898\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:22.822287 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822287 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-root\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822287 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvvv4\" (UniqueName: \"kubernetes.io/projected/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-kube-api-access-jvvv4\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-metrics-client-ca\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-sys\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822384 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-root\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-textfile\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822487 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-sys\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-tls\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822559 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-wtmp\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:22.822592 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:22.822658 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-tls podName:0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:23.32263812 +0000 UTC m=+61.878071700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-tls") pod "node-exporter-95vdx" (UID: "0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8") : secret "node-exporter-tls" not found Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822677 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-textfile\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822743 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-wtmp\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822849 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-metrics-client-ca\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.822954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.822861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.824650 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.824633 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.830839 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.830816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvvv4\" (UniqueName: \"kubernetes.io/projected/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-kube-api-access-jvvv4\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:22.895267 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:22.895249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" Jul 24 04:01:23.119048 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.119025 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s"] Jul 24 04:01:23.121661 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:23.121637 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd766dac9_be04_411a_bead_62b6aa513898.slice/crio-78ad75b7a18ddb23e0d4bb286e6a2e41ddf488b5289503eff88dbd550ad892b8 WatchSource:0}: Error finding container 78ad75b7a18ddb23e0d4bb286e6a2e41ddf488b5289503eff88dbd550ad892b8: Status 404 returned error can't find the container with id 78ad75b7a18ddb23e0d4bb286e6a2e41ddf488b5289503eff88dbd550ad892b8 Jul 24 04:01:23.329736 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.329670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-tls\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:23.331724 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.331702 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8-node-exporter-tls\") pod \"node-exporter-95vdx\" (UID: \"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8\") " pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:23.511654 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.511618 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95vdx" Jul 24 04:01:23.520670 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:23.520648 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfd48aa_6a17_4eb0_a065_6539e0b0c8d8.slice/crio-0bc307957f77a5b2d4400e46ad19ae3ecf656b5759e20758757b60a42cbf1548 WatchSource:0}: Error finding container 0bc307957f77a5b2d4400e46ad19ae3ecf656b5759e20758757b60a42cbf1548: Status 404 returned error can't find the container with id 0bc307957f77a5b2d4400e46ad19ae3ecf656b5759e20758757b60a42cbf1548 Jul 24 04:01:23.664199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.664143 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:01:23.668099 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.668083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.670891 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.670867 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 04:01:23.671016 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671000 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 04:01:23.671087 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671023 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 04:01:23.671087 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 04:01:23.671087 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 04:01:23.671253 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 04:01:23.671316 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671289 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 04:01:23.671447 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 04:01:23.671571 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 04:01:23.671571 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.671520 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rql55\"" Jul 24 04:01:23.681300 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.681277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:01:23.732853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.732826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-out\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.732979 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.732867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.732979 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.732904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-web-config\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.732979 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.732966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-volume\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zsgk\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-kube-api-access-5zsgk\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733328 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733328 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733328 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733328 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.733328 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.733309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-web-config\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-volume\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zsgk\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-kube-api-access-5zsgk\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-out\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.834949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.834889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.835645 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:23.835079 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 24 04:01:23.835645 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:23.835149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle podName:db22b9fa-ec47-4f57-ab33-a404bb1dd751 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:24.335125202 +0000 UTC m=+62.890558767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751") : configmap references non-existent config key: ca-bundle.crt Jul 24 04:01:23.835645 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:01:23.835173 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls podName:db22b9fa-ec47-4f57-ab33-a404bb1dd751 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:24.335163565 +0000 UTC m=+62.890597136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751") : secret "alertmanager-main-tls" not found Jul 24 04:01:23.835645 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.835431 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.836618 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.836199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.838275 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.838231 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.839036 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.839013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.839187 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.839166 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.839510 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.839489 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.839603 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.839586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-web-config\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.840029 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.840009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.840491 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.840453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-out\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.840834 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.840810 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-volume\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:23.844236 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:23.844217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zsgk\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-kube-api-access-5zsgk\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:24.098851 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.098807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv9x" event={"ID":"86d73e34-7d4e-4e88-a67e-6a9005da3d3e","Type":"ContainerStarted","Data":"ffe2bfe5244d4fa484dcdee22decfaee1c010563f9d4c0f6debe67236da1b7d9"} Jul 24 04:01:24.100469 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.100436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95vdx" event={"ID":"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8","Type":"ContainerStarted","Data":"0bc307957f77a5b2d4400e46ad19ae3ecf656b5759e20758757b60a42cbf1548"} Jul 24 04:01:24.102432 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.102375 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" event={"ID":"d766dac9-be04-411a-bead-62b6aa513898","Type":"ContainerStarted","Data":"69bd879c237344b8f252599a9d29d18a79c91890280a56e1784e69f565b28634"} Jul 24 04:01:24.102432 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.102419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" event={"ID":"d766dac9-be04-411a-bead-62b6aa513898","Type":"ContainerStarted","Data":"cc4bdc103933adc5c4f076537deae4e4dcf1be989cc0896c3d71c3b8d260426f"} Jul 24 04:01:24.102585 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.102446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" event={"ID":"d766dac9-be04-411a-bead-62b6aa513898","Type":"ContainerStarted","Data":"78ad75b7a18ddb23e0d4bb286e6a2e41ddf488b5289503eff88dbd550ad892b8"} Jul 24 04:01:24.339778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.339739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:24.340253 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.339818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:24.340719 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.340689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:24.342879 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.342841 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:24.579468 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.578030 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d6f7587-wkr8p"] Jul 24 04:01:24.579468 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.578064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:01:24.581505 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.581494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.584964 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.584877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 04:01:24.585786 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.585512 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3vaoojf2n1uf6\"" Jul 24 04:01:24.585786 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.585552 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 04:01:24.585786 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.585597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 04:01:24.586515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.586234 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 04:01:24.586515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.586303 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 04:01:24.586515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.586242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bpbfz\"" Jul 24 04:01:24.597974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.597878 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d6f7587-wkr8p"] Jul 24 04:01:24.643005 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.642975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643119 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95946799-1314-4421-ab2d-19e5ba53becf-metrics-client-ca\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643119 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643119 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643281 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-grpc-tls\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643281 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643281 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xhz\" (UniqueName: \"kubernetes.io/projected/95946799-1314-4421-ab2d-19e5ba53becf-kube-api-access-m6xhz\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.643281 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.643267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-tls\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.743695 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.743831 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-grpc-tls\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.743831 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.743831 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xhz\" (UniqueName: \"kubernetes.io/projected/95946799-1314-4421-ab2d-19e5ba53becf-kube-api-access-m6xhz\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.743831 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-tls\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.744113 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.744113 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95946799-1314-4421-ab2d-19e5ba53becf-metrics-client-ca\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.744113 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.743980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.744960 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.744878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95946799-1314-4421-ab2d-19e5ba53becf-metrics-client-ca\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.747225 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.746607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.747225 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.746792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.747225 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.747003 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.747438 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.747336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-tls\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.747763 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.747744 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-grpc-tls\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.748365 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.748344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/95946799-1314-4421-ab2d-19e5ba53becf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.752860 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.752842 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xhz\" (UniqueName: \"kubernetes.io/projected/95946799-1314-4421-ab2d-19e5ba53becf-kube-api-access-m6xhz\") pod \"thanos-querier-7d6f7587-wkr8p\" (UID: \"95946799-1314-4421-ab2d-19e5ba53becf\") " pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.893160 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.893131 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:24.953722 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:24.953693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:01:25.006978 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:25.006943 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22b9fa_ec47_4f57_ab33_a404bb1dd751.slice/crio-29ef3756686736d427b9168236aa66217e4316347054a4cb06aaa1205aecc2e2 WatchSource:0}: Error finding container 29ef3756686736d427b9168236aa66217e4316347054a4cb06aaa1205aecc2e2: Status 404 returned error can't find the container with id 29ef3756686736d427b9168236aa66217e4316347054a4cb06aaa1205aecc2e2 Jul 24 04:01:25.037068 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.037003 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d6f7587-wkr8p"] Jul 24 04:01:25.040040 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:25.040012 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95946799_1314_4421_ab2d_19e5ba53becf.slice/crio-c957e9b559f686ac39618accafa2a13f9c595be117a27d3768876ee8b1b107a2 WatchSource:0}: Error finding container c957e9b559f686ac39618accafa2a13f9c595be117a27d3768876ee8b1b107a2: Status 404 returned error can't find the container with id c957e9b559f686ac39618accafa2a13f9c595be117a27d3768876ee8b1b107a2 Jul 24 04:01:25.107515 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.107430 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8" containerID="05cdf5e8e6adc8f0b8f29cf502410c1b8269dcfde79b267cae583c932c1c23b6" exitCode=0 Jul 24 04:01:25.107652 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.107520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95vdx" event={"ID":"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8","Type":"ContainerDied","Data":"05cdf5e8e6adc8f0b8f29cf502410c1b8269dcfde79b267cae583c932c1c23b6"} Jul 24 04:01:25.109891 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.109867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" event={"ID":"d766dac9-be04-411a-bead-62b6aa513898","Type":"ContainerStarted","Data":"3603fc4a3da834724de2f7792acf554431c450fb685cdb34fbbb8e2bb75868d8"} Jul 24 04:01:25.111358 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.111332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"c957e9b559f686ac39618accafa2a13f9c595be117a27d3768876ee8b1b107a2"} Jul 24 04:01:25.112834 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.112814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"29ef3756686736d427b9168236aa66217e4316347054a4cb06aaa1205aecc2e2"} Jul 24 04:01:25.140421 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:25.140378 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6sj7s" podStartSLOduration=1.5703740050000001 podStartE2EDuration="3.140359465s" totalImagesPullingTime="1.56998546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:25.139438657 +0000 UTC m=+63.694872243" watchObservedRunningTime="2026-07-24 04:01:25.140359465 +0000 UTC m=+63.695793055" Jul 24 04:01:26.119162 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:26.119121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95vdx" event={"ID":"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8","Type":"ContainerStarted","Data":"1339f8cf89e0d6938f553074ae37cd4fb49a8fde2debeea63bee94198fcfff8d"} Jul 24 04:01:26.119614 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:26.119191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95vdx" event={"ID":"0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8","Type":"ContainerStarted","Data":"dcc95a72fb3e0d9af104a811215f19ead83dfc662700c8a0f9e25b32139a41a4"} Jul 24 04:01:26.139834 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:26.139792 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95vdx" podStartSLOduration=2.788281529 podStartE2EDuration="4.139777559s" totalImagesPullingTime="1.271038256s" totalInitContainerRuntime="80.457774ms" isStatefulPod=true podCreationTimestamp="2026-07-24 04:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:26.138904773 +0000 UTC m=+64.694338353" watchObservedRunningTime="2026-07-24 04:01:26.139777559 +0000 UTC m=+64.695211124" Jul 24 04:01:27.127059 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.127009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv9x" event={"ID":"86d73e34-7d4e-4e88-a67e-6a9005da3d3e","Type":"ContainerStarted","Data":"1535baf56090cd42240d496609a3f9c81d1ddc2917ec45a7c3c9a07d4223e777"} Jul 24 04:01:27.146034 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.145935 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfv9x" podStartSLOduration=1.270204913 podStartE2EDuration="15.145896785s" totalImagesPullingTime="13.875691872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:01:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:27.144663486 +0000 UTC m=+65.700097072" watchObservedRunningTime="2026-07-24 04:01:27.145896785 +0000 UTC m=+65.701330372" Jul 24 04:01:27.671470 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.671438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:27.671596 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.671495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:27.673913 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.673891 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 04:01:27.674037 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.673971 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 04:01:27.684377 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.684352 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17-original-pull-secret\") pod \"global-pull-secret-syncer-mtgw2\" (UID: \"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17\") " pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:27.684501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.684429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c-metrics-certs\") pod \"network-metrics-daemon-9wqx5\" (UID: \"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c\") " pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:27.687428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.687408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtpl8\"" Jul 24 04:01:27.695538 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.695512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wqx5" Jul 24 04:01:27.772313 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.772284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:27.774984 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.774946 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 04:01:27.785724 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.785252 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 04:01:27.796191 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.796167 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftpm\" (UniqueName: \"kubernetes.io/projected/a947c93c-f367-4956-a000-bc1c04644c59-kube-api-access-6ftpm\") pod \"network-check-target-jdgw2\" (UID: \"a947c93c-f367-4956-a000-bc1c04644c59\") " pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:27.832010 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.831981 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9wqx5"] Jul 24 04:01:27.834851 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:27.834828 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1dcdf0_f0f3_4fd9_93a5_6a2ca27f626c.slice/crio-830ae24c14a8d7af1fe12527e5f8cf0ffa25690185de168dac4148656ddcd96e WatchSource:0}: Error finding container 830ae24c14a8d7af1fe12527e5f8cf0ffa25690185de168dac4148656ddcd96e: Status 404 returned error can't find the container with id 830ae24c14a8d7af1fe12527e5f8cf0ffa25690185de168dac4148656ddcd96e Jul 24 04:01:27.901894 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.901868 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j89kf\"" Jul 24 04:01:27.903993 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.903969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtgw2" Jul 24 04:01:27.909791 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:27.909755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:28.131652 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.131614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wqx5" event={"ID":"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c","Type":"ContainerStarted","Data":"830ae24c14a8d7af1fe12527e5f8cf0ffa25690185de168dac4148656ddcd96e"} Jul 24 04:01:28.133334 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.133306 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f" exitCode=0 Jul 24 04:01:28.133444 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.133402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f"} Jul 24 04:01:28.533393 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.533358 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdgw2"] Jul 24 04:01:28.536815 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:28.536787 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda947c93c_f367_4956_a000_bc1c04644c59.slice/crio-6b1eda507d8032604606e11aae5548c846e1e4d8085e4b8b3437b9e2eb7a7ed0 WatchSource:0}: Error finding container 6b1eda507d8032604606e11aae5548c846e1e4d8085e4b8b3437b9e2eb7a7ed0: Status 404 returned error can't find the container with id 6b1eda507d8032604606e11aae5548c846e1e4d8085e4b8b3437b9e2eb7a7ed0 Jul 24 04:01:28.550234 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.550173 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtgw2"] Jul 24 04:01:28.552860 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:28.552832 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7b5caf_e7b9_44d1_b8e7_d3f51a885d17.slice/crio-e97c6b0475b1718d7bbbd0810b0a6ba8de84a35329010e4b0011a1614617e699 WatchSource:0}: Error finding container e97c6b0475b1718d7bbbd0810b0a6ba8de84a35329010e4b0011a1614617e699: Status 404 returned error can't find the container with id e97c6b0475b1718d7bbbd0810b0a6ba8de84a35329010e4b0011a1614617e699 Jul 24 04:01:28.790600 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.790571 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:01:28.811130 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.811075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.817210 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.813985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 04:01:28.817210 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.815750 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 04:01:28.817210 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.816943 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8hpqkji3slc40\"" Jul 24 04:01:28.817804 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.817781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 04:01:28.818620 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.818518 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 04:01:28.818843 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.818766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 04:01:28.819011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.818990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 04:01:28.820016 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.819997 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 04:01:28.820159 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820134 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 04:01:28.820304 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820289 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 04:01:28.820383 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 04:01:28.820595 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820571 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:01:28.820784 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 04:01:28.820857 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820690 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 04:01:28.820969 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.820635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 04:01:28.821160 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.821040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 04:01:28.821160 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.821125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fqv8g\"" Jul 24 04:01:28.821326 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.821294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 04:01:28.881987 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.881870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.881987 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.881938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.881992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hlmw\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-kube-api-access-2hlmw\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.882567 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.882514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983106 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983106 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983598 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hlmw\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-kube-api-access-2hlmw\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983598 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983598 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983598 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983598 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983598 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983872 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983872 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983872 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983872 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.983872 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.983732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.984130 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.984019 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.984186 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.984125 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.984237 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.984179 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.984855 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.984601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.984855 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.984651 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.984855 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.984729 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.986243 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.985951 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.986538 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.986488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.988228 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.988180 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.988476 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.988453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.989340 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.989294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.989463 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.989441 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.989520 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.989459 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.989520 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.989470 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.989613 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.989533 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.989696 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.989656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.990233 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.990212 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.990683 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.990656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.990994 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.990977 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:28.993078 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:28.993055 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hlmw\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-kube-api-access-2hlmw\") pod \"prometheus-k8s-0\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:29.077936 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.077894 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-69d74" Jul 24 04:01:29.126944 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.126900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:01:29.138985 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.138959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdgw2" event={"ID":"a947c93c-f367-4956-a000-bc1c04644c59","Type":"ContainerStarted","Data":"6b1eda507d8032604606e11aae5548c846e1e4d8085e4b8b3437b9e2eb7a7ed0"} Jul 24 04:01:29.141620 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.141594 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"b7fc5bb965f1577ce9e50ce0f037ddfa358abc382ba49e7a89012d4b7035c937"} Jul 24 04:01:29.141745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.141666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"303cfe0fd7781896541c290cec22ab1d944f253870b128753d7349a6fcb1a5e3"} Jul 24 04:01:29.141745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.141710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"f7b2a1787686b08c15f8bf1a38bf4cedc22274bc3473953bf44582be04ef35e5"} Jul 24 04:01:29.142852 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.142827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtgw2" event={"ID":"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17","Type":"ContainerStarted","Data":"e97c6b0475b1718d7bbbd0810b0a6ba8de84a35329010e4b0011a1614617e699"} Jul 24 04:01:29.294252 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:29.294225 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:01:29.297671 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:01:29.297647 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cd9119_66ed_40f8_8acf_a0b3c1dd9189.slice/crio-f3c8cac2175da9de6f68d3eaaee27b7946fe86753cdb9169e90f63bec619bbc5 WatchSource:0}: Error finding container f3c8cac2175da9de6f68d3eaaee27b7946fe86753cdb9169e90f63bec619bbc5: Status 404 returned error can't find the container with id f3c8cac2175da9de6f68d3eaaee27b7946fe86753cdb9169e90f63bec619bbc5 Jul 24 04:01:30.152005 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:30.151969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"10ed0c68ef7996998d41b538b75eb2359397521be25e4cfb84777a581b38d3f4"} Jul 24 04:01:30.152318 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:30.152100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"f3c8cac2175da9de6f68d3eaaee27b7946fe86753cdb9169e90f63bec619bbc5"} Jul 24 04:01:31.157947 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.157819 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="10ed0c68ef7996998d41b538b75eb2359397521be25e4cfb84777a581b38d3f4" exitCode=0 Jul 24 04:01:31.157947 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.157858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"10ed0c68ef7996998d41b538b75eb2359397521be25e4cfb84777a581b38d3f4"} Jul 24 04:01:31.161893 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.161867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"3a938d92217f130569d8f99bde4050b64bc9c5427d34b57117566544f39501e9"} Jul 24 04:01:31.162035 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.161959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"9c4b4165ca7f79c476beeb45864965e1e466997b44efd458f614b25af331fd76"} Jul 24 04:01:31.162035 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.161989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" event={"ID":"95946799-1314-4421-ab2d-19e5ba53becf","Type":"ContainerStarted","Data":"f3953a936c6ffab2954d089b2c81b4c682732bdb469e0a25aed8b879607c50ec"} Jul 24 04:01:31.162035 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.162031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:31.166017 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.165993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d"} Jul 24 04:01:31.166119 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.166066 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced"} Jul 24 04:01:31.166119 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.166112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0"} Jul 24 04:01:31.166232 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.166161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024"} Jul 24 04:01:31.166232 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.166204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae"} Jul 24 04:01:31.166329 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.166242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerStarted","Data":"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee"} Jul 24 04:01:31.168094 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.168073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wqx5" event={"ID":"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c","Type":"ContainerStarted","Data":"52e2f4f69e3cd8e8be8e49288b6889d61ff15357fb1a51477d55a5d638e3b4fd"} Jul 24 04:01:31.168167 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.168116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wqx5" event={"ID":"de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c","Type":"ContainerStarted","Data":"445065599f2a9a3277b4d61b7cd9f17e03eb2ea7fd5dcd9732844e854c4cf9a6"} Jul 24 04:01:31.212502 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.212456 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.345026031 podStartE2EDuration="8.212437983s" totalImagesPullingTime="4.843587681s" totalInitContainerRuntime="23.824271ms" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:31.209846467 +0000 UTC m=+69.765280056" watchObservedRunningTime="2026-07-24 04:01:31.212437983 +0000 UTC m=+69.767871573" Jul 24 04:01:31.236756 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:31.236705 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" podStartSLOduration=1.946864763 podStartE2EDuration="7.236687723s" totalImagesPullingTime="5.28982296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:31.234843827 +0000 UTC m=+69.790277404" watchObservedRunningTime="2026-07-24 04:01:31.236687723 +0000 UTC m=+69.792121321" Jul 24 04:01:34.059161 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:34.059128 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68c989b7d9-vhmq6" Jul 24 04:01:34.080367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:34.080314 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9wqx5" podStartSLOduration=69.885894914 podStartE2EDuration="1m12.080298122s" totalImagesPullingTime="2.194403208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:31.252681406 +0000 UTC m=+69.808114993" watchObservedRunningTime="2026-07-24 04:01:34.080298122 +0000 UTC m=+72.635731707" Jul 24 04:01:36.190639 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.190600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtgw2" event={"ID":"fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17","Type":"ContainerStarted","Data":"609409f9090f9362c5cc4542ba9939780cdca882539d4618e8aa2fd26e85db62"} Jul 24 04:01:36.194592 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.194556 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"53325ffbb0e10892dc13748fd6b8a5a1166a8a50a4842ec37f17255940597b8b"} Jul 24 04:01:36.194745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.194634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"d2ea580d13dd665956d4a6941e3c8087674dbdd79748e74fb518b6695fe1ce3a"} Jul 24 04:01:36.194745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.194679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"e43e8ebb1c26e6f46adedb6c5e21d5f65d5782128afd02da1ab3478e83a58e19"} Jul 24 04:01:36.194745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.194711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"0159a68d1a5d2c6de60d79539a057e90e6d07b7bf6a085829b789e87027331b6"} Jul 24 04:01:36.194745 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.194738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"78ccc5eb5f932eb716c02d3d8e40d3083c0e978dccaa55525278d7e1d24aa563"} Jul 24 04:01:36.194998 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.194778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerStarted","Data":"dc72779d761ee4644912984bdeb3bd35295559acd20e3d631e45b03b30245f74"} Jul 24 04:01:36.196249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.196225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdgw2" event={"ID":"a947c93c-f367-4956-a000-bc1c04644c59","Type":"ContainerStarted","Data":"d12b2a7986e8530584205f61fa78ed6c616ed119817bf583d35f4a2c0dfb1033"} Jul 24 04:01:36.196384 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.196351 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:01:36.224422 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.224374 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtgw2" podStartSLOduration=67.406955228 podStartE2EDuration="1m14.224362255s" totalImagesPullingTime="6.817407027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:36.224231435 +0000 UTC m=+74.779665022" watchObservedRunningTime="2026-07-24 04:01:36.224362255 +0000 UTC m=+74.779795839" Jul 24 04:01:36.244758 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.244721 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jdgw2" podStartSLOduration=67.401240497 podStartE2EDuration="1m14.244708839s" totalImagesPullingTime="6.843468342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:36.244208995 +0000 UTC m=+74.799642582" watchObservedRunningTime="2026-07-24 04:01:36.244708839 +0000 UTC m=+74.800142425" Jul 24 04:01:36.274709 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:36.274666 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.987132459 podStartE2EDuration="8.274648404s" totalImagesPullingTime="4.263723924s" totalInitContainerRuntime="23.792021ms" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:36.27285262 +0000 UTC m=+74.828286205" watchObservedRunningTime="2026-07-24 04:01:36.274648404 +0000 UTC m=+74.830081990" Jul 24 04:01:37.180159 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:37.180132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d6f7587-wkr8p" Jul 24 04:01:39.127954 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:01:39.127898 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:07.202087 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:07.202057 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jdgw2" Jul 24 04:02:29.127215 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:29.127177 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:29.145466 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:29.145438 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:29.406109 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:29.406039 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:42.891574 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.891535 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:02:42.892101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.891852 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="alertmanager" containerID="cri-o://40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee" gracePeriod=120 Jul 24 04:02:42.892101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.891886 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-metric" containerID="cri-o://f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced" gracePeriod=120 Jul 24 04:02:42.892101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.891946 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-web" containerID="cri-o://1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024" gracePeriod=120 Jul 24 04:02:42.892101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.891982 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="prom-label-proxy" containerID="cri-o://785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d" gracePeriod=120 Jul 24 04:02:42.892101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.891988 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="config-reloader" containerID="cri-o://70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae" gracePeriod=120 Jul 24 04:02:42.892101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:42.892000 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy" containerID="cri-o://a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0" gracePeriod=120 Jul 24 04:02:43.446709 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446676 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d" exitCode=0 Jul 24 04:02:43.446709 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446700 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0" exitCode=0 Jul 24 04:02:43.446709 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446706 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae" exitCode=0 Jul 24 04:02:43.446709 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446712 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee" exitCode=0 Jul 24 04:02:43.446976 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d"} Jul 24 04:02:43.446976 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0"} Jul 24 04:02:43.446976 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae"} Jul 24 04:02:43.446976 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:43.446834 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee"} Jul 24 04:02:44.129949 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.129906 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.164255 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164230 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zsgk\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-kube-api-access-5zsgk\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164264 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-out\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164282 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164320 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-web\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164376 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-web-config\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164410 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164398 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-metrics-client-ca\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164424 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164452 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-metric\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164480 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-main-db\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164509 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-volume\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164542 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-tls-assets\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.164667 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.164604 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-cluster-tls-config\") pod \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\" (UID: \"db22b9fa-ec47-4f57-ab33-a404bb1dd751\") " Jul 24 04:02:44.165778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.165747 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:44.166155 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.166099 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:44.168100 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.168028 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:02:44.168557 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.168496 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-kube-api-access-5zsgk" (OuterVolumeSpecName: "kube-api-access-5zsgk") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "kube-api-access-5zsgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:02:44.169322 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.169255 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.169501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.169466 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.169766 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.169695 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-volume" (OuterVolumeSpecName: "config-volume") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.170027 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.169994 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.170624 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.170593 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.170782 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.170755 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:02:44.170991 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.170941 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-out" (OuterVolumeSpecName: "config-out") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:02:44.173658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.173634 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.180128 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.180103 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-web-config" (OuterVolumeSpecName: "web-config") pod "db22b9fa-ec47-4f57-ab33-a404bb1dd751" (UID: "db22b9fa-ec47-4f57-ab33-a404bb1dd751"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:44.265853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265800 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-main-tls\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.265853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265822 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-tls-assets\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.265853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265830 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-cluster-tls-config\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.265853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265840 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zsgk\" (UniqueName: \"kubernetes.io/projected/db22b9fa-ec47-4f57-ab33-a404bb1dd751-kube-api-access-5zsgk\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.265853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265848 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-out\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265857 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265867 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265876 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-web-config\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265884 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db22b9fa-ec47-4f57-ab33-a404bb1dd751-metrics-client-ca\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265892 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265901 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265910 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db22b9fa-ec47-4f57-ab33-a404bb1dd751-alertmanager-main-db\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.266088 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.265934 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db22b9fa-ec47-4f57-ab33-a404bb1dd751-config-volume\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:44.453120 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453086 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced" exitCode=0 Jul 24 04:02:44.453120 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453119 2577 generic.go:356] "Generic (PLEG): container finished" podID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerID="1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024" exitCode=0 Jul 24 04:02:44.453283 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453139 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced"} Jul 24 04:02:44.453283 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453166 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.453283 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024"} Jul 24 04:02:44.453283 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db22b9fa-ec47-4f57-ab33-a404bb1dd751","Type":"ContainerDied","Data":"29ef3756686736d427b9168236aa66217e4316347054a4cb06aaa1205aecc2e2"} Jul 24 04:02:44.453283 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.453265 2577 scope.go:117] "RemoveContainer" containerID="785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d" Jul 24 04:02:44.462411 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.462394 2577 scope.go:117] "RemoveContainer" containerID="f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced" Jul 24 04:02:44.468756 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.468741 2577 scope.go:117] "RemoveContainer" containerID="a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0" Jul 24 04:02:44.474884 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.474867 2577 scope.go:117] "RemoveContainer" containerID="1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024" Jul 24 04:02:44.477483 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.477415 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:02:44.482255 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.482237 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:02:44.482488 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.482475 2577 scope.go:117] "RemoveContainer" containerID="70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae" Jul 24 04:02:44.488897 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.488871 2577 scope.go:117] "RemoveContainer" containerID="40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee" Jul 24 04:02:44.495222 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.495207 2577 scope.go:117] "RemoveContainer" containerID="110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f" Jul 24 04:02:44.501600 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.501568 2577 scope.go:117] "RemoveContainer" containerID="785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d" Jul 24 04:02:44.501988 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.501958 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d\": container with ID starting with 785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d not found: ID does not exist" containerID="785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d" Jul 24 04:02:44.502089 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.501996 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d"} err="failed to get container status \"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d\": rpc error: code = NotFound desc = could not find container \"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d\": container with ID starting with 785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d not found: ID does not exist" Jul 24 04:02:44.502089 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502037 2577 scope.go:117] "RemoveContainer" containerID="f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced" Jul 24 04:02:44.502286 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.502268 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced\": container with ID starting with f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced not found: ID does not exist" containerID="f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced" Jul 24 04:02:44.502325 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502291 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced"} err="failed to get container status \"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced\": rpc error: code = NotFound desc = could not find container \"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced\": container with ID starting with f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced not found: ID does not exist" Jul 24 04:02:44.502325 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502306 2577 scope.go:117] "RemoveContainer" containerID="a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0" Jul 24 04:02:44.502556 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.502529 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0\": container with ID starting with a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0 not found: ID does not exist" containerID="a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0" Jul 24 04:02:44.502639 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502559 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0"} err="failed to get container status \"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0\": rpc error: code = NotFound desc = could not find container \"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0\": container with ID starting with a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0 not found: ID does not exist" Jul 24 04:02:44.502639 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502573 2577 scope.go:117] "RemoveContainer" containerID="1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024" Jul 24 04:02:44.502789 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.502775 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024\": container with ID starting with 1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024 not found: ID does not exist" containerID="1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024" Jul 24 04:02:44.502828 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502793 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024"} err="failed to get container status \"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024\": rpc error: code = NotFound desc = could not find container \"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024\": container with ID starting with 1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024 not found: ID does not exist" Jul 24 04:02:44.502828 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.502804 2577 scope.go:117] "RemoveContainer" containerID="70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae" Jul 24 04:02:44.503051 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.503027 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae\": container with ID starting with 70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae not found: ID does not exist" containerID="70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae" Jul 24 04:02:44.503101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503057 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae"} err="failed to get container status \"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae\": rpc error: code = NotFound desc = could not find container \"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae\": container with ID starting with 70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae not found: ID does not exist" Jul 24 04:02:44.503101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503072 2577 scope.go:117] "RemoveContainer" containerID="40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee" Jul 24 04:02:44.503306 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.503290 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee\": container with ID starting with 40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee not found: ID does not exist" containerID="40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee" Jul 24 04:02:44.503356 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503308 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee"} err="failed to get container status \"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee\": rpc error: code = NotFound desc = could not find container \"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee\": container with ID starting with 40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee not found: ID does not exist" Jul 24 04:02:44.503356 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503321 2577 scope.go:117] "RemoveContainer" containerID="110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f" Jul 24 04:02:44.503538 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:02:44.503523 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f\": container with ID starting with 110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f not found: ID does not exist" containerID="110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f" Jul 24 04:02:44.503576 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503541 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f"} err="failed to get container status \"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f\": rpc error: code = NotFound desc = could not find container \"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f\": container with ID starting with 110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f not found: ID does not exist" Jul 24 04:02:44.503576 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503553 2577 scope.go:117] "RemoveContainer" containerID="785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d" Jul 24 04:02:44.503739 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503724 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d"} err="failed to get container status \"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d\": rpc error: code = NotFound desc = could not find container \"785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d\": container with ID starting with 785b0a05b6767d405a993e7f0aa54321d6e6b8fe86bec7c6eb241629e139350d not found: ID does not exist" Jul 24 04:02:44.503774 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503740 2577 scope.go:117] "RemoveContainer" containerID="f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced" Jul 24 04:02:44.503944 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503909 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced"} err="failed to get container status \"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced\": rpc error: code = NotFound desc = could not find container \"f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced\": container with ID starting with f5080104f891e0a3db5427bb7bdbd3624ea7b50555a3b5756ae06147cf288ced not found: ID does not exist" Jul 24 04:02:44.503990 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.503944 2577 scope.go:117] "RemoveContainer" containerID="a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0" Jul 24 04:02:44.504149 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504133 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0"} err="failed to get container status \"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0\": rpc error: code = NotFound desc = could not find container \"a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0\": container with ID starting with a5dd751226d25ca02dd7b2e7b69e0ae85e77843b5d46008d533f91271a4b4ee0 not found: ID does not exist" Jul 24 04:02:44.504201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504149 2577 scope.go:117] "RemoveContainer" containerID="1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024" Jul 24 04:02:44.504321 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504306 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024"} err="failed to get container status \"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024\": rpc error: code = NotFound desc = could not find container \"1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024\": container with ID starting with 1edc7da43757621c53aff8ffda6e24c4dbe31358d5e8a8c795fd6a2b65bc1024 not found: ID does not exist" Jul 24 04:02:44.504362 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504321 2577 scope.go:117] "RemoveContainer" containerID="70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae" Jul 24 04:02:44.504492 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504478 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae"} err="failed to get container status \"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae\": rpc error: code = NotFound desc = could not find container \"70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae\": container with ID starting with 70e6550d082c32311a3eddb224fac9d174e6291ef2fe08c84ffd2a6f39ab07ae not found: ID does not exist" Jul 24 04:02:44.504531 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504492 2577 scope.go:117] "RemoveContainer" containerID="40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee" Jul 24 04:02:44.504692 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504675 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee"} err="failed to get container status \"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee\": rpc error: code = NotFound desc = could not find container \"40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee\": container with ID starting with 40d3bd803ec5d10b66f48bad5e0d025a92cd3ce6565cd3344e9cf9ec693b7cee not found: ID does not exist" Jul 24 04:02:44.504692 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504691 2577 scope.go:117] "RemoveContainer" containerID="110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f" Jul 24 04:02:44.504861 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:44.504846 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f"} err="failed to get container status \"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f\": rpc error: code = NotFound desc = could not find container \"110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f\": container with ID starting with 110e83869733d605e6264fc22963473c3baef070cd2630d9a0de68960aeb895f not found: ID does not exist" Jul 24 04:02:45.875184 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:45.875144 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" path="/var/lib/kubelet/pods/db22b9fa-ec47-4f57-ab33-a404bb1dd751/volumes" Jul 24 04:02:47.173715 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.173672 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:02:47.174138 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.173972 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="prometheus" containerID="cri-o://dc72779d761ee4644912984bdeb3bd35295559acd20e3d631e45b03b30245f74" gracePeriod=600 Jul 24 04:02:47.174138 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.174018 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy" containerID="cri-o://d2ea580d13dd665956d4a6941e3c8087674dbdd79748e74fb518b6695fe1ce3a" gracePeriod=600 Jul 24 04:02:47.174138 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.174099 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-thanos" containerID="cri-o://53325ffbb0e10892dc13748fd6b8a5a1166a8a50a4842ec37f17255940597b8b" gracePeriod=600 Jul 24 04:02:47.174138 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.174111 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="config-reloader" containerID="cri-o://78ccc5eb5f932eb716c02d3d8e40d3083c0e978dccaa55525278d7e1d24aa563" gracePeriod=600 Jul 24 04:02:47.174138 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.174128 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-web" containerID="cri-o://e43e8ebb1c26e6f46adedb6c5e21d5f65d5782128afd02da1ab3478e83a58e19" gracePeriod=600 Jul 24 04:02:47.174379 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.174102 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="thanos-sidecar" containerID="cri-o://0159a68d1a5d2c6de60d79539a057e90e6d07b7bf6a085829b789e87027331b6" gracePeriod=600 Jul 24 04:02:47.467794 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467770 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="53325ffbb0e10892dc13748fd6b8a5a1166a8a50a4842ec37f17255940597b8b" exitCode=0 Jul 24 04:02:47.467794 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467791 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="d2ea580d13dd665956d4a6941e3c8087674dbdd79748e74fb518b6695fe1ce3a" exitCode=0 Jul 24 04:02:47.467794 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467797 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="e43e8ebb1c26e6f46adedb6c5e21d5f65d5782128afd02da1ab3478e83a58e19" exitCode=0 Jul 24 04:02:47.467972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467803 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="0159a68d1a5d2c6de60d79539a057e90e6d07b7bf6a085829b789e87027331b6" exitCode=0 Jul 24 04:02:47.467972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467808 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="78ccc5eb5f932eb716c02d3d8e40d3083c0e978dccaa55525278d7e1d24aa563" exitCode=0 Jul 24 04:02:47.467972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467814 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerID="dc72779d761ee4644912984bdeb3bd35295559acd20e3d631e45b03b30245f74" exitCode=0 Jul 24 04:02:47.467972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"53325ffbb0e10892dc13748fd6b8a5a1166a8a50a4842ec37f17255940597b8b"} Jul 24 04:02:47.467972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"d2ea580d13dd665956d4a6941e3c8087674dbdd79748e74fb518b6695fe1ce3a"} Jul 24 04:02:47.467972 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"e43e8ebb1c26e6f46adedb6c5e21d5f65d5782128afd02da1ab3478e83a58e19"} Jul 24 04:02:47.468145 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.467976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"0159a68d1a5d2c6de60d79539a057e90e6d07b7bf6a085829b789e87027331b6"} Jul 24 04:02:47.468145 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.468000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"78ccc5eb5f932eb716c02d3d8e40d3083c0e978dccaa55525278d7e1d24aa563"} Jul 24 04:02:47.468145 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.468024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"dc72779d761ee4644912984bdeb3bd35295559acd20e3d631e45b03b30245f74"} Jul 24 04:02:47.899371 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.899350 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:47.994676 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.994645 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-tls\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.994797 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.994689 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-serving-certs-ca-bundle\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.994797 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.994719 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.994932 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.994797 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config-out\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.994932 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.994823 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-kubelet-serving-ca-bundle\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.994932 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.994849 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-trusted-ca-bundle\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995174 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995142 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.995284 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995205 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.995590 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995560 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.995702 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-thanos-prometheus-http-client-file\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995702 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995629 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995702 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995659 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-db\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995707 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-metrics-client-certs\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995735 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-0\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995766 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hlmw\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-kube-api-access-2hlmw\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995803 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-1\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995833 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.995873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-metrics-client-ca\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.996199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995895 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-grpc-tls\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.996199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995944 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-tls-assets\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.996199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.995971 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-web-config\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.996199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.996000 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-2\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.996199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.996025 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-kube-rbac-proxy\") pod \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\" (UID: \"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189\") " Jul 24 04:02:47.996482 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.996233 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:47.996482 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.996248 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:47.996482 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.996262 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:47.997736 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.997595 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:47.997736 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.997630 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:47.998097 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.997885 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.998097 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.997892 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:47.998097 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.997910 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config-out" (OuterVolumeSpecName: "config-out") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:02:47.998285 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.998229 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.998469 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.998384 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.998554 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.998493 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:47.999197 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.999169 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:47.999586 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.999539 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:02:47.999696 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.999635 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-kube-api-access-2hlmw" (OuterVolumeSpecName: "kube-api-access-2hlmw") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "kube-api-access-2hlmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:02:47.999755 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:47.999705 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:48.000159 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.000129 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:48.000547 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.000519 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config" (OuterVolumeSpecName: "config") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:48.000865 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.000843 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:02:48.001117 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.001100 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:48.010101 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.010082 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-web-config" (OuterVolumeSpecName: "web-config") pod "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" (UID: "c5cd9119-66ed-40f8-8acf-a0b3c1dd9189"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:48.097180 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097129 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-metrics-client-certs\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097180 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097150 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097180 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097160 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hlmw\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-kube-api-access-2hlmw\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097180 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097168 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097180 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097177 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097187 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-configmap-metrics-client-ca\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097196 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-grpc-tls\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097205 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-tls-assets\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097212 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-web-config\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097220 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097228 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-kube-rbac-proxy\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097236 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097246 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097254 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-config-out\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097262 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097271 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.097367 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.097280 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189-prometheus-k8s-db\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jul 24 04:02:48.473940 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.473892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5cd9119-66ed-40f8-8acf-a0b3c1dd9189","Type":"ContainerDied","Data":"f3c8cac2175da9de6f68d3eaaee27b7946fe86753cdb9169e90f63bec619bbc5"} Jul 24 04:02:48.474425 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.473965 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.474425 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.473995 2577 scope.go:117] "RemoveContainer" containerID="53325ffbb0e10892dc13748fd6b8a5a1166a8a50a4842ec37f17255940597b8b" Jul 24 04:02:48.482124 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.481962 2577 scope.go:117] "RemoveContainer" containerID="d2ea580d13dd665956d4a6941e3c8087674dbdd79748e74fb518b6695fe1ce3a" Jul 24 04:02:48.488502 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.488485 2577 scope.go:117] "RemoveContainer" containerID="e43e8ebb1c26e6f46adedb6c5e21d5f65d5782128afd02da1ab3478e83a58e19" Jul 24 04:02:48.494744 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.494725 2577 scope.go:117] "RemoveContainer" containerID="0159a68d1a5d2c6de60d79539a057e90e6d07b7bf6a085829b789e87027331b6" Jul 24 04:02:48.497768 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.497748 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:02:48.501626 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.501601 2577 scope.go:117] "RemoveContainer" containerID="78ccc5eb5f932eb716c02d3d8e40d3083c0e978dccaa55525278d7e1d24aa563" Jul 24 04:02:48.501978 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.501958 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:02:48.507842 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.507825 2577 scope.go:117] "RemoveContainer" containerID="dc72779d761ee4644912984bdeb3bd35295559acd20e3d631e45b03b30245f74" Jul 24 04:02:48.514127 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.514113 2577 scope.go:117] "RemoveContainer" containerID="10ed0c68ef7996998d41b538b75eb2359397521be25e4cfb84777a581b38d3f4" Jul 24 04:02:48.525967 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.525948 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:02:48.526171 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526161 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="config-reloader" Jul 24 04:02:48.526218 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526173 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="config-reloader" Jul 24 04:02:48.526218 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526184 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-metric" Jul 24 04:02:48.526218 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526191 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-metric" Jul 24 04:02:48.526218 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526199 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="prom-label-proxy" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526219 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="prom-label-proxy" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526228 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526234 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526240 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-thanos" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526245 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-thanos" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526252 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="config-reloader" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526257 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="config-reloader" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526263 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="init-config-reloader" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526268 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="init-config-reloader" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526274 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="thanos-sidecar" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526279 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="thanos-sidecar" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526285 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="alertmanager" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526289 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="alertmanager" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526294 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-web" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526299 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-web" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526303 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526308 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526315 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="init-config-reloader" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526320 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="init-config-reloader" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526325 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-web" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526330 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-web" Jul 24 04:02:48.526333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526338 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="prometheus" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526343 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="prometheus" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526379 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526388 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="config-reloader" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526394 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="prom-label-proxy" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526398 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="config-reloader" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526404 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="thanos-sidecar" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526410 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-thanos" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526415 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526419 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="alertmanager" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526425 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-web" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526429 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db22b9fa-ec47-4f57-ab33-a404bb1dd751" containerName="kube-rbac-proxy-metric" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526434 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="prometheus" Jul 24 04:02:48.526974 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.526438 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" containerName="kube-rbac-proxy-web" Jul 24 04:02:48.530520 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.530506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.533120 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533102 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 04:02:48.533231 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 04:02:48.533231 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8hpqkji3slc40\"" Jul 24 04:02:48.533365 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 04:02:48.533365 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533337 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 04:02:48.533506 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533435 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 04:02:48.533561 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fqv8g\"" Jul 24 04:02:48.533747 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533732 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 04:02:48.533833 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533817 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 04:02:48.533984 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.533970 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 04:02:48.534171 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.534157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 04:02:48.534243 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.534233 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 04:02:48.534288 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.534240 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 04:02:48.535035 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.535018 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 04:02:48.535423 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.535410 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 04:02:48.540167 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.540151 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 04:02:48.542811 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.542796 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 04:02:48.559827 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.559807 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:02:48.600103 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600103 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600103 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600388 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe290c9b-8938-4573-ae3e-d9243b18c401-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600388 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkwc\" (UniqueName: \"kubernetes.io/projected/fe290c9b-8938-4573-ae3e-d9243b18c401-kube-api-access-twkwc\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600388 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-config\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600388 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600757 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600796 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600841 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe290c9b-8938-4573-ae3e-d9243b18c401-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600841 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600958 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600958 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.600958 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.601095 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.601095 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.600999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.601095 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.601030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.601095 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.601054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701340 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe290c9b-8938-4573-ae3e-d9243b18c401-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.701658 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe290c9b-8938-4573-ae3e-d9243b18c401-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkwc\" (UniqueName: \"kubernetes.io/projected/fe290c9b-8938-4573-ae3e-d9243b18c401-kube-api-access-twkwc\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-config\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701804 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.701810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702134 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.702016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702484 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.702346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.702634 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.702611 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.704201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.704176 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe290c9b-8938-4573-ae3e-d9243b18c401-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.704333 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.704301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.704430 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.704344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe290c9b-8938-4573-ae3e-d9243b18c401-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705263 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.704980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705263 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705263 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705051 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705263 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705160 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705263 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705235 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705277 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705624 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.705970 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.705945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-config\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.707288 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.707262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.707399 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.707379 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe290c9b-8938-4573-ae3e-d9243b18c401-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.707466 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.707455 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.707519 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.707481 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe290c9b-8938-4573-ae3e-d9243b18c401-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.709943 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.709908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkwc\" (UniqueName: \"kubernetes.io/projected/fe290c9b-8938-4573-ae3e-d9243b18c401-kube-api-access-twkwc\") pod \"prometheus-k8s-0\" (UID: \"fe290c9b-8938-4573-ae3e-d9243b18c401\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.839067 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.839007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:02:48.968380 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:48.968353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 04:02:48.971745 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:02:48.971719 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe290c9b_8938_4573_ae3e_d9243b18c401.slice/crio-f9c84fb3718c1dfcc665c9ab577ce49ef9e3e6f1c5d7d33065295449f8dec494 WatchSource:0}: Error finding container f9c84fb3718c1dfcc665c9ab577ce49ef9e3e6f1c5d7d33065295449f8dec494: Status 404 returned error can't find the container with id f9c84fb3718c1dfcc665c9ab577ce49ef9e3e6f1c5d7d33065295449f8dec494 Jul 24 04:02:49.480607 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:49.480576 2577 generic.go:356] "Generic (PLEG): container finished" podID="fe290c9b-8938-4573-ae3e-d9243b18c401" containerID="b6bfc9b52aa9ee41d51fae98110af12961e98d43673a7ec7c67b8b3c547ad801" exitCode=0 Jul 24 04:02:49.481001 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:49.480627 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerDied","Data":"b6bfc9b52aa9ee41d51fae98110af12961e98d43673a7ec7c67b8b3c547ad801"} Jul 24 04:02:49.481001 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:49.480680 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"f9c84fb3718c1dfcc665c9ab577ce49ef9e3e6f1c5d7d33065295449f8dec494"} Jul 24 04:02:49.874413 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:49.874389 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5cd9119-66ed-40f8-8acf-a0b3c1dd9189" path="/var/lib/kubelet/pods/c5cd9119-66ed-40f8-8acf-a0b3c1dd9189/volumes" Jul 24 04:02:50.488305 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.488273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"ef5e39ed4fc87c47fb7ea8e7cdfc8b9ce7fc23657be93268d85baf2550d70f29"} Jul 24 04:02:50.488633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.488336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"fba75a66eecbf57893a045ef0b17d4e770a639d88d3d66aea2efc7e6cc1d7192"} Jul 24 04:02:50.488633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.488360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"2b9fd4b5be30690fd6958ddc59ddcbc4e1d207d6eb0332fb1cf39bec30d8ec2a"} Jul 24 04:02:50.488633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.488386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"e1cda4721db452d8239dbcc5aaef13788bc92f9058499b2a6a161c34a8710670"} Jul 24 04:02:50.488633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.488416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"9692cf43d1064d8058776b93ae3503575c4d7adaf7a0fa2a6120bd90d7313334"} Jul 24 04:02:50.488633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.488439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe290c9b-8938-4573-ae3e-d9243b18c401","Type":"ContainerStarted","Data":"899404dbc675e74a38732fae590197a93fa9627dce873029911c19dbc2491eef"} Jul 24 04:02:50.517820 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:50.517775 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.498467922 podStartE2EDuration="2.517760126s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.292204ms" isStatefulPod=false podCreationTimestamp="2026-07-24 04:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:02:50.51567952 +0000 UTC m=+149.071113135" watchObservedRunningTime="2026-07-24 04:02:50.517760126 +0000 UTC m=+149.073193711" Jul 24 04:02:53.839991 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:02:53.839952 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:03:48.839242 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:03:48.839208 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:03:48.853882 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:03:48.853859 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:03:49.705609 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:03:49.705586 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 04:04:31.825812 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.825778 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt"] Jul 24 04:04:31.828998 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.828979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:31.831712 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.831685 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 04:04:31.831848 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.831748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-thbrq\"" Jul 24 04:04:31.832828 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.832806 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:04:31.838647 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.838622 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt"] Jul 24 04:04:31.995637 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.995612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsnj\" (UniqueName: \"kubernetes.io/projected/f0d697a6-bcf1-4c49-a408-8d10c86397d5-kube-api-access-cmsnj\") pod \"openshift-lws-operator-fd8ccff4c-494lt\" (UID: \"f0d697a6-bcf1-4c49-a408-8d10c86397d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:31.995761 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:31.995672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0d697a6-bcf1-4c49-a408-8d10c86397d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-494lt\" (UID: \"f0d697a6-bcf1-4c49-a408-8d10c86397d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:32.096545 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.096487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0d697a6-bcf1-4c49-a408-8d10c86397d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-494lt\" (UID: \"f0d697a6-bcf1-4c49-a408-8d10c86397d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:32.096545 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.096531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsnj\" (UniqueName: \"kubernetes.io/projected/f0d697a6-bcf1-4c49-a408-8d10c86397d5-kube-api-access-cmsnj\") pod \"openshift-lws-operator-fd8ccff4c-494lt\" (UID: \"f0d697a6-bcf1-4c49-a408-8d10c86397d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:32.096815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.096795 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0d697a6-bcf1-4c49-a408-8d10c86397d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-494lt\" (UID: \"f0d697a6-bcf1-4c49-a408-8d10c86397d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:32.103931 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.103900 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsnj\" (UniqueName: \"kubernetes.io/projected/f0d697a6-bcf1-4c49-a408-8d10c86397d5-kube-api-access-cmsnj\") pod \"openshift-lws-operator-fd8ccff4c-494lt\" (UID: \"f0d697a6-bcf1-4c49-a408-8d10c86397d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:32.157563 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.157542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" Jul 24 04:04:32.278893 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.278849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt"] Jul 24 04:04:32.281505 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:04:32.281477 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0d697a6_bcf1_4c49_a408_8d10c86397d5.slice/crio-38886806778d621e9340b563449db42b9c72e249aaf3a77537df6518332036de WatchSource:0}: Error finding container 38886806778d621e9340b563449db42b9c72e249aaf3a77537df6518332036de: Status 404 returned error can't find the container with id 38886806778d621e9340b563449db42b9c72e249aaf3a77537df6518332036de Jul 24 04:04:32.841712 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:32.841673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" event={"ID":"f0d697a6-bcf1-4c49-a408-8d10c86397d5","Type":"ContainerStarted","Data":"38886806778d621e9340b563449db42b9c72e249aaf3a77537df6518332036de"} Jul 24 04:04:34.849673 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:34.849598 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" event={"ID":"f0d697a6-bcf1-4c49-a408-8d10c86397d5","Type":"ContainerStarted","Data":"80f56ef7070cd74292d74bfded032c700def910217ef9bf582e25795d597b5c8"} Jul 24 04:04:34.870526 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:34.870466 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-494lt" podStartSLOduration=1.567447514 podStartE2EDuration="3.870448242s" totalImagesPullingTime="2.303000728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:04:34.868625869 +0000 UTC m=+253.424059453" watchObservedRunningTime="2026-07-24 04:04:34.870448242 +0000 UTC m=+253.425881830" Jul 24 04:04:54.703279 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.703248 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj"] Jul 24 04:04:54.706717 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.706695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.711397 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.711375 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 04:04:54.712090 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.712066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 04:04:54.712199 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.712179 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 04:04:54.714789 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.714772 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 04:04:54.720057 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.720038 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdbz4\"" Jul 24 04:04:54.735853 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.735832 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj"] Jul 24 04:04:54.740540 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.740517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.740633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.740553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.740633 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.740615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrpcd\" (UniqueName: \"kubernetes.io/projected/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-kube-api-access-vrpcd\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.740731 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.740643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.740731 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.740707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.841856 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.841827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.841980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.841864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.841980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.841908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrpcd\" (UniqueName: \"kubernetes.io/projected/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-kube-api-access-vrpcd\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.841980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.841962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.842149 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.842010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.842224 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.842204 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.844005 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.843987 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.844209 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.844192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.844302 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.844286 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:54.860792 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:54.860763 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrpcd\" (UniqueName: \"kubernetes.io/projected/64a39bce-74f1-41b5-8b9e-22e36e9ea9e0-kube-api-access-vrpcd\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj\" (UID: \"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:55.017065 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:55.017002 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:04:55.162901 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:55.162865 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj"] Jul 24 04:04:55.165841 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:04:55.165806 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a39bce_74f1_41b5_8b9e_22e36e9ea9e0.slice/crio-0978a467dd8a1befe7996a6073bd17194e07f81f962ae636a6ac1340b7b76f82 WatchSource:0}: Error finding container 0978a467dd8a1befe7996a6073bd17194e07f81f962ae636a6ac1340b7b76f82: Status 404 returned error can't find the container with id 0978a467dd8a1befe7996a6073bd17194e07f81f962ae636a6ac1340b7b76f82 Jul 24 04:04:55.922184 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:55.922146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" event={"ID":"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0","Type":"ContainerStarted","Data":"0978a467dd8a1befe7996a6073bd17194e07f81f962ae636a6ac1340b7b76f82"} Jul 24 04:04:58.934973 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:58.934915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" event={"ID":"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0","Type":"ContainerStarted","Data":"9d0bb055c0695d8b2ef7deaabfaba1edebc7c92c4801132f2667c248cab16eb9"} Jul 24 04:04:59.939126 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:59.939087 2577 generic.go:356] "Generic (PLEG): container finished" podID="64a39bce-74f1-41b5-8b9e-22e36e9ea9e0" containerID="9d0bb055c0695d8b2ef7deaabfaba1edebc7c92c4801132f2667c248cab16eb9" exitCode=0 Jul 24 04:04:59.939611 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:04:59.939153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" event={"ID":"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0","Type":"ContainerDied","Data":"9d0bb055c0695d8b2ef7deaabfaba1edebc7c92c4801132f2667c248cab16eb9"} Jul 24 04:05:00.944943 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:00.944894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" event={"ID":"64a39bce-74f1-41b5-8b9e-22e36e9ea9e0","Type":"ContainerStarted","Data":"ff792bd6f4e7bdbe761675319c2202a5d7a1d82aac55f66dd3e32e0c63a5e68c"} Jul 24 04:05:00.945329 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:00.944981 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:05:00.983978 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:00.983910 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" podStartSLOduration=2.565477938 podStartE2EDuration="6.983894978s" totalImagesPullingTime="3.324437177s" totalInitContainerRuntime="1.093979863s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:00.981342504 +0000 UTC m=+279.536776116" watchObservedRunningTime="2026-07-24 04:05:00.983894978 +0000 UTC m=+279.539328564" Jul 24 04:05:11.949834 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:11.949806 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj" Jul 24 04:05:15.289060 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.289025 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9"] Jul 24 04:05:15.292201 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.292177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.296266 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.296244 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 04:05:15.297025 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.297003 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 04:05:15.297085 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.297028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzsfh\"" Jul 24 04:05:15.297728 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.297713 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 04:05:15.297822 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.297803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 04:05:15.313768 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.313745 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9"] Jul 24 04:05:15.408118 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.408086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f40f07f-cfd1-4b9a-b202-40e162d03846-tmp\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.408228 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.408140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5msbn\" (UniqueName: \"kubernetes.io/projected/5f40f07f-cfd1-4b9a-b202-40e162d03846-kube-api-access-5msbn\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.408228 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.408199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40f07f-cfd1-4b9a-b202-40e162d03846-tls-certs\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.509045 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.509022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5msbn\" (UniqueName: \"kubernetes.io/projected/5f40f07f-cfd1-4b9a-b202-40e162d03846-kube-api-access-5msbn\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.509142 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.509050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40f07f-cfd1-4b9a-b202-40e162d03846-tls-certs\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.509142 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.509100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f40f07f-cfd1-4b9a-b202-40e162d03846-tmp\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.511274 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.511251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f40f07f-cfd1-4b9a-b202-40e162d03846-tmp\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.511436 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.511421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40f07f-cfd1-4b9a-b202-40e162d03846-tls-certs\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.522848 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.522826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5msbn\" (UniqueName: \"kubernetes.io/projected/5f40f07f-cfd1-4b9a-b202-40e162d03846-kube-api-access-5msbn\") pod \"kube-auth-proxy-555685c6b7-kcxb9\" (UID: \"5f40f07f-cfd1-4b9a-b202-40e162d03846\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.530338 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.530321 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lg6qz"] Jul 24 04:05:15.533502 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.533488 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:15.537135 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.537118 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 04:05:15.537220 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.537144 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kshjv\"" Jul 24 04:05:15.549684 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.549667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lg6qz"] Jul 24 04:05:15.602166 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.602144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" Jul 24 04:05:15.609659 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.609639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e413748f-c4d0-4843-a5c0-c7c5801b5d84-cert\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:15.609882 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.609857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff9lw\" (UniqueName: \"kubernetes.io/projected/e413748f-c4d0-4843-a5c0-c7c5801b5d84-kube-api-access-ff9lw\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:15.710523 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.710498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff9lw\" (UniqueName: \"kubernetes.io/projected/e413748f-c4d0-4843-a5c0-c7c5801b5d84-kube-api-access-ff9lw\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:15.710646 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.710534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e413748f-c4d0-4843-a5c0-c7c5801b5d84-cert\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:15.710646 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:05:15.710639 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 24 04:05:15.710725 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:05:15.710694 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e413748f-c4d0-4843-a5c0-c7c5801b5d84-cert podName:e413748f-c4d0-4843-a5c0-c7c5801b5d84 nodeName:}" failed. No retries permitted until 2026-07-24 04:05:16.210677388 +0000 UTC m=+294.766110973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e413748f-c4d0-4843-a5c0-c7c5801b5d84-cert") pod "odh-model-controller-7998c67dc4-lg6qz" (UID: "e413748f-c4d0-4843-a5c0-c7c5801b5d84") : secret "odh-model-controller-webhook-cert" not found Jul 24 04:05:15.750708 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.750678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff9lw\" (UniqueName: \"kubernetes.io/projected/e413748f-c4d0-4843-a5c0-c7c5801b5d84-kube-api-access-ff9lw\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:15.768684 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.768664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9"] Jul 24 04:05:15.771610 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:05:15.771585 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f40f07f_cfd1_4b9a_b202_40e162d03846.slice/crio-b5aa94a72d2d7c5204fab5e4b630de9a8c93a8b3499805c67fc4f616f3e743ec WatchSource:0}: Error finding container b5aa94a72d2d7c5204fab5e4b630de9a8c93a8b3499805c67fc4f616f3e743ec: Status 404 returned error can't find the container with id b5aa94a72d2d7c5204fab5e4b630de9a8c93a8b3499805c67fc4f616f3e743ec Jul 24 04:05:15.996964 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:15.996937 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" event={"ID":"5f40f07f-cfd1-4b9a-b202-40e162d03846","Type":"ContainerStarted","Data":"b5aa94a72d2d7c5204fab5e4b630de9a8c93a8b3499805c67fc4f616f3e743ec"} Jul 24 04:05:16.216161 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:16.216135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e413748f-c4d0-4843-a5c0-c7c5801b5d84-cert\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:16.218542 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:16.218522 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e413748f-c4d0-4843-a5c0-c7c5801b5d84-cert\") pod \"odh-model-controller-7998c67dc4-lg6qz\" (UID: \"e413748f-c4d0-4843-a5c0-c7c5801b5d84\") " pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:16.443068 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:16.443045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:16.580307 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:16.580278 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lg6qz"] Jul 24 04:05:16.583612 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:05:16.583582 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode413748f_c4d0_4843_a5c0_c7c5801b5d84.slice/crio-850866123da614de473c6ef88a5b768a7942779168a8deb5992f07d3d376b4ed WatchSource:0}: Error finding container 850866123da614de473c6ef88a5b768a7942779168a8deb5992f07d3d376b4ed: Status 404 returned error can't find the container with id 850866123da614de473c6ef88a5b768a7942779168a8deb5992f07d3d376b4ed Jul 24 04:05:17.001593 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:17.001554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" event={"ID":"e413748f-c4d0-4843-a5c0-c7c5801b5d84","Type":"ContainerStarted","Data":"850866123da614de473c6ef88a5b768a7942779168a8deb5992f07d3d376b4ed"} Jul 24 04:05:20.015133 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:20.015098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" event={"ID":"5f40f07f-cfd1-4b9a-b202-40e162d03846","Type":"ContainerStarted","Data":"a35503694143243521a92f91d63510f8d3db52355b820a3545bf50ee46c986bc"} Jul 24 04:05:20.016488 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:20.016464 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" event={"ID":"e413748f-c4d0-4843-a5c0-c7c5801b5d84","Type":"ContainerStarted","Data":"d9b8d951b8649077b87ae7646b9e3dedc50ca09b37c40f2b0226850093a2ba6e"} Jul 24 04:05:20.016599 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:20.016580 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:20.033905 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:20.033856 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-555685c6b7-kcxb9" podStartSLOduration=0.911107926 podStartE2EDuration="5.033840728s" totalImagesPullingTime="4.122732802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:20.032250847 +0000 UTC m=+298.587684434" watchObservedRunningTime="2026-07-24 04:05:20.033840728 +0000 UTC m=+298.589274318" Jul 24 04:05:20.051273 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:20.051231 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" podStartSLOduration=1.740125252 podStartE2EDuration="5.051218037s" totalImagesPullingTime="3.311092785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:20.049625034 +0000 UTC m=+298.605058621" watchObservedRunningTime="2026-07-24 04:05:20.051218037 +0000 UTC m=+298.606651622" Jul 24 04:05:21.764059 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:21.764032 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 04:05:23.241120 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.241088 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht"] Jul 24 04:05:23.244272 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.244255 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.246737 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.246710 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 04:05:23.246737 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.246734 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m5lns\"" Jul 24 04:05:23.260799 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.260778 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht"] Jul 24 04:05:23.369129 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d162e85-f637-4712-a2f8-14f06cca069c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369264 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369264 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369264 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369429 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369429 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d162e85-f637-4712-a2f8-14f06cca069c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369429 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psnht\" (UniqueName: \"kubernetes.io/projected/1d162e85-f637-4712-a2f8-14f06cca069c-kube-api-access-psnht\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369429 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.369576 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.369457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d162e85-f637-4712-a2f8-14f06cca069c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.381777 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.381753 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4"] Jul 24 04:05:23.384544 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.384529 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.388899 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.388882 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 04:05:23.389142 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.389129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 04:05:23.389618 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.389595 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q9tp5\"" Jul 24 04:05:23.389873 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.389859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 04:05:23.416195 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.416168 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4"] Jul 24 04:05:23.470518 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d162e85-f637-4712-a2f8-14f06cca069c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.470615 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dea9fbae-09b4-4889-a66f-58143036618f-cert\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.470615 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psnht\" (UniqueName: \"kubernetes.io/projected/1d162e85-f637-4712-a2f8-14f06cca069c-kube-api-access-psnht\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.470615 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.470773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d162e85-f637-4712-a2f8-14f06cca069c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.470773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6t7g\" (UniqueName: \"kubernetes.io/projected/dea9fbae-09b4-4889-a66f-58143036618f-kube-api-access-c6t7g\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.470773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d162e85-f637-4712-a2f8-14f06cca069c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.470773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dea9fbae-09b4-4889-a66f-58143036618f-manager-config\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.470773 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471054 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471054 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471054 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471054 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dea9fbae-09b4-4889-a66f-58143036618f-metrics-cert\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.471054 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.470961 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471306 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.471251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471306 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.471266 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471484 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.471466 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d162e85-f637-4712-a2f8-14f06cca069c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.471542 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.471507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.472976 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.472956 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d162e85-f637-4712-a2f8-14f06cca069c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.473209 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.473194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d162e85-f637-4712-a2f8-14f06cca069c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.488046 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.488017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psnht\" (UniqueName: \"kubernetes.io/projected/1d162e85-f637-4712-a2f8-14f06cca069c-kube-api-access-psnht\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.489776 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.489759 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d162e85-f637-4712-a2f8-14f06cca069c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht\" (UID: \"1d162e85-f637-4712-a2f8-14f06cca069c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.553959 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.553903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:23.572192 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.572170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dea9fbae-09b4-4889-a66f-58143036618f-metrics-cert\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.572312 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.572209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dea9fbae-09b4-4889-a66f-58143036618f-cert\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.572312 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.572240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6t7g\" (UniqueName: \"kubernetes.io/projected/dea9fbae-09b4-4889-a66f-58143036618f-kube-api-access-c6t7g\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.572312 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.572265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dea9fbae-09b4-4889-a66f-58143036618f-manager-config\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.572866 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.572848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dea9fbae-09b4-4889-a66f-58143036618f-manager-config\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.574466 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.574446 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dea9fbae-09b4-4889-a66f-58143036618f-cert\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.574466 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.574454 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dea9fbae-09b4-4889-a66f-58143036618f-metrics-cert\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.586948 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.586912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6t7g\" (UniqueName: \"kubernetes.io/projected/dea9fbae-09b4-4889-a66f-58143036618f-kube-api-access-c6t7g\") pod \"lws-controller-manager-65c5cbb794-rbnx4\" (UID: \"dea9fbae-09b4-4889-a66f-58143036618f\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.693320 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.693287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:23.707613 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.707592 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht"] Jul 24 04:05:23.709208 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:05:23.709186 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d162e85_f637_4712_a2f8_14f06cca069c.slice/crio-56080f7d7f00e235bee418f744635abf77d944c8a155a19e7ed6e5ac25eefbac WatchSource:0}: Error finding container 56080f7d7f00e235bee418f744635abf77d944c8a155a19e7ed6e5ac25eefbac: Status 404 returned error can't find the container with id 56080f7d7f00e235bee418f744635abf77d944c8a155a19e7ed6e5ac25eefbac Jul 24 04:05:23.711287 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.711257 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:05:23.822994 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:23.822888 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4"] Jul 24 04:05:23.825579 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:05:23.825555 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea9fbae_09b4_4889_a66f_58143036618f.slice/crio-20635b626677673721fa41bca21f89beb24e6d21f786594cf498e7974e5ba6b7 WatchSource:0}: Error finding container 20635b626677673721fa41bca21f89beb24e6d21f786594cf498e7974e5ba6b7: Status 404 returned error can't find the container with id 20635b626677673721fa41bca21f89beb24e6d21f786594cf498e7974e5ba6b7 Jul 24 04:05:24.032170 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:24.032130 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" event={"ID":"1d162e85-f637-4712-a2f8-14f06cca069c","Type":"ContainerStarted","Data":"56080f7d7f00e235bee418f744635abf77d944c8a155a19e7ed6e5ac25eefbac"} Jul 24 04:05:24.033195 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:24.033174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" event={"ID":"dea9fbae-09b4-4889-a66f-58143036618f","Type":"ContainerStarted","Data":"20635b626677673721fa41bca21f89beb24e6d21f786594cf498e7974e5ba6b7"} Jul 24 04:05:26.046198 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:26.046112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" event={"ID":"dea9fbae-09b4-4889-a66f-58143036618f","Type":"ContainerStarted","Data":"454e41d1a6d17198424cdbf2072fbd988b079ce2b0042a2e4efd2dc768ba1344"} Jul 24 04:05:26.046603 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:26.046243 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:05:26.082735 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:26.082692 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" podStartSLOduration=1.188210998 podStartE2EDuration="3.082677055s" totalImagesPullingTime="1.894466057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:26.081378525 +0000 UTC m=+304.636812111" watchObservedRunningTime="2026-07-24 04:05:26.082677055 +0000 UTC m=+304.638110619" Jul 24 04:05:26.884175 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:26.884127 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:05:26.884309 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:26.884213 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:05:26.884309 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:26.884259 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:05:27.051749 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:27.051713 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" event={"ID":"1d162e85-f637-4712-a2f8-14f06cca069c","Type":"ContainerStarted","Data":"ea9e0ba4ab5c3f68b3b34d18135056286761a82dc15ec59d8378f4ae4f05314f"} Jul 24 04:05:27.554377 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:27.554339 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:27.558532 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:27.558505 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:27.598049 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:27.598006 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" podStartSLOduration=1.4255429689999999 podStartE2EDuration="4.597989328s" totalImagesPullingTime="3.172446359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:27.107586193 +0000 UTC m=+305.663019780" watchObservedRunningTime="2026-07-24 04:05:27.597989328 +0000 UTC m=+306.153422914" Jul 24 04:05:28.056715 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:28.056684 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:28.057698 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:28.057677 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht" Jul 24 04:05:31.022123 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:31.022091 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lg6qz" Jul 24 04:05:37.053831 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:05:37.053798 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-rbnx4" Jul 24 04:07:13.400506 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.400461 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs"] Jul 24 04:07:13.403692 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.403675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.406168 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.406149 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 04:07:13.406641 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.406626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 24 04:07:13.406743 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.406702 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 24 04:07:13.407336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.407315 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 04:07:13.407336 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.407330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g5kfq\"" Jul 24 04:07:13.412933 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.412904 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs"] Jul 24 04:07:13.493858 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.493826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ec56532-b5d3-457e-b452-6469d8b48a21-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.494017 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.493868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfsx8\" (UniqueName: \"kubernetes.io/projected/2ec56532-b5d3-457e-b452-6469d8b48a21-kube-api-access-cfsx8\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.494017 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.493900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec56532-b5d3-457e-b452-6469d8b48a21-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.595308 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.595273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec56532-b5d3-457e-b452-6469d8b48a21-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.595455 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.595340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ec56532-b5d3-457e-b452-6469d8b48a21-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.595455 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.595376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfsx8\" (UniqueName: \"kubernetes.io/projected/2ec56532-b5d3-457e-b452-6469d8b48a21-kube-api-access-cfsx8\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.595455 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:07:13.595414 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 24 04:07:13.595557 ip-10-0-134-57 kubenswrapper[2577]: E0724 04:07:13.595498 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ec56532-b5d3-457e-b452-6469d8b48a21-plugin-serving-cert podName:2ec56532-b5d3-457e-b452-6469d8b48a21 nodeName:}" failed. No retries permitted until 2026-07-24 04:07:14.095478607 +0000 UTC m=+412.650912177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2ec56532-b5d3-457e-b452-6469d8b48a21-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-q8sfs" (UID: "2ec56532-b5d3-457e-b452-6469d8b48a21") : secret "plugin-serving-cert" not found Jul 24 04:07:13.595970 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.595952 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ec56532-b5d3-457e-b452-6469d8b48a21-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:13.607602 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:13.607584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfsx8\" (UniqueName: \"kubernetes.io/projected/2ec56532-b5d3-457e-b452-6469d8b48a21-kube-api-access-cfsx8\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:14.099888 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:14.099860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec56532-b5d3-457e-b452-6469d8b48a21-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:14.102162 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:14.102136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec56532-b5d3-457e-b452-6469d8b48a21-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q8sfs\" (UID: \"2ec56532-b5d3-457e-b452-6469d8b48a21\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:14.312815 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:14.312781 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" Jul 24 04:07:14.438049 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:14.438026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs"] Jul 24 04:07:14.440421 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:07:14.440396 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ec56532_b5d3_457e_b452_6469d8b48a21.slice/crio-81253dd455878ab5104326b9440fd16ab1048ac44c688c9cac5092d6345732d9 WatchSource:0}: Error finding container 81253dd455878ab5104326b9440fd16ab1048ac44c688c9cac5092d6345732d9: Status 404 returned error can't find the container with id 81253dd455878ab5104326b9440fd16ab1048ac44c688c9cac5092d6345732d9 Jul 24 04:07:14.485080 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:14.485046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" event={"ID":"2ec56532-b5d3-457e-b452-6469d8b48a21","Type":"ContainerStarted","Data":"81253dd455878ab5104326b9440fd16ab1048ac44c688c9cac5092d6345732d9"} Jul 24 04:07:36.588449 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:36.588422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" event={"ID":"2ec56532-b5d3-457e-b452-6469d8b48a21","Type":"ContainerStarted","Data":"94bb40d66ffb4efe496054ccc4e290aac6554140dbe283263a591b0490cddce6"} Jul 24 04:07:36.613534 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:36.613490 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q8sfs" podStartSLOduration=1.6815137070000001 podStartE2EDuration="23.613475416s" totalImagesPullingTime="21.931961709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:36.611678791 +0000 UTC m=+435.167112378" watchObservedRunningTime="2026-07-24 04:07:36.613475416 +0000 UTC m=+435.168909002" Jul 24 04:07:52.549205 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.549176 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm"] Jul 24 04:07:52.559000 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.558976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.561176 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.561145 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm"] Jul 24 04:07:52.561829 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.561805 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q4f4r\"" Jul 24 04:07:52.706864 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.706834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.706864 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.706869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707086 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.706889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707086 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.706909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1e6e7d-7357-44e2-81a0-2814166426ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707086 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.706997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707086 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.707051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707086 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.707074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707288 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.707102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.707288 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.707119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h6qj\" (UniqueName: \"kubernetes.io/projected/1d1e6e7d-7357-44e2-81a0-2814166426ab-kube-api-access-9h6qj\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.807568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.807568 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h6qj\" (UniqueName: \"kubernetes.io/projected/1d1e6e7d-7357-44e2-81a0-2814166426ab-kube-api-access-9h6qj\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.807778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.807778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.807778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.807778 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1e6e7d-7357-44e2-81a0-2814166426ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.807902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808222 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.808064 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808222 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.808166 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808324 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.808308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.808673 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.808648 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1e6e7d-7357-44e2-81a0-2814166426ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.809820 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.809788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.810164 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.810147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.815235 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.815214 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1e6e7d-7357-44e2-81a0-2814166426ab-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.815462 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.815444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h6qj\" (UniqueName: \"kubernetes.io/projected/1d1e6e7d-7357-44e2-81a0-2814166426ab-kube-api-access-9h6qj\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zxkkm\" (UID: \"1d1e6e7d-7357-44e2-81a0-2814166426ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:52.871146 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:52.871126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:53.108775 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.108751 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm"] Jul 24 04:07:53.111144 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:07:53.111119 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1e6e7d_7357_44e2_81a0_2814166426ab.slice/crio-66d605a9113be646f6b36644adeb203be2f6c336dc0a6222ea4fc63eafdf3a25 WatchSource:0}: Error finding container 66d605a9113be646f6b36644adeb203be2f6c336dc0a6222ea4fc63eafdf3a25: Status 404 returned error can't find the container with id 66d605a9113be646f6b36644adeb203be2f6c336dc0a6222ea4fc63eafdf3a25 Jul 24 04:07:53.113141 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.113113 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:07:53.113209 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.113177 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:07:53.113248 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.113223 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:07:53.666023 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.665981 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" event={"ID":"1d1e6e7d-7357-44e2-81a0-2814166426ab","Type":"ContainerStarted","Data":"aa088909ed43deb7b60539cb6c996d3be9c7d66596c4894af46c351f9e075781"} Jul 24 04:07:53.666384 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.666051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" event={"ID":"1d1e6e7d-7357-44e2-81a0-2814166426ab","Type":"ContainerStarted","Data":"66d605a9113be646f6b36644adeb203be2f6c336dc0a6222ea4fc63eafdf3a25"} Jul 24 04:07:53.687645 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.687597 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" podStartSLOduration=1.687582524 podStartE2EDuration="1.687582524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:53.685415074 +0000 UTC m=+452.240848661" watchObservedRunningTime="2026-07-24 04:07:53.687582524 +0000 UTC m=+452.243016110" Jul 24 04:07:53.875322 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:53.875296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:54.824375 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.824344 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:07:54.827135 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.827118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:54.829779 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.829762 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 24 04:07:54.837548 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.837528 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:07:54.868278 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.868254 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:07:54.890593 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.890568 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:54.922934 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.922892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktbgc\" (UniqueName: \"kubernetes.io/projected/93641b50-b5fa-4446-a59b-32e94e95d933-kube-api-access-ktbgc\") pod \"limitador-limitador-54d6d988d5-jjbv5\" (UID: \"93641b50-b5fa-4446-a59b-32e94e95d933\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:54.923041 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:54.922956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93641b50-b5fa-4446-a59b-32e94e95d933-config-file\") pod \"limitador-limitador-54d6d988d5-jjbv5\" (UID: \"93641b50-b5fa-4446-a59b-32e94e95d933\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:55.023856 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.023832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93641b50-b5fa-4446-a59b-32e94e95d933-config-file\") pod \"limitador-limitador-54d6d988d5-jjbv5\" (UID: \"93641b50-b5fa-4446-a59b-32e94e95d933\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:55.023986 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.023930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktbgc\" (UniqueName: \"kubernetes.io/projected/93641b50-b5fa-4446-a59b-32e94e95d933-kube-api-access-ktbgc\") pod \"limitador-limitador-54d6d988d5-jjbv5\" (UID: \"93641b50-b5fa-4446-a59b-32e94e95d933\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:55.024460 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.024442 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93641b50-b5fa-4446-a59b-32e94e95d933-config-file\") pod \"limitador-limitador-54d6d988d5-jjbv5\" (UID: \"93641b50-b5fa-4446-a59b-32e94e95d933\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:55.031951 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.031911 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktbgc\" (UniqueName: \"kubernetes.io/projected/93641b50-b5fa-4446-a59b-32e94e95d933-kube-api-access-ktbgc\") pod \"limitador-limitador-54d6d988d5-jjbv5\" (UID: \"93641b50-b5fa-4446-a59b-32e94e95d933\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:55.137252 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.137175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:55.256421 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.256397 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:07:55.258258 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:07:55.258232 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93641b50_b5fa_4446_a59b_32e94e95d933.slice/crio-cd445664ce0b30ed19fc6662578a91c24a57202d48c38861503b1e322b5e33e0 WatchSource:0}: Error finding container cd445664ce0b30ed19fc6662578a91c24a57202d48c38861503b1e322b5e33e0: Status 404 returned error can't find the container with id cd445664ce0b30ed19fc6662578a91c24a57202d48c38861503b1e322b5e33e0 Jul 24 04:07:55.675105 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.675062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" event={"ID":"93641b50-b5fa-4446-a59b-32e94e95d933","Type":"ContainerStarted","Data":"cd445664ce0b30ed19fc6662578a91c24a57202d48c38861503b1e322b5e33e0"} Jul 24 04:07:55.675358 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.675348 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:55.676273 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:55.676255 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:07:58.693202 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:58.693166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" event={"ID":"93641b50-b5fa-4446-a59b-32e94e95d933","Type":"ContainerStarted","Data":"47183b1f3dbd3a5bfc7bb2ac25ad8d40e3d822682fac9a40414ac39affaa2060"} Jul 24 04:07:58.693592 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:58.693287 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:07:58.712121 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:07:58.712077 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" podStartSLOduration=2.19827956 podStartE2EDuration="4.712061704s" totalImagesPullingTime="2.513782144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:58.710478607 +0000 UTC m=+457.265912194" watchObservedRunningTime="2026-07-24 04:07:58.712061704 +0000 UTC m=+457.267495355" Jul 24 04:08:09.699439 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:08:09.699406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jjbv5" Jul 24 04:09:07.955898 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:07.955867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:09:16.017428 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:16.017392 2577 generic.go:356] "Generic (PLEG): container finished" podID="1d1e6e7d-7357-44e2-81a0-2814166426ab" containerID="aa088909ed43deb7b60539cb6c996d3be9c7d66596c4894af46c351f9e075781" exitCode=0 Jul 24 04:09:16.017980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:16.017446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" event={"ID":"1d1e6e7d-7357-44e2-81a0-2814166426ab","Type":"ContainerDied","Data":"aa088909ed43deb7b60539cb6c996d3be9c7d66596c4894af46c351f9e075781"} Jul 24 04:09:16.017980 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:16.017885 2577 scope.go:117] "RemoveContainer" containerID="aa088909ed43deb7b60539cb6c996d3be9c7d66596c4894af46c351f9e075781" Jul 24 04:09:16.018875 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:16.018844 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:09:16.018982 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:16.018910 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:09:16.018982 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:16.018965 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 04:09:17.025950 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:17.025737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" event={"ID":"1d1e6e7d-7357-44e2-81a0-2814166426ab","Type":"ContainerStarted","Data":"d1c978c3469f5740068afb57945c625a4b555e396f1f4d13a01b012e7c18b747"} Jul 24 04:09:17.871643 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:17.871605 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zxkkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 24 04:09:17.871814 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:17.871664 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" podUID="1d1e6e7d-7357-44e2-81a0-2814166426ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 24 04:09:17.876395 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:17.876370 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:09:18.872293 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:18.872258 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zxkkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 24 04:09:18.872661 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:18.872313 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" podUID="1d1e6e7d-7357-44e2-81a0-2814166426ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 24 04:09:19.872297 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:19.872257 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zxkkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 24 04:09:19.872693 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:19.872321 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" podUID="1d1e6e7d-7357-44e2-81a0-2814166426ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 24 04:09:20.871564 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:20.871523 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zxkkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 24 04:09:20.871749 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:20.871580 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" podUID="1d1e6e7d-7357-44e2-81a0-2814166426ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 24 04:09:21.876083 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:21.876059 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:09:21.876530 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:21.876419 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:09:21.877029 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:21.877008 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zxkkm" Jul 24 04:09:31.113365 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:31.113333 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:09:45.937501 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:09:45.937469 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:10:10.922277 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:10.922237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:10:16.428807 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:16.428766 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:10:38.975265 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.975214 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t"] Jul 24 04:10:38.978648 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.978630 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:38.982516 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.982486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 04:10:38.982516 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.982499 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 04:10:38.982702 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.982642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 24 04:10:38.982753 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.982732 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wfpq8\"" Jul 24 04:10:38.990912 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:38.990887 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t"] Jul 24 04:10:39.062514 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.062483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgp6s\" (UniqueName: \"kubernetes.io/projected/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-kube-api-access-vgp6s\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.062514 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.062516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.062684 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.062533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.062684 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.062557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.062684 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.062627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.062684 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.062673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.115036 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.115012 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:10:39.163078 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163175 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163175 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163310 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgp6s\" (UniqueName: \"kubernetes.io/projected/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-kube-api-access-vgp6s\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163385 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163385 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163504 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163484 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163554 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163524 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.163743 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.163686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.165720 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.165691 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.165951 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.165910 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.171545 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.171514 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgp6s\" (UniqueName: \"kubernetes.io/projected/78b8bbca-f77c-4abf-b2ee-6f53eaf957bd-kube-api-access-vgp6s\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dl47t\" (UID: \"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.288599 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.288539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:39.412526 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.412504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t"] Jul 24 04:10:39.414954 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:10:39.414906 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78b8bbca_f77c_4abf_b2ee_6f53eaf957bd.slice/crio-f14d8e458e664166f0b000de66228d2d19c77ab2bd43fe49f7d7d972b7d7f3f6 WatchSource:0}: Error finding container f14d8e458e664166f0b000de66228d2d19c77ab2bd43fe49f7d7d972b7d7f3f6: Status 404 returned error can't find the container with id f14d8e458e664166f0b000de66228d2d19c77ab2bd43fe49f7d7d972b7d7f3f6 Jul 24 04:10:39.416039 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:39.416020 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:10:40.385663 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:40.385620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" event={"ID":"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd","Type":"ContainerStarted","Data":"f14d8e458e664166f0b000de66228d2d19c77ab2bd43fe49f7d7d972b7d7f3f6"} Jul 24 04:10:41.391055 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:41.391012 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" event={"ID":"78b8bbca-f77c-4abf-b2ee-6f53eaf957bd","Type":"ContainerStarted","Data":"659746ac337cf8b5f153bcbb5983625dd998ec3475cb8a9fa0046b6c04d90ab9"} Jul 24 04:10:41.408219 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:41.408170 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" podStartSLOduration=2.299361594 podStartE2EDuration="3.408157349s" totalImagesPullingTime="1.108795755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:10:41.406326798 +0000 UTC m=+619.961760385" watchObservedRunningTime="2026-07-24 04:10:41.408157349 +0000 UTC m=+619.963590912" Jul 24 04:10:49.289331 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:49.289235 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:49.289331 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:49.289291 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:49.302292 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:49.302263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:49.436369 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:49.436340 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dl47t" Jul 24 04:10:50.614770 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:10:50.614735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jjbv5"] Jul 24 04:12:51.077934 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:51.077882 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lg6qz_e413748f-c4d0-4843-a5c0-c7c5801b5d84/manager/0.log" Jul 24 04:12:51.454480 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:51.454452 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj_64a39bce-74f1-41b5-8b9e-22e36e9ea9e0/copy-manifests/0.log" Jul 24 04:12:51.460215 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:51.460191 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj_64a39bce-74f1-41b5-8b9e-22e36e9ea9e0/manager/0.log" Jul 24 04:12:53.583699 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:53.583672 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q8sfs_2ec56532-b5d3-457e-b452-6469d8b48a21/kuadrant-console-plugin/0.log" Jul 24 04:12:53.966206 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:53.966184 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jjbv5_93641b50-b5fa-4446-a59b-32e94e95d933/limitador/0.log" Jul 24 04:12:54.448313 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:54.448286 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht_1d162e85-f637-4712-a2f8-14f06cca069c/istio-proxy/0.log" Jul 24 04:12:54.688011 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:54.687986 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-kcxb9_5f40f07f-cfd1-4b9a-b202-40e162d03846/kube-auth-proxy/0.log" Jul 24 04:12:54.922387 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:54.922324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/1.log" Jul 24 04:12:56.211147 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:12:56.211121 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dl47t_78b8bbca-f77c-4abf-b2ee-6f53eaf957bd/main/0.log" Jul 24 04:13:01.954196 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.954165 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-plmrp/must-gather-fkls9"] Jul 24 04:13:01.957676 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.957655 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:01.960696 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.960664 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-plmrp\"/\"openshift-service-ca.crt\"" Jul 24 04:13:01.961939 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.961906 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-plmrp\"/\"default-dockercfg-qlnt6\"" Jul 24 04:13:01.962035 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.961914 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-plmrp\"/\"kube-root-ca.crt\"" Jul 24 04:13:01.966659 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.966634 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/must-gather-fkls9"] Jul 24 04:13:01.996149 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.996128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8178fe3-b1de-40d3-ba13-ae66c50ff359-must-gather-output\") pod \"must-gather-fkls9\" (UID: \"b8178fe3-b1de-40d3-ba13-ae66c50ff359\") " pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:01.996262 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:01.996203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqdbw\" (UniqueName: \"kubernetes.io/projected/b8178fe3-b1de-40d3-ba13-ae66c50ff359-kube-api-access-jqdbw\") pod \"must-gather-fkls9\" (UID: \"b8178fe3-b1de-40d3-ba13-ae66c50ff359\") " pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:02.096988 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.096961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqdbw\" (UniqueName: \"kubernetes.io/projected/b8178fe3-b1de-40d3-ba13-ae66c50ff359-kube-api-access-jqdbw\") pod \"must-gather-fkls9\" (UID: \"b8178fe3-b1de-40d3-ba13-ae66c50ff359\") " pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:02.097118 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.097032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8178fe3-b1de-40d3-ba13-ae66c50ff359-must-gather-output\") pod \"must-gather-fkls9\" (UID: \"b8178fe3-b1de-40d3-ba13-ae66c50ff359\") " pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:02.097943 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.097864 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8178fe3-b1de-40d3-ba13-ae66c50ff359-must-gather-output\") pod \"must-gather-fkls9\" (UID: \"b8178fe3-b1de-40d3-ba13-ae66c50ff359\") " pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:02.107322 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.107295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqdbw\" (UniqueName: \"kubernetes.io/projected/b8178fe3-b1de-40d3-ba13-ae66c50ff359-kube-api-access-jqdbw\") pod \"must-gather-fkls9\" (UID: \"b8178fe3-b1de-40d3-ba13-ae66c50ff359\") " pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:02.268668 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.268608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/must-gather-fkls9" Jul 24 04:13:02.392539 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.392517 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/must-gather-fkls9"] Jul 24 04:13:02.394721 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:13:02.394698 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8178fe3_b1de_40d3_ba13_ae66c50ff359.slice/crio-e4e08165989907cd2fa09d0d3698c975e126328515cf2765ae06da4dd6efeefc WatchSource:0}: Error finding container e4e08165989907cd2fa09d0d3698c975e126328515cf2765ae06da4dd6efeefc: Status 404 returned error can't find the container with id e4e08165989907cd2fa09d0d3698c975e126328515cf2765ae06da4dd6efeefc Jul 24 04:13:02.987007 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:02.986962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/must-gather-fkls9" event={"ID":"b8178fe3-b1de-40d3-ba13-ae66c50ff359","Type":"ContainerStarted","Data":"e4e08165989907cd2fa09d0d3698c975e126328515cf2765ae06da4dd6efeefc"} Jul 24 04:13:03.996148 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:03.996100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/must-gather-fkls9" event={"ID":"b8178fe3-b1de-40d3-ba13-ae66c50ff359","Type":"ContainerStarted","Data":"0c7f0476fa6c755db21caf29283ab1a8483016e78774b0c248c69d5e80d6a7df"} Jul 24 04:13:03.996605 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:03.996163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/must-gather-fkls9" event={"ID":"b8178fe3-b1de-40d3-ba13-ae66c50ff359","Type":"ContainerStarted","Data":"bb3bf5cc9c7e0ecf94701145e774e4cee1ce48c69ca68046e79986f1ff05d922"} Jul 24 04:13:04.012605 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:04.012545 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-plmrp/must-gather-fkls9" podStartSLOduration=2.30918919 podStartE2EDuration="3.012523149s" totalImagesPullingTime="703.333959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:13:04.011345174 +0000 UTC m=+762.566778765" watchObservedRunningTime="2026-07-24 04:13:04.012523149 +0000 UTC m=+762.567956736" Jul 24 04:13:04.653893 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:04.653866 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtgw2_fd7b5caf-e7b9-44d1-b8e7-d3f51a885d17/global-pull-secret-syncer/0.log" Jul 24 04:13:04.724757 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:04.724727 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lw8vp_7b5ba710-58b7-4d91-9bdf-7975c314a162/konnectivity-agent/0.log" Jul 24 04:13:04.796733 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:04.796692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-57.ec2.internal_06bbd3a05c6f4492e95c3f38f3847691/haproxy/0.log" Jul 24 04:13:09.377409 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:09.377331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q8sfs_2ec56532-b5d3-457e-b452-6469d8b48a21/kuadrant-console-plugin/0.log" Jul 24 04:13:09.486572 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:09.486543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jjbv5_93641b50-b5fa-4446-a59b-32e94e95d933/limitador/0.log" Jul 24 04:13:11.730358 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:11.730321 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95vdx_0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8/node-exporter/0.log" Jul 24 04:13:11.764005 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:11.763971 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95vdx_0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8/kube-rbac-proxy/0.log" Jul 24 04:13:11.797816 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:11.797791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95vdx_0dfd48aa-6a17-4eb0-a065-6539e0b0c8d8/init-textfile/0.log" Jul 24 04:13:11.933314 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:11.933282 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6sj7s_d766dac9-be04-411a-bead-62b6aa513898/kube-rbac-proxy-main/0.log" Jul 24 04:13:11.961525 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:11.961498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6sj7s_d766dac9-be04-411a-bead-62b6aa513898/kube-rbac-proxy-self/0.log" Jul 24 04:13:11.989132 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:11.989072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6sj7s_d766dac9-be04-411a-bead-62b6aa513898/openshift-state-metrics/0.log" Jul 24 04:13:12.026231 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.026162 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/prometheus/0.log" Jul 24 04:13:12.052571 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.052474 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/config-reloader/0.log" Jul 24 04:13:12.082192 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.082129 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/thanos-sidecar/0.log" Jul 24 04:13:12.130731 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.130677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/kube-rbac-proxy-web/0.log" Jul 24 04:13:12.197370 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.197340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/kube-rbac-proxy/0.log" Jul 24 04:13:12.277690 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.277614 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/kube-rbac-proxy-thanos/0.log" Jul 24 04:13:12.325937 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.325881 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe290c9b-8938-4573-ae3e-d9243b18c401/init-config-reloader/0.log" Jul 24 04:13:12.519440 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.519340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d6f7587-wkr8p_95946799-1314-4421-ab2d-19e5ba53becf/thanos-query/0.log" Jul 24 04:13:12.545270 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.545153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d6f7587-wkr8p_95946799-1314-4421-ab2d-19e5ba53becf/kube-rbac-proxy-web/0.log" Jul 24 04:13:12.574124 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.574100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d6f7587-wkr8p_95946799-1314-4421-ab2d-19e5ba53becf/kube-rbac-proxy/0.log" Jul 24 04:13:12.598830 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.598799 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d6f7587-wkr8p_95946799-1314-4421-ab2d-19e5ba53becf/prom-label-proxy/0.log" Jul 24 04:13:12.623071 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.623025 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d6f7587-wkr8p_95946799-1314-4421-ab2d-19e5ba53becf/kube-rbac-proxy-rules/0.log" Jul 24 04:13:12.648339 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:12.648311 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d6f7587-wkr8p_95946799-1314-4421-ab2d-19e5ba53becf/kube-rbac-proxy-metrics/0.log" Jul 24 04:13:14.679716 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.679679 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw"] Jul 24 04:13:14.685030 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.685006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.688988 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.688714 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw"] Jul 24 04:13:14.829208 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.829178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwbg6\" (UniqueName: \"kubernetes.io/projected/4d883269-a78d-413e-a481-6f34c2919382-kube-api-access-pwbg6\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.829460 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.829439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-lib-modules\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.829575 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.829561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-podres\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.829744 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.829732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-proc\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.829960 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.829942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-sys\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931000 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.930882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-proc\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931000 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.930960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-sys\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931000 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.930988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbg6\" (UniqueName: \"kubernetes.io/projected/4d883269-a78d-413e-a481-6f34c2919382-kube-api-access-pwbg6\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931265 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.931019 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-proc\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931265 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.931025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-lib-modules\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931265 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.931099 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-sys\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931265 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.931238 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-lib-modules\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931408 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.931266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-podres\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.931408 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.931381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d883269-a78d-413e-a481-6f34c2919382-podres\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:14.940249 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:14.940224 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwbg6\" (UniqueName: \"kubernetes.io/projected/4d883269-a78d-413e-a481-6f34c2919382-kube-api-access-pwbg6\") pod \"perf-node-gather-daemonset-xmdxw\" (UID: \"4d883269-a78d-413e-a481-6f34c2919382\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:15.003120 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:15.003087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:15.171701 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:15.171676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw"] Jul 24 04:13:15.174177 ip-10-0-134-57 kubenswrapper[2577]: W0724 04:13:15.174146 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4d883269_a78d_413e_a481_6f34c2919382.slice/crio-fd65922fce9284934c560a29b5febaeda5ed2e56ceb369014c1d281b1ee430e3 WatchSource:0}: Error finding container fd65922fce9284934c560a29b5febaeda5ed2e56ceb369014c1d281b1ee430e3: Status 404 returned error can't find the container with id fd65922fce9284934c560a29b5febaeda5ed2e56ceb369014c1d281b1ee430e3 Jul 24 04:13:16.072937 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.072880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" event={"ID":"4d883269-a78d-413e-a481-6f34c2919382","Type":"ContainerStarted","Data":"8b6ac2e5c45e2541151d76b602262bab18346c5199833b5f09cdcc1074c96c22"} Jul 24 04:13:16.073412 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.072975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" event={"ID":"4d883269-a78d-413e-a481-6f34c2919382","Type":"ContainerStarted","Data":"fd65922fce9284934c560a29b5febaeda5ed2e56ceb369014c1d281b1ee430e3"} Jul 24 04:13:16.073787 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.073760 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:16.093213 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.093157 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" podStartSLOduration=2.093135745 podStartE2EDuration="2.093135745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:13:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:13:16.090673021 +0000 UTC m=+774.646106599" watchObservedRunningTime="2026-07-24 04:13:16.093135745 +0000 UTC m=+774.648569333" Jul 24 04:13:16.673762 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.673730 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-69d74_3d225e5d-b717-4710-afed-6e9d1d745742/dns/0.log" Jul 24 04:13:16.695694 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.695666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-69d74_3d225e5d-b717-4710-afed-6e9d1d745742/kube-rbac-proxy/0.log" Jul 24 04:13:16.773984 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:16.773957 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dn79f_04f51c19-9f38-46b6-885a-7edb62016ae3/dns-node-resolver/0.log" Jul 24 04:13:17.392960 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:17.392915 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68c989b7d9-vhmq6_47dad4d5-8208-4794-892b-af5c4bc2802a/registry/0.log" Jul 24 04:13:17.459212 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:17.459182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xc6j8_220e565f-2691-4b31-93df-02875ddbd63d/node-ca/0.log" Jul 24 04:13:18.547608 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:18.547561 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht_1d162e85-f637-4712-a2f8-14f06cca069c/istio-proxy/0.log" Jul 24 04:13:18.621212 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:18.621180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-kcxb9_5f40f07f-cfd1-4b9a-b202-40e162d03846/kube-auth-proxy/0.log" Jul 24 04:13:18.679180 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:18.679149 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/1.log" Jul 24 04:13:18.679719 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:18.679692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/0.log" Jul 24 04:13:19.404356 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:19.404305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jjnx5_4d75cef4-bcf3-41dc-8902-990688a41166/serve-healthcheck-canary/0.log" Jul 24 04:13:20.106916 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:20.106888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfv9x_86d73e34-7d4e-4e88-a67e-6a9005da3d3e/kube-rbac-proxy/0.log" Jul 24 04:13:20.152880 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:20.152850 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfv9x_86d73e34-7d4e-4e88-a67e-6a9005da3d3e/exporter/0.log" Jul 24 04:13:20.174655 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:20.174633 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfv9x_86d73e34-7d4e-4e88-a67e-6a9005da3d3e/extractor/0.log" Jul 24 04:13:22.366485 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:22.366455 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lg6qz_e413748f-c4d0-4843-a5c0-c7c5801b5d84/manager/0.log" Jul 24 04:13:22.498817 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:22.498791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj_64a39bce-74f1-41b5-8b9e-22e36e9ea9e0/manager/0.log" Jul 24 04:13:22.519220 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:22.519186 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-zdfvj_64a39bce-74f1-41b5-8b9e-22e36e9ea9e0/copy-manifests/0.log" Jul 24 04:13:23.095854 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:23.095825 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-xmdxw" Jul 24 04:13:23.638700 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:23.638669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65c5cbb794-rbnx4_dea9fbae-09b4-4889-a66f-58143036618f/manager/0.log" Jul 24 04:13:23.665119 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:23.665077 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-494lt_f0d697a6-bcf1-4c49-a408-8d10c86397d5/openshift-lws-operator/0.log" Jul 24 04:13:24.394321 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:24.394297 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht_1d162e85-f637-4712-a2f8-14f06cca069c/istio-proxy/0.log" Jul 24 04:13:24.440641 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:24.440612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-kcxb9_5f40f07f-cfd1-4b9a-b202-40e162d03846/kube-auth-proxy/0.log" Jul 24 04:13:24.476552 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:24.476513 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/1.log" Jul 24 04:13:24.476752 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:24.476663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/0.log" Jul 24 04:13:25.770645 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:25.770615 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6vht_1d162e85-f637-4712-a2f8-14f06cca069c/istio-proxy/0.log" Jul 24 04:13:25.816938 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:25.816895 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-kcxb9_5f40f07f-cfd1-4b9a-b202-40e162d03846/kube-auth-proxy/0.log" Jul 24 04:13:25.855474 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:25.855444 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/1.log" Jul 24 04:13:25.855723 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:25.855703 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zxkkm_1d1e6e7d-7357-44e2-81a0-2814166426ab/istio-proxy/0.log" Jul 24 04:13:30.249283 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.249252 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-95tjs_5538d024-5890-4f7f-b9f5-addedcf72489/kube-multus/0.log" Jul 24 04:13:30.455829 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.455803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/kube-multus-additional-cni-plugins/0.log" Jul 24 04:13:30.477430 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.477405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/egress-router-binary-copy/0.log" Jul 24 04:13:30.498095 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.498073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/cni-plugins/0.log" Jul 24 04:13:30.518478 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.518411 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/bond-cni-plugin/0.log" Jul 24 04:13:30.541128 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.541108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/routeoverride-cni/0.log" Jul 24 04:13:30.561825 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.561808 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/whereabouts-cni-bincopy/0.log" Jul 24 04:13:30.582253 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.582229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6vkb7_d0d07eb7-df9e-45bd-806a-55e35ff2da46/whereabouts-cni/0.log" Jul 24 04:13:30.844059 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.843982 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9wqx5_de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c/network-metrics-daemon/0.log" Jul 24 04:13:30.871677 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:30.871654 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9wqx5_de1dcdf0-f0f3-4fd9-93a5-6a2ca27f626c/kube-rbac-proxy/0.log" Jul 24 04:13:32.333147 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.333120 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/ovn-controller/0.log" Jul 24 04:13:32.355808 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.355788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/ovn-acl-logging/0.log" Jul 24 04:13:32.381312 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.381289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/kube-rbac-proxy-node/0.log" Jul 24 04:13:32.403563 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.403542 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 04:13:32.423906 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.423883 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/northd/0.log" Jul 24 04:13:32.444833 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.444813 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/nbdb/0.log" Jul 24 04:13:32.466346 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.466329 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/sbdb/0.log" Jul 24 04:13:32.511730 ip-10-0-134-57 kubenswrapper[2577]: I0724 04:13:32.511709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcgwj_1cc4b8ce-fb6a-4083-abb5-65e6e5bde47f/ovnkube-controller/0.log"