Jul 23 18:30:27.840671 ip-10-0-134-87 systemd[1]: Starting Kubernetes Kubelet... Jul 23 18:30:28.142687 ip-10-0-134-87 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:30:28.142687 ip-10-0-134-87 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 18:30:28.142687 ip-10-0-134-87 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:30:28.142687 ip-10-0-134-87 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 18:30:28.142687 ip-10-0-134-87 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:30:28.144496 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.144374 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 18:30:28.150394 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150376 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:28.150394 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150395 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150399 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150403 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150406 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150409 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150413 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150417 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150420 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150423 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150427 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150431 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150434 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150437 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150439 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150442 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150445 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150448 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150450 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150453 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150455 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:28.150466 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150465 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150468 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150471 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150473 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150476 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150479 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150481 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150484 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150486 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150489 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150491 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150494 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150496 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150498 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150501 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150503 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150506 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150508 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150511 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:28.150931 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150513 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150516 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150518 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150520 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150523 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150525 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150527 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150530 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150532 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150534 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150537 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150539 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150542 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150545 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150549 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150553 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150556 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150559 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150561 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150564 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:28.151439 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150566 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150569 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150571 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150574 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150576 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150579 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150581 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150584 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150586 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150589 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150591 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150594 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150596 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150599 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150602 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150604 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150606 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150609 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150611 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150614 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:28.151926 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150616 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150618 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150621 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150623 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150626 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150630 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150633 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150638 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150641 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150644 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150647 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150649 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150652 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150655 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150658 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150660 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150663 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150665 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.150668 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:28.152410 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151382 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151391 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151397 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151403 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151406 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151409 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151412 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151415 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151418 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151420 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151423 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151426 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151428 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151431 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151433 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151436 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151438 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151443 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151446 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:28.152863 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151449 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151452 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151456 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151459 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151461 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151464 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151466 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151469 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151471 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151474 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151476 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151478 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151481 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151484 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151487 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151491 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151493 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151496 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151499 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:28.153323 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151501 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151504 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151506 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151509 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151512 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151515 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151517 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151520 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151522 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151524 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151527 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151529 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151532 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151534 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151537 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151540 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151543 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151545 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151548 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151550 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:28.153801 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151553 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151555 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151558 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151560 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151563 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151565 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151567 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151570 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151572 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151574 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151577 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151580 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151582 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151585 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151587 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151589 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151592 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151594 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151596 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:28.154438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151598 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151601 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151603 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151606 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151608 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151611 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151614 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151617 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151619 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151623 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151626 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151628 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151631 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151634 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151636 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151638 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151641 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151644 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151646 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151649 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:28.154910 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151651 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.151653 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152027 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152032 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152035 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152037 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152040 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152043 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152045 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152048 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152050 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152054 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152057 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152059 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152062 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152064 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152066 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152069 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152071 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:28.155422 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152074 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152078 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152081 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152083 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152086 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152089 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152091 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152094 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152096 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152099 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152101 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152105 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152109 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152112 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152115 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152118 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152121 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152123 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152126 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152128 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:28.155869 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152131 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152133 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152135 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152139 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152142 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152145 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152148 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152150 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152153 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152155 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152158 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152160 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152163 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152166 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152168 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152171 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152174 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152176 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152178 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:28.156349 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152181 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152184 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152186 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152189 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152191 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152193 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152196 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152198 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152200 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152203 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152205 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152208 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152210 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152213 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152215 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152217 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152220 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152222 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152224 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152227 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:28.156823 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152229 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152231 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152234 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152254 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152258 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152263 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152266 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152269 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152273 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152275 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152279 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152281 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152284 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152287 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152289 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152292 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152294 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152296 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152299 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152302 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:28.157292 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152304 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152307 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.152309 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152396 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152404 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152417 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152426 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152430 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152433 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152438 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152442 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152445 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152448 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152451 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152457 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152460 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152463 2556 flags.go:64] FLAG: --cgroup-root="" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152468 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152471 2556 flags.go:64] FLAG: --client-ca-file="" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152474 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152477 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152481 2556 flags.go:64] FLAG: --cluster-domain="" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152484 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152489 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 18:30:28.157785 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152493 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152496 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152499 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152502 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152505 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152509 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152512 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152514 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152517 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152520 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152523 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152527 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152530 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152540 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152543 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152546 2556 flags.go:64] FLAG: --enable-server="true" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152549 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152553 2556 flags.go:64] FLAG: --event-burst="100" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152556 2556 flags.go:64] FLAG: --event-qps="50" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152559 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152562 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152565 2556 flags.go:64] FLAG: --eviction-hard="" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152568 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152572 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152575 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 18:30:28.158357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152579 2556 flags.go:64] FLAG: --eviction-soft="" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152582 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152585 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152587 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152590 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152593 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152598 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152601 2556 flags.go:64] FLAG: --feature-gates="" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152605 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152608 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152611 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152614 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152616 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152619 2556 flags.go:64] FLAG: --help="false" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152622 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152625 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152627 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152630 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152633 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152637 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152639 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152642 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152645 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 18:30:28.158976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152647 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152650 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152653 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152656 2556 flags.go:64] FLAG: --kube-reserved="" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152659 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152661 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152664 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152667 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152669 2556 flags.go:64] FLAG: --lock-file="" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152675 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152678 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152681 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152686 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152689 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152692 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152695 2556 flags.go:64] FLAG: --logging-format="text" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152698 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152702 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152705 2556 flags.go:64] FLAG: --manifest-url="" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152708 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152712 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152715 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152727 2556 flags.go:64] FLAG: --max-pods="110" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152730 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152733 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 18:30:28.159640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152735 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152739 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152742 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152744 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152747 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152754 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152757 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152760 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152763 2556 flags.go:64] FLAG: --pod-cidr="" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152765 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152772 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152775 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152778 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152781 2556 flags.go:64] FLAG: --port="10250" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152784 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152787 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e681afca00dfcb21" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152789 2556 flags.go:64] FLAG: --qos-reserved="" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152793 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152796 2556 flags.go:64] FLAG: --register-node="true" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152799 2556 flags.go:64] FLAG: --register-with-taints="" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152803 2556 flags.go:64] FLAG: --registry-burst="10" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152806 2556 flags.go:64] FLAG: --registry-qps="5" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152810 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152813 2556 flags.go:64] FLAG: --reserved-memory="" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.152816 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 18:30:28.160601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153181 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153185 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153188 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153191 2556 flags.go:64] FLAG: --runonce="false" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153193 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153196 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153199 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153202 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153204 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153207 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153210 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153213 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153216 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153218 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153221 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153224 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153227 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153229 2556 flags.go:64] FLAG: --system-cgroups="" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153232 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153237 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153240 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153243 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153246 2556 flags.go:64] FLAG: --tls-min-version="" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153248 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153253 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 18:30:28.161287 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153256 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153258 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153261 2556 flags.go:64] FLAG: --v="2" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153265 2556 flags.go:64] FLAG: --version="false" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153270 2556 flags.go:64] FLAG: --vmodule="" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153274 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.153277 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153400 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153405 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153409 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153412 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153415 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153418 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153420 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153423 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153426 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153428 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153431 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153433 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153436 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153438 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:28.161907 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153440 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153443 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153446 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153448 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153450 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153453 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153455 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153458 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153460 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153462 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153466 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153468 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153471 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153475 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153479 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153483 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153485 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153488 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153490 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:28.162441 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153493 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153496 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153498 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153501 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153504 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153507 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153509 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153511 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153514 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153516 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153519 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153521 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153523 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153526 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153528 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153530 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153533 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153535 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153538 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153540 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:28.162901 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153543 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153545 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153548 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153551 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153554 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153556 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153559 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153561 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153565 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153567 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153570 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153572 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153574 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153577 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153580 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153582 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153585 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153588 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153590 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153592 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:28.163419 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153595 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153597 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153600 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153602 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153604 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153607 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153609 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153611 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153614 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153616 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153634 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153638 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153641 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153644 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153648 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153653 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153655 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153658 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153669 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:28.163941 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153672 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153677 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153680 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153683 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153685 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153688 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.153690 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.154204 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.161911 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.161929 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.161949 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.161955 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162030 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162036 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:28.164425 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162040 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162043 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162046 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162049 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162053 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162057 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162060 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162063 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162066 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162069 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162072 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162075 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162078 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162080 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162083 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162086 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162089 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162091 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162094 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:28.164784 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162096 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162098 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162101 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162103 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162106 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162109 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162113 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162117 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162121 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162124 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162127 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162130 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162132 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162135 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162137 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162140 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162142 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162145 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162147 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162150 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:28.165257 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162152 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162155 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162157 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162160 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162162 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162166 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162168 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162171 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162173 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162176 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162178 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162180 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162183 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162185 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162188 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162190 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162192 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162195 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162198 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162200 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:28.165765 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162204 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162206 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162209 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162211 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162214 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162216 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162219 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162222 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162224 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162226 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162229 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162231 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162234 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162236 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162239 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162242 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162244 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162248 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162253 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:28.166262 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162255 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162258 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162260 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162263 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162265 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162268 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162270 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162272 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162275 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162277 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162280 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162282 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162284 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162288 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162290 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162293 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162296 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162298 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:28.166749 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162301 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.162306 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162451 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162457 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162460 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162463 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162466 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162469 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162472 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162474 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162477 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162479 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162482 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162484 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162488 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:28.167222 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162491 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162493 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162496 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162498 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162501 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162503 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162507 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162511 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162513 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162516 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162518 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162521 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162524 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162526 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162529 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162532 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162534 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162537 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162539 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:28.167604 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162542 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162544 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162547 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162550 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162552 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162554 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162557 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162559 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162562 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162564 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162567 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162570 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162572 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162575 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162578 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162580 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162583 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162585 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162588 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162590 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:28.168057 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162593 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162595 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162597 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162600 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162603 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162605 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162608 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162610 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162613 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162615 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162618 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162621 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162623 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162625 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162628 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162630 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162633 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162635 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162638 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162640 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:28.168694 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162643 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162645 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162648 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162650 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162654 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162657 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162660 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162663 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162665 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162667 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162670 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162672 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162674 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162678 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162682 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162685 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162688 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162690 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162696 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:28.169181 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162698 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162701 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162703 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162706 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162708 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162711 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162714 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:28.162716 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.162721 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.162855 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.165495 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.166557 2556 server.go:1019] "Starting client certificate rotation" Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.166653 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:30:28.169676 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.166687 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:30:28.170014 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.168479 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:30:28.170014 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.169688 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:30:28.177719 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.177694 2556 log.go:25] "Validated CRI v1 runtime API" Jul 23 18:30:28.179805 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.179789 2556 log.go:25] "Validated CRI v1 image API" Jul 23 18:30:28.180674 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.180653 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 18:30:28.183866 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.183843 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 baab9ca8-64e7-4e7d-864c-6b5efea0cc14:/dev/nvme0n1p4 e9f43898-ee50-467b-86a8-bc5c055239fe:/dev/nvme0n1p3] Jul 23 18:30:28.183976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.183863 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 18:30:28.190640 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.190615 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:30:28.191219 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.191096 2556 manager.go:216] Machine: {Timestamp:2026-07-23 18:30:28.189933785 +0000 UTC m=+0.254166505 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2938180 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2362318b553832a4181d871094549f SystemUUID:ec236231-8b55-3832-a418-1d871094549f BootID:13af8ee8-989e-4b8e-99c4-1a93e7e2fcfd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:25:f7:49:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:25:f7:49:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:b3:62:9b:c4:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 18:30:28.191219 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.191216 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 18:30:28.191341 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.191319 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 18:30:28.194127 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.194095 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 18:30:28.194299 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.194129 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 18:30:28.195207 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.195193 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 18:30:28.195271 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.195212 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 18:30:28.195271 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.195222 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:30:28.195795 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.195783 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:30:28.196965 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.196952 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 18:30:28.200489 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200471 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:30:28.200699 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200687 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 18:30:28.200766 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200729 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 23 18:30:28.200766 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200744 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 18:30:28.200766 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200759 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 18:30:28.200882 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200775 2556 kubelet.go:398] "Adding apiserver pod source" Jul 23 18:30:28.200882 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.200788 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 18:30:28.201195 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.201180 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:30:28.201264 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.201203 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:30:28.203169 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.203148 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 18:30:28.204862 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.204848 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 18:30:28.204917 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.204880 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 18:30:28.205983 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.205968 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.205988 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.205994 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206000 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206010 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206015 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206023 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206029 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206036 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206042 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 18:30:28.206053 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206053 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 18:30:28.206321 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206061 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 18:30:28.206711 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206700 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 18:30:28.206749 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.206713 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 18:30:28.210264 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.210251 2556 server.go:1268] "Started kubelet" Jul 23 18:30:28.210388 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.210342 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 18:30:28.210587 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.210516 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 18:30:28.210641 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.210607 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 18:30:28.210986 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.210960 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 18:30:28.211048 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.211029 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 18:30:28.211167 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.211147 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 18:30:28.212280 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.212258 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 18:30:28.212504 ip-10-0-134-87 systemd[1]: Started Kubernetes Kubelet. Jul 23 18:30:28.213981 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.213965 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 23 18:30:28.214902 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.214175 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-87.ec2.internal.18c4feba3e6c5f45 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-87.ec2.internal,UID:ip-10-0-134-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-87.ec2.internal,},FirstTimestamp:2026-07-23 18:30:28.210220869 +0000 UTC m=+0.274453589,LastTimestamp:2026-07-23 18:30:28.210220869 +0000 UTC m=+0.274453589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-87.ec2.internal,}" Jul 23 18:30:28.218103 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.218086 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 18:30:28.218519 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.218503 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4mqbz" Jul 23 18:30:28.220266 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.220248 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 18:30:28.220313 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.220306 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 18:30:28.220745 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.220394 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.220879 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.220859 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 18:30:28.220941 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.220859 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 18:30:28.220941 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.220909 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 18:30:28.221044 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221003 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 23 18:30:28.221044 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221012 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 23 18:30:28.221144 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221084 2556 factory.go:55] Registering systemd factory Jul 23 18:30:28.221144 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221097 2556 factory.go:223] Registration of the systemd container factory successfully Jul 23 18:30:28.221312 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221297 2556 factory.go:153] Registering CRI-O factory Jul 23 18:30:28.221312 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221312 2556 factory.go:223] Registration of the crio container factory successfully Jul 23 18:30:28.221438 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221412 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 18:30:28.221486 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221441 2556 factory.go:103] Registering Raw factory Jul 23 18:30:28.221486 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221455 2556 manager.go:1196] Started watching for new ooms in manager Jul 23 18:30:28.221928 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.221912 2556 manager.go:349] Starting recovery of all containers Jul 23 18:30:28.223275 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.223242 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 18:30:28.223275 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.223248 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 18:30:28.227834 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.227807 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4mqbz" Jul 23 18:30:28.235779 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.235754 2556 manager.go:354] Recovery completed Jul 23 18:30:28.237143 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.237116 2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 23 18:30:28.240170 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.240158 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.242473 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.242454 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.242554 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.242484 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.242554 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.242495 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.243111 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243090 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 18:30:28.243111 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243104 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 18:30:28.243199 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243123 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:30:28.243199 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243106 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.243929 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243911 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.243995 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243943 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.243995 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.243955 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.245307 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.245295 2556 policy_none.go:49] "None policy: Start" Jul 23 18:30:28.245345 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.245312 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 18:30:28.245345 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.245322 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 18:30:28.247372 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.247349 2556 policy_none.go:47] "Start" Jul 23 18:30:28.289194 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289010 2556 manager.go:337] "Starting Device Plugin manager" Jul 23 18:30:28.289358 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.289227 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 18:30:28.289358 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289243 2556 server.go:87] "Starting device plugin registration server" Jul 23 18:30:28.289585 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289570 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 18:30:28.289647 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289587 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 18:30:28.289708 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289681 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 18:30:28.289791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289771 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 18:30:28.289791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.289787 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 18:30:28.290432 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.290406 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 18:30:28.290513 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.290470 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.349038 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.349000 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 18:30:28.351303 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.350436 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 18:30:28.351303 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.350476 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 18:30:28.351303 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.350504 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 18:30:28.351303 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.350545 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 18:30:28.353019 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.352999 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:28.390085 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.390033 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.391044 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.391024 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.391130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.391065 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.391130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.391081 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.391130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.391106 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.399242 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.399197 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.399242 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.399224 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-87.ec2.internal\": node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.418751 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.418726 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.451289 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.451262 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal"] Jul 23 18:30:28.451383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.451355 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.452844 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.452821 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.452844 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.452847 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.453003 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.452861 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.455151 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455137 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.455265 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455251 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.455310 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455281 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.455912 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455894 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.456013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455920 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.456013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455930 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.456013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455979 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.456013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.455998 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.456149 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.456031 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.458313 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.458299 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.458395 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.458331 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:28.459025 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.459007 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:28.459097 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.459039 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:28.459097 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.459048 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:28.486260 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.486233 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-87.ec2.internal\" not found" node="ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.490874 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.490855 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-87.ec2.internal\" not found" node="ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.519839 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.519808 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.522096 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.522076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7576914ea66934410936fa139f29b46e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-87.ec2.internal\" (UID: \"7576914ea66934410936fa139f29b46e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.522164 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.522105 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec2a918c1a6d6727f8085dac5a098ab9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal\" (UID: \"ec2a918c1a6d6727f8085dac5a098ab9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.522164 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.522133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec2a918c1a6d6727f8085dac5a098ab9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal\" (UID: \"ec2a918c1a6d6727f8085dac5a098ab9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.620289 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.620253 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.622504 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.622487 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec2a918c1a6d6727f8085dac5a098ab9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal\" (UID: \"ec2a918c1a6d6727f8085dac5a098ab9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.622568 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.622530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec2a918c1a6d6727f8085dac5a098ab9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal\" (UID: \"ec2a918c1a6d6727f8085dac5a098ab9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.622602 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.622568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec2a918c1a6d6727f8085dac5a098ab9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal\" (UID: \"ec2a918c1a6d6727f8085dac5a098ab9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.622636 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.622593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7576914ea66934410936fa139f29b46e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-87.ec2.internal\" (UID: \"7576914ea66934410936fa139f29b46e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.622636 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.622626 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7576914ea66934410936fa139f29b46e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-87.ec2.internal\" (UID: \"7576914ea66934410936fa139f29b46e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.622695 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.622676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec2a918c1a6d6727f8085dac5a098ab9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal\" (UID: \"ec2a918c1a6d6727f8085dac5a098ab9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.720951 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.720923 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.789281 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.789255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.794284 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:28.794124 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" Jul 23 18:30:28.821868 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.821837 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:28.922303 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:28.922262 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:29.022805 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:29.022725 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:29.123857 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:29.123820 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:29.166426 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.166392 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 18:30:29.166894 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.166571 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:30:29.225100 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:29.224972 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:29.234126 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.234088 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:25:28 +0000 UTC" deadline="2028-04-19 07:35:36.023612028 +0000 UTC" Jul 23 18:30:29.234126 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.234120 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15253h5m6.789495668s" Jul 23 18:30:29.326114 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:29.326074 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:29.401579 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:29.401544 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7576914ea66934410936fa139f29b46e.slice/crio-a3935a4ba8e48157db822351f79be176634b3b4a2d4876a866234269f09103ab WatchSource:0}: Error finding container a3935a4ba8e48157db822351f79be176634b3b4a2d4876a866234269f09103ab: Status 404 returned error can't find the container with id a3935a4ba8e48157db822351f79be176634b3b4a2d4876a866234269f09103ab Jul 23 18:30:29.405877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.405861 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:30:29.406885 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.406863 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:29.427076 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:29.427025 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-87.ec2.internal\" not found" Jul 23 18:30:29.438861 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.438840 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:29.521566 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.521530 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" Jul 23 18:30:29.532176 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.532111 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:30:29.532715 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:29.532681 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2a918c1a6d6727f8085dac5a098ab9.slice/crio-a33eff18089cc9a474f679c20e076380f8eb991bd9384e2a22da29ea1ebccb6b WatchSource:0}: Error finding container a33eff18089cc9a474f679c20e076380f8eb991bd9384e2a22da29ea1ebccb6b: Status 404 returned error can't find the container with id a33eff18089cc9a474f679c20e076380f8eb991bd9384e2a22da29ea1ebccb6b Jul 23 18:30:29.533701 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.533679 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" Jul 23 18:30:29.556995 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.556965 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:30:29.661573 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:29.661530 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:30.040349 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.040317 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:30.202469 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.202431 2556 apiserver.go:52] "Watching apiserver" Jul 23 18:30:30.210727 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.210695 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 18:30:30.211966 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.211932 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-frcgk","openshift-network-diagnostics/network-check-target-84nqc","openshift-network-operator/iptables-alerter-5pl4t","openshift-ovn-kubernetes/ovnkube-node-4snzp","kube-system/global-pull-secret-syncer-98ktb","kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf","openshift-cluster-node-tuning-operator/tuned-b8bgf","openshift-dns/node-resolver-884tl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-svptc","openshift-multus/network-metrics-daemon-j2x26","kube-system/konnectivity-agent-btd25","openshift-image-registry/node-ca-d9hs2"] Jul 23 18:30:30.214887 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.214856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.217621 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.217591 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 18:30:30.217998 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.217959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.217998 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.217998 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.218244 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.218220 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kc2h4\"" Jul 23 18:30:30.218594 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.218574 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.220324 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.220303 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.221915 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.221898 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 18:30:30.222108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.221960 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n265x\"" Jul 23 18:30:30.222230 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.222034 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 18:30:30.222299 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.222069 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 18:30:30.223049 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.223027 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 18:30:30.223129 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.223065 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qj7jf\"" Jul 23 18:30:30.223306 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.223287 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.223825 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.223803 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.223922 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.223840 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.233038 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233001 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 18:30:30.233176 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233047 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.233282 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233261 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-systemd-units\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.233445 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/730762ee-2e86-4599-81c6-a7045f3e5a8d-konnectivity-ca\") pod \"konnectivity-agent-btd25\" (UID: \"730762ee-2e86-4599-81c6-a7045f3e5a8d\") " pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.233445 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-run-netns\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.233445 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233419 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-node-log\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-sys-fs\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnwv\" (UniqueName: \"kubernetes.io/projected/372ecdff-679d-403a-b95a-4780b82538dd-kube-api-access-nvnwv\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0c92c99-8d45-4804-be59-afed93683013-host-slash\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfrg\" (UniqueName: \"kubernetes.io/projected/e0c92c99-8d45-4804-be59-afed93683013-kube-api-access-6wfrg\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-slash\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233699 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 18:30:30.233762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-device-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233778 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-etc-selinux\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/730762ee-2e86-4599-81c6-a7045f3e5a8d-agent-certs\") pod \"konnectivity-agent-btd25\" (UID: \"730762ee-2e86-4599-81c6-a7045f3e5a8d\") " pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-log-socket\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-env-overrides\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-systemd\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233969 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-etc-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233982 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233998 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234010 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-registration-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234087 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.234114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-kubelet\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-var-lib-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234184 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-ovn\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-cni-netd\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-ovnkube-config\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.233971 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tr5mf\"" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdc5\" (UniqueName: \"kubernetes.io/projected/7eb43c39-aac4-4255-a6e9-52452e79c852-kube-api-access-lpdc5\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0c92c99-8d45-4804-be59-afed93683013-iptables-alerter-script\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-cni-bin\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/372ecdff-679d-403a-b95a-4780b82538dd-ovn-node-metrics-cert\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-ovnkube-script-lib\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-socket-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.234796 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.235297 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.234909 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:30.238114 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.238088 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.240864 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.240310 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.241205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.241171 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxgl5\"" Jul 23 18:30:30.241419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.241171 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 18:30:30.242048 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.241885 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.242048 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.241985 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.243365 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.243344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.245271 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.245251 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.246225 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.246202 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.246330 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.246238 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rlvl\"" Jul 23 18:30:30.246330 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.245254 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.246330 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.245284 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pcg9q\"" Jul 23 18:30:30.246505 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.245705 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:30.246505 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.246024 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 18:30:30.246505 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.245979 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 18:30:30.246620 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.246505 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:30.246662 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.246043 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.247218 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.247197 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:30:30.249269 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.248973 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.251447 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.251419 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.252159 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.252106 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2ktq\"" Jul 23 18:30:30.252159 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.252149 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 18:30:30.252714 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.252691 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:30:30.253949 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.253918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.254083 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.254016 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:30.254256 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.254237 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 18:30:30.254355 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.254265 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 18:30:30.254623 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.254562 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qh76t\"" Jul 23 18:30:30.291605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.291540 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fnlhx" Jul 23 18:30:30.304013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.303578 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fnlhx" Jul 23 18:30:30.322609 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.322584 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-run-netns\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-sys-fs\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-kubelet\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysctl-conf\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnwv\" (UniqueName: \"kubernetes.io/projected/372ecdff-679d-403a-b95a-4780b82538dd-kube-api-access-nvnwv\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcb4\" (UniqueName: \"kubernetes.io/projected/c93af641-a2c7-48c8-bf03-7cceaebf7d46-kube-api-access-ftcb4\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0c92c99-8d45-4804-be59-afed93683013-host-slash\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfrg\" (UniqueName: \"kubernetes.io/projected/e0c92c99-8d45-4804-be59-afed93683013-kube-api-access-6wfrg\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-socket-dir-parent\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysctl-d\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/730762ee-2e86-4599-81c6-a7045f3e5a8d-agent-certs\") pod \"konnectivity-agent-btd25\" (UID: \"730762ee-2e86-4599-81c6-a7045f3e5a8d\") " pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-log-socket\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-kubernetes\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.337579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/039445b8-22d4-4879-a5fa-77d524773d62-hosts-file\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-etc-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.335974 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdc5\" (UniqueName: \"kubernetes.io/projected/7eb43c39-aac4-4255-a6e9-52452e79c852-kube-api-access-lpdc5\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-host\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-ovn\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-cni-netd\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cnibin\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-os-release\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfn79\" (UniqueName: \"kubernetes.io/projected/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-kube-api-access-vfn79\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336261 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-cnibin\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysconfig\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-dbus\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/372ecdff-679d-403a-b95a-4780b82538dd-ovn-node-metrics-cert\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-ovnkube-script-lib\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-netns\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-conf-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.338590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-systemd-units\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cni-binary-copy\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ad8740-0445-4268-a0ee-07a3791702ac-serviceca\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-os-release\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-var-lib-kubelet\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/730762ee-2e86-4599-81c6-a7045f3e5a8d-konnectivity-ca\") pod \"konnectivity-agent-btd25\" (UID: \"730762ee-2e86-4599-81c6-a7045f3e5a8d\") " pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-node-log\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-cni-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336756 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336816 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-cni-multus\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336841 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-etc-kubernetes\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-run-netns\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6f2x\" (UniqueName: \"kubernetes.io/projected/3318adb9-a38c-43f9-b886-74675249472a-kube-api-access-k6f2x\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336876 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-slash\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-device-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336908 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-sys-fs\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.339383 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-etc-selinux\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-kubelet-config\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336955 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.336968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3318adb9-a38c-43f9-b886-74675249472a-cni-binary-copy\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3318adb9-a38c-43f9-b886-74675249472a-multus-daemon-config\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e219726-d03a-4b82-9f21-76b72ba824c5-tmp\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxvj\" (UniqueName: \"kubernetes.io/projected/4e219726-d03a-4b82-9f21-76b72ba824c5-kube-api-access-4wxvj\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt75s\" (UniqueName: \"kubernetes.io/projected/039445b8-22d4-4879-a5fa-77d524773d62-kube-api-access-mt75s\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-cni-bin\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-multus-certs\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337230 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-system-cni-dir\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337269 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0c92c99-8d45-4804-be59-afed93683013-host-slash\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337292 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-env-overrides\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337310 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-systemd\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337364 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337382 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-registration-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-k8s-cni-cncf-io\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337449 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh88c\" (UniqueName: \"kubernetes.io/projected/e6ad8740-0445-4268-a0ee-07a3791702ac-kube-api-access-zh88c\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039445b8-22d4-4879-a5fa-77d524773d62-tmp-dir\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-system-cni-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.337515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-kubelet\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-var-lib-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-kubelet\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338375 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-log-socket\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338442 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-slash\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338495 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-systemd-units\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338514 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.338643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-etc-selinux\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339029 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-etc-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339081 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-ovn\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339123 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-cni-netd\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339139 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/730762ee-2e86-4599-81c6-a7045f3e5a8d-konnectivity-ca\") pod \"konnectivity-agent-btd25\" (UID: \"730762ee-2e86-4599-81c6-a7045f3e5a8d\") " pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.340959 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-ovnkube-config\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0c92c99-8d45-4804-be59-afed93683013-iptables-alerter-script\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-cni-bin\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-socket-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-modprobe-d\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-run\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-sys\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ad8740-0445-4268-a0ee-07a3791702ac-host\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-hostroot\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339592 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-systemd\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-lib-modules\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-tuned\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-node-log\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339670 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-systemd\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-host-cni-bin\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.341707 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-registration-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.342373 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339776 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-var-lib-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.339826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-socket-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.344406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-ovnkube-config\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.344643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-ovnkube-script-lib\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.345587 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.345741 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7eb43c39-aac4-4255-a6e9-52452e79c852-device-dir\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.346240 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/730762ee-2e86-4599-81c6-a7045f3e5a8d-agent-certs\") pod \"konnectivity-agent-btd25\" (UID: \"730762ee-2e86-4599-81c6-a7045f3e5a8d\") " pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.346318 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/372ecdff-679d-403a-b95a-4780b82538dd-env-overrides\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.346802 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/372ecdff-679d-403a-b95a-4780b82538dd-run-openvswitch\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.347036 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0c92c99-8d45-4804-be59-afed93683013-iptables-alerter-script\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.347205 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.346976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/372ecdff-679d-403a-b95a-4780b82538dd-ovn-node-metrics-cert\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.351426 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.351368 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnwv\" (UniqueName: \"kubernetes.io/projected/372ecdff-679d-403a-b95a-4780b82538dd-kube-api-access-nvnwv\") pod \"ovnkube-node-4snzp\" (UID: \"372ecdff-679d-403a-b95a-4780b82538dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.351979 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.351955 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfrg\" (UniqueName: \"kubernetes.io/projected/e0c92c99-8d45-4804-be59-afed93683013-kube-api-access-6wfrg\") pod \"iptables-alerter-5pl4t\" (UID: \"e0c92c99-8d45-4804-be59-afed93683013\") " pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.356039 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.355981 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdc5\" (UniqueName: \"kubernetes.io/projected/7eb43c39-aac4-4255-a6e9-52452e79c852-kube-api-access-lpdc5\") pod \"aws-ebs-csi-driver-node-gm4lf\" (UID: \"7eb43c39-aac4-4255-a6e9-52452e79c852\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.357370 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.357318 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" event={"ID":"ec2a918c1a6d6727f8085dac5a098ab9","Type":"ContainerStarted","Data":"a33eff18089cc9a474f679c20e076380f8eb991bd9384e2a22da29ea1ebccb6b"} Jul 23 18:30:30.358976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.358948 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" event={"ID":"7576914ea66934410936fa139f29b46e","Type":"ContainerStarted","Data":"a3935a4ba8e48157db822351f79be176634b3b4a2d4876a866234269f09103ab"} Jul 23 18:30:30.440972 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.440930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-k8s-cni-cncf-io\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.440984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh88c\" (UniqueName: \"kubernetes.io/projected/e6ad8740-0445-4268-a0ee-07a3791702ac-kube-api-access-zh88c\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441015 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039445b8-22d4-4879-a5fa-77d524773d62-tmp-dir\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-system-cni-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-modprobe-d\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-k8s-cni-cncf-io\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-run\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441166 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441153 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-sys\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-sys\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ad8740-0445-4268-a0ee-07a3791702ac-host\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-hostroot\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441250 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-modprobe-d\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-systemd\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441155 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-run\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441156 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-system-cni-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-lib-modules\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441332 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-systemd\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441336 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ad8740-0445-4268-a0ee-07a3791702ac-host\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-tuned\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441414 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-kubelet\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.441439 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysctl-conf\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcb4\" (UniqueName: \"kubernetes.io/projected/c93af641-a2c7-48c8-bf03-7cceaebf7d46-kube-api-access-ftcb4\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039445b8-22d4-4879-a5fa-77d524773d62-tmp-dir\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.441567 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.441516 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:30:30.94148754 +0000 UTC m=+3.005720273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-kubelet\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-lib-modules\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-hostroot\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441606 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-socket-dir-parent\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysctl-d\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-kubernetes\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441736 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysctl-conf\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.441681 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441743 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-socket-dir-parent\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/039445b8-22d4-4879-a5fa-77d524773d62-hosts-file\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441807 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-kubernetes\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.441822 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:30:30.941801211 +0000 UTC m=+3.006033918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441884 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/039445b8-22d4-4879-a5fa-77d524773d62-hosts-file\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-host\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.442399 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cnibin\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441935 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-host\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441887 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysctl-d\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-os-release\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441979 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.441990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cnibin\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfn79\" (UniqueName: \"kubernetes.io/projected/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-kube-api-access-vfn79\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-cnibin\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442045 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-os-release\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysconfig\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-dbus\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-cnibin\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442138 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-sysconfig\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-netns\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-netns\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442212 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-dbus\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-conf-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cni-binary-copy\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.443360 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442351 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-conf-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ad8740-0445-4268-a0ee-07a3791702ac-serviceca\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-os-release\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-var-lib-kubelet\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e219726-d03a-4b82-9f21-76b72ba824c5-var-lib-kubelet\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-os-release\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-cni-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442612 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-cni-multus\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442650 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-multus-cni-dir\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-cni-multus\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-etc-kubernetes\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6f2x\" (UniqueName: \"kubernetes.io/projected/3318adb9-a38c-43f9-b886-74675249472a-kube-api-access-k6f2x\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-kubelet-config\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3318adb9-a38c-43f9-b886-74675249472a-cni-binary-copy\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3318adb9-a38c-43f9-b886-74675249472a-multus-daemon-config\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e219726-d03a-4b82-9f21-76b72ba824c5-tmp\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ad8740-0445-4268-a0ee-07a3791702ac-serviceca\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.444385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxvj\" (UniqueName: \"kubernetes.io/projected/4e219726-d03a-4b82-9f21-76b72ba824c5-kube-api-access-4wxvj\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cni-binary-copy\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt75s\" (UniqueName: \"kubernetes.io/projected/039445b8-22d4-4879-a5fa-77d524773d62-kube-api-access-mt75s\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.442983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-cni-bin\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-etc-kubernetes\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-multus-certs\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443053 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-system-cni-dir\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443098 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-kubelet-config\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443097 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-var-lib-cni-bin\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443057 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3318adb9-a38c-43f9-b886-74675249472a-host-run-multus-certs\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443354 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c93af641-a2c7-48c8-bf03-7cceaebf7d46-system-cni-dir\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c93af641-a2c7-48c8-bf03-7cceaebf7d46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443698 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3318adb9-a38c-43f9-b886-74675249472a-multus-daemon-config\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.443712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3318adb9-a38c-43f9-b886-74675249472a-cni-binary-copy\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.445021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.444599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e219726-d03a-4b82-9f21-76b72ba824c5-etc-tuned\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.445774 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.445631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e219726-d03a-4b82-9f21-76b72ba824c5-tmp\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.457001 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.456970 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh88c\" (UniqueName: \"kubernetes.io/projected/e6ad8740-0445-4268-a0ee-07a3791702ac-kube-api-access-zh88c\") pod \"node-ca-d9hs2\" (UID: \"e6ad8740-0445-4268-a0ee-07a3791702ac\") " pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.463525 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.463469 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:30.463525 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.463525 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:30.463771 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.463547 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:30.463771 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.463637 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:30:30.963616334 +0000 UTC m=+3.027849062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:30.464184 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.464162 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcb4\" (UniqueName: \"kubernetes.io/projected/c93af641-a2c7-48c8-bf03-7cceaebf7d46-kube-api-access-ftcb4\") pod \"multus-additional-cni-plugins-svptc\" (UID: \"c93af641-a2c7-48c8-bf03-7cceaebf7d46\") " pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.465071 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.465050 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxvj\" (UniqueName: \"kubernetes.io/projected/4e219726-d03a-4b82-9f21-76b72ba824c5-kube-api-access-4wxvj\") pod \"tuned-b8bgf\" (UID: \"4e219726-d03a-4b82-9f21-76b72ba824c5\") " pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.467429 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.467391 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6f2x\" (UniqueName: \"kubernetes.io/projected/3318adb9-a38c-43f9-b886-74675249472a-kube-api-access-k6f2x\") pod \"multus-frcgk\" (UID: \"3318adb9-a38c-43f9-b886-74675249472a\") " pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.467544 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.467442 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt75s\" (UniqueName: \"kubernetes.io/projected/039445b8-22d4-4879-a5fa-77d524773d62-kube-api-access-mt75s\") pod \"node-resolver-884tl\" (UID: \"039445b8-22d4-4879-a5fa-77d524773d62\") " pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.467874 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.467847 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfn79\" (UniqueName: \"kubernetes.io/projected/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-kube-api-access-vfn79\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.537705 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.537663 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" Jul 23 18:30:30.554641 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.554552 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:30.571536 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.571496 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5pl4t" Jul 23 18:30:30.577816 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.577784 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:30.586889 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.586863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d9hs2" Jul 23 18:30:30.593840 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.593817 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-884tl" Jul 23 18:30:30.602946 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.602919 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-frcgk" Jul 23 18:30:30.613194 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.613169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" Jul 23 18:30:30.619283 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.619256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svptc" Jul 23 18:30:30.947925 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.947877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:30.948145 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:30.947940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:30.948145 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.948067 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:30.948145 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.948076 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:30.948254 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.948149 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:30:31.948129506 +0000 UTC m=+4.012362234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:30.948254 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:30.948170 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:30:31.948159147 +0000 UTC m=+4.012391863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:31.049423 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.049347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:31.049602 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.049562 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:31.049602 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.049595 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:31.049705 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.049607 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:31.049705 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.049669 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:30:32.049652003 +0000 UTC m=+4.113884729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:31.307112 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.307033 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:25:30 +0000 UTC" deadline="2028-04-09 06:16:02.11721673 +0000 UTC" Jul 23 18:30:31.307112 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.307107 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15011h45m30.810115059s" Jul 23 18:30:31.351701 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.351656 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:31.351885 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.351792 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:31.351885 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.351852 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:31.352041 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.352004 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:31.587935 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.587904 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730762ee_2e86_4599_81c6_a7045f3e5a8d.slice/crio-18e1cfa7e7ab8ec32fa3cf0c7a10174e481c86976498d3417430af2410b0107c WatchSource:0}: Error finding container 18e1cfa7e7ab8ec32fa3cf0c7a10174e481c86976498d3417430af2410b0107c: Status 404 returned error can't find the container with id 18e1cfa7e7ab8ec32fa3cf0c7a10174e481c86976498d3417430af2410b0107c Jul 23 18:30:31.589286 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.589253 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93af641_a2c7_48c8_bf03_7cceaebf7d46.slice/crio-b6187e3474c45b6557ba0081d4c6ff9ca8e280e70d29c778cb9b611f0d640c42 WatchSource:0}: Error finding container b6187e3474c45b6557ba0081d4c6ff9ca8e280e70d29c778cb9b611f0d640c42: Status 404 returned error can't find the container with id b6187e3474c45b6557ba0081d4c6ff9ca8e280e70d29c778cb9b611f0d640c42 Jul 23 18:30:31.595160 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.595135 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c92c99_8d45_4804_be59_afed93683013.slice/crio-2bc203524f0034afdc3aac1fde22a797cc85ecd6a05291333f1064859e0d679b WatchSource:0}: Error finding container 2bc203524f0034afdc3aac1fde22a797cc85ecd6a05291333f1064859e0d679b: Status 404 returned error can't find the container with id 2bc203524f0034afdc3aac1fde22a797cc85ecd6a05291333f1064859e0d679b Jul 23 18:30:31.597019 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.596800 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb43c39_aac4_4255_a6e9_52452e79c852.slice/crio-e0ed287adb480cb707f58836c01841edcefd71e31521a59602b9950b3d16a487 WatchSource:0}: Error finding container e0ed287adb480cb707f58836c01841edcefd71e31521a59602b9950b3d16a487: Status 404 returned error can't find the container with id e0ed287adb480cb707f58836c01841edcefd71e31521a59602b9950b3d16a487 Jul 23 18:30:31.597996 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.597873 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ad8740_0445_4268_a0ee_07a3791702ac.slice/crio-70d4b14901d984cf959ce6ada3fb44ddbfeea53dce95f1a1466600f527dc3433 WatchSource:0}: Error finding container 70d4b14901d984cf959ce6ada3fb44ddbfeea53dce95f1a1466600f527dc3433: Status 404 returned error can't find the container with id 70d4b14901d984cf959ce6ada3fb44ddbfeea53dce95f1a1466600f527dc3433 Jul 23 18:30:31.599135 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.599091 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039445b8_22d4_4879_a5fa_77d524773d62.slice/crio-3ea86d1e95c80774ee0d81d31ac3483855a2727b837d26515afd6d4e84a0ed73 WatchSource:0}: Error finding container 3ea86d1e95c80774ee0d81d31ac3483855a2727b837d26515afd6d4e84a0ed73: Status 404 returned error can't find the container with id 3ea86d1e95c80774ee0d81d31ac3483855a2727b837d26515afd6d4e84a0ed73 Jul 23 18:30:31.600274 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:30:31.600212 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e219726_d03a_4b82_9f21_76b72ba824c5.slice/crio-c4e09b91f3f0cc3c1593587ca132fa88616780f798f799f12b0b939ce537a4fa WatchSource:0}: Error finding container c4e09b91f3f0cc3c1593587ca132fa88616780f798f799f12b0b939ce537a4fa: Status 404 returned error can't find the container with id c4e09b91f3f0cc3c1593587ca132fa88616780f798f799f12b0b939ce537a4fa Jul 23 18:30:31.957689 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.957653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:31.957841 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:31.957697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:31.957841 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.957804 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:31.957841 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.957821 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:31.957959 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.957865 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:30:33.957848066 +0000 UTC m=+6.022080777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:31.957959 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:31.957885 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:30:33.957871863 +0000 UTC m=+6.022104572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:32.058700 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.058656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:32.058914 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:32.058828 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:32.058914 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:32.058855 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:32.058914 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:32.058867 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:32.059062 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:32.058926 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:30:34.058909392 +0000 UTC m=+6.123142101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:32.307397 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.307340 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:25:30 +0000 UTC" deadline="2028-04-02 12:57:38.368876708 +0000 UTC" Jul 23 18:30:32.307397 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.307394 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14850h27m6.061487381s" Jul 23 18:30:32.354290 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.354249 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:32.354489 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:32.354403 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:32.368474 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.368348 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" event={"ID":"4e219726-d03a-4b82-9f21-76b72ba824c5","Type":"ContainerStarted","Data":"c4e09b91f3f0cc3c1593587ca132fa88616780f798f799f12b0b939ce537a4fa"} Jul 23 18:30:32.384458 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.384328 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-884tl" event={"ID":"039445b8-22d4-4879-a5fa-77d524773d62","Type":"ContainerStarted","Data":"3ea86d1e95c80774ee0d81d31ac3483855a2727b837d26515afd6d4e84a0ed73"} Jul 23 18:30:32.388709 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.388596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerStarted","Data":"b6187e3474c45b6557ba0081d4c6ff9ca8e280e70d29c778cb9b611f0d640c42"} Jul 23 18:30:32.396863 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.396779 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-btd25" event={"ID":"730762ee-2e86-4599-81c6-a7045f3e5a8d","Type":"ContainerStarted","Data":"18e1cfa7e7ab8ec32fa3cf0c7a10174e481c86976498d3417430af2410b0107c"} Jul 23 18:30:32.405013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.404891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-frcgk" event={"ID":"3318adb9-a38c-43f9-b886-74675249472a","Type":"ContainerStarted","Data":"881098aaa3f0447ffcc3036e77b9061cd471ff1b18e9023dcfa4c40dd0243071"} Jul 23 18:30:32.417021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.416980 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec2a918c1a6d6727f8085dac5a098ab9" containerID="9487f11c3ec05a43b660c975c142e1ad746f678e5f5efd06c83866a061fbc524" exitCode=0 Jul 23 18:30:32.417419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.417329 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" event={"ID":"ec2a918c1a6d6727f8085dac5a098ab9","Type":"ContainerDied","Data":"9487f11c3ec05a43b660c975c142e1ad746f678e5f5efd06c83866a061fbc524"} Jul 23 18:30:32.432144 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.431954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" event={"ID":"7576914ea66934410936fa139f29b46e","Type":"ContainerStarted","Data":"a39b0951a1190f8623a94e4651668f0ad307e60709cf3aac40c6e32017f555ca"} Jul 23 18:30:32.444724 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.444573 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" event={"ID":"7eb43c39-aac4-4255-a6e9-52452e79c852","Type":"ContainerStarted","Data":"e0ed287adb480cb707f58836c01841edcefd71e31521a59602b9950b3d16a487"} Jul 23 18:30:32.453005 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.452966 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5pl4t" event={"ID":"e0c92c99-8d45-4804-be59-afed93683013","Type":"ContainerStarted","Data":"2bc203524f0034afdc3aac1fde22a797cc85ecd6a05291333f1064859e0d679b"} Jul 23 18:30:32.453223 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.453153 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-87.ec2.internal" podStartSLOduration=2.453133155 podStartE2EDuration="2.453133155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:32.452769816 +0000 UTC m=+4.517002549" watchObservedRunningTime="2026-07-23 18:30:32.453133155 +0000 UTC m=+4.517365892" Jul 23 18:30:32.478533 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.478298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d9hs2" event={"ID":"e6ad8740-0445-4268-a0ee-07a3791702ac","Type":"ContainerStarted","Data":"70d4b14901d984cf959ce6ada3fb44ddbfeea53dce95f1a1466600f527dc3433"} Jul 23 18:30:32.497682 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:32.497614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"5c1f6a2919f87b331df9322716c7a38466824ba5f5cb6a14d8040bda48b9f262"} Jul 23 18:30:33.352153 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:33.351339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:33.352153 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:33.351572 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:33.352153 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:33.352016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:33.352153 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:33.352113 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:33.516574 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:33.516530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" event={"ID":"ec2a918c1a6d6727f8085dac5a098ab9","Type":"ContainerStarted","Data":"fd81ee8aaf2cbed38c414910dd2d3bd8d2663ac785a0a7bb358edeadf9aebab2"} Jul 23 18:30:33.984097 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:33.983253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:33.984097 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:33.983315 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:33.984097 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:33.983501 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:33.984097 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:33.983570 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:30:37.983548807 +0000 UTC m=+10.047781523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:33.984097 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:33.983996 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:33.984097 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:33.984052 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:30:37.984035774 +0000 UTC m=+10.048268486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:34.084372 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:34.084319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:34.084651 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:34.084587 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:34.084651 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:34.084623 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:34.084787 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:34.084677 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:34.084787 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:34.084753 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:30:38.084729407 +0000 UTC m=+10.148962131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:34.352401 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:34.351809 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:34.352401 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:34.351950 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:35.350982 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:35.350928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:35.351199 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:35.351084 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:35.351681 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:35.351495 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:35.351681 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:35.351626 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:36.356385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:36.356339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:36.356881 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:36.356489 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:37.351578 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:37.351539 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:37.351765 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:37.351693 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:37.352107 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:37.352084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:37.352233 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:37.352208 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:38.018943 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:38.018898 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:38.019447 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:38.018973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:38.019447 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.019086 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:38.019447 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.019137 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:38.019447 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.019164 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:30:46.019143226 +0000 UTC m=+18.083375950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:38.019447 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.019195 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:30:46.019176475 +0000 UTC m=+18.083409185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:38.119831 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:38.119793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:38.120018 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.119970 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:38.120018 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.119997 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:38.120018 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.120010 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:38.120169 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.120063 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:30:46.120048186 +0000 UTC m=+18.184280896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:38.355144 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:38.354675 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:38.355144 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:38.354790 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:39.351421 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:39.351351 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:39.351878 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:39.351382 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:39.351878 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:39.351552 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:39.351878 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:39.351669 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:40.351453 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:40.351413 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:40.351885 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:40.351552 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:41.351788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:41.351124 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:41.351788 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:41.351269 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:41.351788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:41.351658 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:41.351788 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:41.351749 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:42.351503 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:42.351464 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:42.351695 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:42.351601 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:43.351568 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:43.351535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:43.351971 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:43.351549 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:43.351971 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:43.351657 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:43.351971 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:43.351714 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:44.351312 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:44.351274 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:44.351518 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:44.351442 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:45.351305 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:45.351271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:45.351789 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:45.351276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:45.351789 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:45.351438 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:45.351789 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:45.351467 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:46.078918 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:46.078870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:46.079096 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:46.078928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:46.079096 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.079046 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:46.079211 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.079134 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:31:02.07911238 +0000 UTC m=+34.143345120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:46.079211 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.079069 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:46.079211 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.079207 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:31:02.079192988 +0000 UTC m=+34.143425701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:46.179904 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:46.179872 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:46.180118 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.180089 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:46.180165 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.180124 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:46.180165 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.180135 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:46.180233 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.180202 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:31:02.180188647 +0000 UTC m=+34.244421367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:46.351129 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:46.351053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:46.351261 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:46.351184 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:47.350972 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:47.350936 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:47.351525 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:47.350951 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:47.351525 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:47.351088 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:47.351525 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:47.351243 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:48.352355 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:48.352315 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:48.352777 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:48.352440 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:49.351082 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:49.351044 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:49.351241 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:49.351091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:49.351241 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:49.351171 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:49.351338 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:49.351301 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:50.351410 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:50.351340 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:50.352025 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:50.351475 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:51.351483 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.351434 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:51.351982 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:51.351591 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:51.351982 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.351434 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:51.351982 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:51.351699 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:51.565708 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.565503 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" event={"ID":"7eb43c39-aac4-4255-a6e9-52452e79c852","Type":"ContainerStarted","Data":"829aaf6f2f8ec795e4cce6facf563638aa003d18f8286dfc7e65b5a8df3a26b4"} Jul 23 18:30:51.566974 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.566942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d9hs2" event={"ID":"e6ad8740-0445-4268-a0ee-07a3791702ac","Type":"ContainerStarted","Data":"4e40280434b8a2a051ae776cb18a999bc452522cf07915bfd1f03f9d64fcf703"} Jul 23 18:30:51.568600 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.568571 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"efdab39c0593c294ba35bc803c8ffb465bfee320b337b39a8f7a73b26ce2d898"} Jul 23 18:30:51.570164 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.570125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" event={"ID":"4e219726-d03a-4b82-9f21-76b72ba824c5","Type":"ContainerStarted","Data":"9a4ce9af0ffb2be69bf14194e17b8b0e380cb333d60d9911310e373eb6d725cf"} Jul 23 18:30:51.571589 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.571560 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-884tl" event={"ID":"039445b8-22d4-4879-a5fa-77d524773d62","Type":"ContainerStarted","Data":"9c3d29c3c25a241f37c4340a05d1e720e9cb3218925b1e4f69d13a85aeafaeef"} Jul 23 18:30:51.573318 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.573295 2556 generic.go:356] "Generic (PLEG): container finished" podID="c93af641-a2c7-48c8-bf03-7cceaebf7d46" containerID="7b13218c27fa2dab2abbad1718f86c8806d46851036e9e9eda2ffc43045c9967" exitCode=0 Jul 23 18:30:51.573425 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.573377 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerDied","Data":"7b13218c27fa2dab2abbad1718f86c8806d46851036e9e9eda2ffc43045c9967"} Jul 23 18:30:51.575102 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.575079 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-btd25" event={"ID":"730762ee-2e86-4599-81c6-a7045f3e5a8d","Type":"ContainerStarted","Data":"623a02b608ac727a13d01911ce3defcd61cbae9466588aad434917507a9bfab6"} Jul 23 18:30:51.576696 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.576670 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-frcgk" event={"ID":"3318adb9-a38c-43f9-b886-74675249472a","Type":"ContainerStarted","Data":"a19b82b1ca2cbff0697211f34a366a30133a4137c23dfb0671e10f9d19c20aef"} Jul 23 18:30:51.582535 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.582295 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d9hs2" podStartSLOduration=3.074981675 podStartE2EDuration="22.582277912s" totalImagesPullingTime="19.507296237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:51.582238593 +0000 UTC m=+23.646471324" watchObservedRunningTime="2026-07-23 18:30:51.582277912 +0000 UTC m=+23.646510642" Jul 23 18:30:51.582999 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.582965 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-87.ec2.internal" podStartSLOduration=21.582954404 podStartE2EDuration="21.582954404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:33.547736368 +0000 UTC m=+5.611969102" watchObservedRunningTime="2026-07-23 18:30:51.582954404 +0000 UTC m=+23.647187164" Jul 23 18:30:51.618665 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.618622 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-884tl" podStartSLOduration=3.337631399 podStartE2EDuration="22.618606647s" totalImagesPullingTime="19.280975248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:51.618356944 +0000 UTC m=+23.682589674" watchObservedRunningTime="2026-07-23 18:30:51.618606647 +0000 UTC m=+23.682839377" Jul 23 18:30:51.618863 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.618839 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-btd25" podStartSLOduration=3.383884762 podStartE2EDuration="22.618830843s" totalImagesPullingTime="19.234946081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:51.599672464 +0000 UTC m=+23.663905190" watchObservedRunningTime="2026-07-23 18:30:51.618830843 +0000 UTC m=+23.683063573" Jul 23 18:30:51.663708 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.663650 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-frcgk" podStartSLOduration=3.142394934 podStartE2EDuration="22.663626026s" totalImagesPullingTime="19.521231092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:51.638955568 +0000 UTC m=+23.703188480" watchObservedRunningTime="2026-07-23 18:30:51.663626026 +0000 UTC m=+23.727858756" Jul 23 18:30:51.697187 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:51.697126 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b8bgf" podStartSLOduration=3.396723923 podStartE2EDuration="22.69710338s" totalImagesPullingTime="19.300379457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:51.664120856 +0000 UTC m=+23.728353602" watchObservedRunningTime="2026-07-23 18:30:51.69710338 +0000 UTC m=+23.761336109" Jul 23 18:30:52.351825 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.351585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:52.352604 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:52.351939 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:52.580955 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.580921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5pl4t" event={"ID":"e0c92c99-8d45-4804-be59-afed93683013","Type":"ContainerStarted","Data":"1b2ccf048c960c4b0118aad08026dc7c837bc46655c71b4b8eeb6860b4e21d18"} Jul 23 18:30:52.583796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.583772 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:30:52.584159 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.584133 2556 generic.go:356] "Generic (PLEG): container finished" podID="372ecdff-679d-403a-b95a-4780b82538dd" containerID="a6e1cc3c8e124422e93dc0f5a04143d748ae3e9de359242b47468a0942bf9dbe" exitCode=1 Jul 23 18:30:52.584271 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.584225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"785a8c5ba255530c4b1818fd782e0766416660cda8f8232ca6cecd3ac76d2416"} Jul 23 18:30:52.584332 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.584321 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"571f54b88e612d9e1cc4c81afb2b626753f1d30096cca9ae7a04356b8e16220b"} Jul 23 18:30:52.584400 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.584355 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"c1d5a356de2cb77eada3c487eafb87c7af3eedd090d39adbf29d6bd754dd7a9d"} Jul 23 18:30:52.584462 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.584407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"1042633c22178352bceeff3e9d353d00a54a0bd67ec9daef5f3b21352487f2cd"} Jul 23 18:30:52.584462 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.584441 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerDied","Data":"a6e1cc3c8e124422e93dc0f5a04143d748ae3e9de359242b47468a0942bf9dbe"} Jul 23 18:30:52.596467 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.596419 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5pl4t" podStartSLOduration=4.08497569 podStartE2EDuration="23.596402621s" totalImagesPullingTime="19.511426931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:52.595857569 +0000 UTC m=+24.660090299" watchObservedRunningTime="2026-07-23 18:30:52.596402621 +0000 UTC m=+24.660635349" Jul 23 18:30:52.786811 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:52.786779 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 18:30:53.302496 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.302325 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:30:52.786805313Z","UUID":"f8a286f5-d954-42bc-bdbb-955879345824","Handler":null,"Name":"","Endpoint":""} Jul 23 18:30:53.304937 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.304387 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 18:30:53.304937 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.304433 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 18:30:53.309830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.309804 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:53.310448 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.310424 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:53.351561 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.351531 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:53.351726 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:53.351658 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:53.352049 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.352026 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:53.352455 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:53.352128 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:53.590107 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.590027 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" event={"ID":"7eb43c39-aac4-4255-a6e9-52452e79c852","Type":"ContainerStarted","Data":"38cc0bebbd8c9420deb5ea7d9057f32789d1b8cb3999301c656604461b5793e8"} Jul 23 18:30:53.590107 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.590096 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:53.590910 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:53.590888 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-btd25" Jul 23 18:30:54.351349 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:54.351268 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:54.351511 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:54.351397 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:54.593951 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:54.593911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" event={"ID":"7eb43c39-aac4-4255-a6e9-52452e79c852","Type":"ContainerStarted","Data":"be8b2f933287d8306f35e5785a09383397a18bf39785692534231c71c8733885"} Jul 23 18:30:54.597494 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:54.597471 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:30:54.597955 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:54.597925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"2e473ae07061a6c20e19f6fdaac4678c816e84452b0955a699c752fe1d8e45bf"} Jul 23 18:30:54.612836 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:54.612747 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gm4lf" podStartSLOduration=3.931580873 podStartE2EDuration="25.612731643s" totalImagesPullingTime="21.68115077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:54.61262395 +0000 UTC m=+26.676856693" watchObservedRunningTime="2026-07-23 18:30:54.612731643 +0000 UTC m=+26.676964372" Jul 23 18:30:55.351528 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:55.351493 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:55.351734 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:55.351509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:55.351734 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:55.351642 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:55.351844 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:55.351741 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:56.350995 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.350846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:56.351696 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:56.351125 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:56.606378 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.606288 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:30:56.606688 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.606663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"df156fbef770e35f3e5e15118c09b44dd6e377ca42ebbd11be6180621790aeeb"} Jul 23 18:30:56.607052 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.607027 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:56.607189 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.607171 2556 scope.go:117] "RemoveContainer" containerID="a6e1cc3c8e124422e93dc0f5a04143d748ae3e9de359242b47468a0942bf9dbe" Jul 23 18:30:56.608548 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.608519 2556 generic.go:356] "Generic (PLEG): container finished" podID="c93af641-a2c7-48c8-bf03-7cceaebf7d46" containerID="80b800c96751f71151377284b7e753e1ee542b8287c5284bdbd72ae8dc2c5b57" exitCode=0 Jul 23 18:30:56.608661 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.608563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerDied","Data":"80b800c96751f71151377284b7e753e1ee542b8287c5284bdbd72ae8dc2c5b57"} Jul 23 18:30:56.625775 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:56.625748 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:57.351500 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.351301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:57.351910 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.351301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:57.351910 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:57.351572 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:57.351910 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:57.351648 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:57.615433 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.615343 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:30:57.615807 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.615781 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" event={"ID":"372ecdff-679d-403a-b95a-4780b82538dd","Type":"ContainerStarted","Data":"ccaae9d6bc490e8a9acfaf7231e6ce82dac4f2c70ec201609e72f25ef0298588"} Jul 23 18:30:57.616894 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.616869 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:57.616991 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.616933 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:57.636788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.636759 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:30:57.653966 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:57.653605 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" podStartSLOduration=8.888761228 podStartE2EDuration="28.65355928s" totalImagesPullingTime="19.764798052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:57.651797586 +0000 UTC m=+29.716030322" watchObservedRunningTime="2026-07-23 18:30:57.65355928 +0000 UTC m=+29.717792009" Jul 23 18:30:58.309239 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.309208 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-98ktb"] Jul 23 18:30:58.309397 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.309346 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:30:58.309497 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:58.309474 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:30:58.312398 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.312351 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84nqc"] Jul 23 18:30:58.312548 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.312522 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:30:58.312691 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:58.312631 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:30:58.313008 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.312985 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2x26"] Jul 23 18:30:58.313110 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.313084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:30:58.313175 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:30:58.313159 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:30:58.619956 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.619863 2556 generic.go:356] "Generic (PLEG): container finished" podID="c93af641-a2c7-48c8-bf03-7cceaebf7d46" containerID="2e4edd0cca97b3a2cf4d792552a6e2d013940da4ccbea6199a4d3b5669954e0c" exitCode=0 Jul 23 18:30:58.620347 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:58.619946 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerDied","Data":"2e4edd0cca97b3a2cf4d792552a6e2d013940da4ccbea6199a4d3b5669954e0c"} Jul 23 18:30:59.624392 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:59.624282 2556 generic.go:356] "Generic (PLEG): container finished" podID="c93af641-a2c7-48c8-bf03-7cceaebf7d46" containerID="699e2c75c6f1c7cd05d1d272c5ef0d182c46780a662b0af25239393761feb94a" exitCode=0 Jul 23 18:30:59.624392 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:30:59.624375 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerDied","Data":"699e2c75c6f1c7cd05d1d272c5ef0d182c46780a662b0af25239393761feb94a"} Jul 23 18:31:00.351710 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:00.351678 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:00.351867 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:00.351679 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:00.351867 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:00.351810 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:31:00.352063 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:00.351876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:00.352063 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:00.351992 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:31:00.352318 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:00.352083 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:31:02.105247 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:02.105196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:02.105774 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:02.105275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:02.105774 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.105398 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:31:02.105774 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.105434 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:31:02.105774 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.105480 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret podName:08e6500c-f4b5-4261-9d97-7d52ddc8b50f nodeName:}" failed. No retries permitted until 2026-07-23 18:31:34.105456324 +0000 UTC m=+66.169689039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret") pod "global-pull-secret-syncer-98ktb" (UID: "08e6500c-f4b5-4261-9d97-7d52ddc8b50f") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:31:02.105774 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.105502 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs podName:5aa30c19-bbbe-4e43-9f16-c0fd591f55ba nodeName:}" failed. No retries permitted until 2026-07-23 18:31:34.105491536 +0000 UTC m=+66.169724253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs") pod "network-metrics-daemon-j2x26" (UID: "5aa30c19-bbbe-4e43-9f16-c0fd591f55ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:31:02.206275 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:02.206243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:02.206469 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.206402 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:31:02.206469 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.206420 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:31:02.206469 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.206429 2556 projected.go:196] Error preparing data for projected volume kube-api-access-954zk for pod openshift-network-diagnostics/network-check-target-84nqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:31:02.206604 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.206476 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk podName:9313dd27-2e51-4a76-8724-e69e100209cd nodeName:}" failed. No retries permitted until 2026-07-23 18:31:34.206463196 +0000 UTC m=+66.270695903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-954zk" (UniqueName: "kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk") pod "network-check-target-84nqc" (UID: "9313dd27-2e51-4a76-8724-e69e100209cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:31:02.350822 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:02.350781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:02.350822 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:02.350822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:02.351057 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:02.350786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:02.351057 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.350922 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:31:02.351057 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.351026 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:31:02.351206 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:02.351132 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:31:03.537000 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:03.536794 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-884tl_039445b8-22d4-4879-a5fa-77d524773d62/dns-node-resolver/0.log" Jul 23 18:31:04.351634 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:04.351596 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:04.351814 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:04.351601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:04.351814 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:04.351738 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:04.351814 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:04.351728 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98ktb" podUID="08e6500c-f4b5-4261-9d97-7d52ddc8b50f" Jul 23 18:31:04.351941 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:04.351843 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84nqc" podUID="9313dd27-2e51-4a76-8724-e69e100209cd" Jul 23 18:31:04.351982 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:04.351952 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2x26" podUID="5aa30c19-bbbe-4e43-9f16-c0fd591f55ba" Jul 23 18:31:04.510332 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:04.510299 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d9hs2_e6ad8740-0445-4268-a0ee-07a3791702ac/node-ca/0.log" Jul 23 18:31:05.305570 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.305539 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-87.ec2.internal" event="NodeReady" Jul 23 18:31:05.306022 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.305685 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 18:31:05.356591 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.356549 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wlg4z"] Jul 23 18:31:05.381082 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.381053 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-khm8l"] Jul 23 18:31:05.381250 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.381162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.383899 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.383872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ndjj8\"" Jul 23 18:31:05.383899 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.383893 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 18:31:05.384123 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.383922 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 18:31:05.384123 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.383982 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 18:31:05.405588 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.405554 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wlg4z"] Jul 23 18:31:05.405588 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.405585 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-khm8l"] Jul 23 18:31:05.405754 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.405606 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wqrjk"] Jul 23 18:31:05.405754 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.405677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.409276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.408835 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7rvg\"" Jul 23 18:31:05.409276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.409062 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 18:31:05.409276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.409068 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 18:31:05.409276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.409085 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 18:31:05.409562 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.409394 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 18:31:05.423454 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.423426 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wqrjk"] Jul 23 18:31:05.423601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.423537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.426038 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.426016 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 18:31:05.426518 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.426502 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55lsf\"" Jul 23 18:31:05.426582 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.426506 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 18:31:05.530345 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/95b44360-7f38-440c-838e-a814a4829aeb-data-volume\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.530345 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-config-volume\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530400 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-tmp-dir\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530428 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4slxk\" (UniqueName: \"kubernetes.io/projected/95b44360-7f38-440c-838e-a814a4829aeb-kube-api-access-4slxk\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530519 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97f1f06c-b84f-4a95-b24a-ff753395b11f-cert\") pod \"ingress-canary-wlg4z\" (UID: \"97f1f06c-b84f-4a95-b24a-ff753395b11f\") " pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/95b44360-7f38-440c-838e-a814a4829aeb-crio-socket\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.530620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530577 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrdq\" (UniqueName: \"kubernetes.io/projected/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-kube-api-access-mwrdq\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.530832 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvln\" (UniqueName: \"kubernetes.io/projected/97f1f06c-b84f-4a95-b24a-ff753395b11f-kube-api-access-8cvln\") pod \"ingress-canary-wlg4z\" (UID: \"97f1f06c-b84f-4a95-b24a-ff753395b11f\") " pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.530832 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.530679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.631307 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631233 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-tmp-dir\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.631307 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.631307 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631318 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4slxk\" (UniqueName: \"kubernetes.io/projected/95b44360-7f38-440c-838e-a814a4829aeb-kube-api-access-4slxk\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97f1f06c-b84f-4a95-b24a-ff753395b11f-cert\") pod \"ingress-canary-wlg4z\" (UID: \"97f1f06c-b84f-4a95-b24a-ff753395b11f\") " pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:05.631413 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:05.631466 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/95b44360-7f38-440c-838e-a814a4829aeb-crio-socket\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:05.631507 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:06.131486256 +0000 UTC m=+38.195718984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : configmap "kube-rbac-proxy" not found Jul 23 18:31:05.631542 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:05.631537 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:06.131519387 +0000 UTC m=+38.195752094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631555 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrdq\" (UniqueName: \"kubernetes.io/projected/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-kube-api-access-mwrdq\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvln\" (UniqueName: \"kubernetes.io/projected/97f1f06c-b84f-4a95-b24a-ff753395b11f-kube-api-access-8cvln\") pod \"ingress-canary-wlg4z\" (UID: \"97f1f06c-b84f-4a95-b24a-ff753395b11f\") " pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/95b44360-7f38-440c-838e-a814a4829aeb-data-volume\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-config-volume\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/95b44360-7f38-440c-838e-a814a4829aeb-crio-socket\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631679 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-tmp-dir\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:05.631760 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:05.631852 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:05.631820 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls podName:4fdec47e-b7c8-4c90-b03f-71d11333e6cf nodeName:}" failed. No retries permitted until 2026-07-23 18:31:06.131806475 +0000 UTC m=+38.196039183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls") pod "dns-default-wqrjk" (UID: "4fdec47e-b7c8-4c90-b03f-71d11333e6cf") : secret "dns-default-metrics-tls" not found Jul 23 18:31:05.632147 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.631986 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/95b44360-7f38-440c-838e-a814a4829aeb-data-volume\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.632181 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.632161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-config-volume\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.635703 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.635685 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97f1f06c-b84f-4a95-b24a-ff753395b11f-cert\") pod \"ingress-canary-wlg4z\" (UID: \"97f1f06c-b84f-4a95-b24a-ff753395b11f\") " pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.643358 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.643323 2556 generic.go:356] "Generic (PLEG): container finished" podID="c93af641-a2c7-48c8-bf03-7cceaebf7d46" containerID="382fafcf87675635a5157749858b5ec878f0718b5b86a0c99f4c353a16d66a18" exitCode=0 Jul 23 18:31:05.643548 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.643428 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerDied","Data":"382fafcf87675635a5157749858b5ec878f0718b5b86a0c99f4c353a16d66a18"} Jul 23 18:31:05.643909 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.643885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrdq\" (UniqueName: \"kubernetes.io/projected/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-kube-api-access-mwrdq\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:05.644780 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.644759 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4slxk\" (UniqueName: \"kubernetes.io/projected/95b44360-7f38-440c-838e-a814a4829aeb-kube-api-access-4slxk\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:05.645183 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.645162 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvln\" (UniqueName: \"kubernetes.io/projected/97f1f06c-b84f-4a95-b24a-ff753395b11f-kube-api-access-8cvln\") pod \"ingress-canary-wlg4z\" (UID: \"97f1f06c-b84f-4a95-b24a-ff753395b11f\") " pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.691429 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.691392 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wlg4z" Jul 23 18:31:05.896604 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:05.896345 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wlg4z"] Jul 23 18:31:05.899746 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:05.899721 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f1f06c_b84f_4a95_b24a_ff753395b11f.slice/crio-0f890153ff58b71b061355312c0a0939b4e008cf67de23bd7067b11b86578cef WatchSource:0}: Error finding container 0f890153ff58b71b061355312c0a0939b4e008cf67de23bd7067b11b86578cef: Status 404 returned error can't find the container with id 0f890153ff58b71b061355312c0a0939b4e008cf67de23bd7067b11b86578cef Jul 23 18:31:06.134266 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.134233 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:06.134485 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.134291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:06.134485 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.134335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:06.134485 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:06.134382 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:06.134485 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:06.134461 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:07.134445328 +0000 UTC m=+39.198678057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : configmap "kube-rbac-proxy" not found Jul 23 18:31:06.134485 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:06.134465 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:06.134684 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:06.134464 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:06.134684 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:06.134518 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls podName:4fdec47e-b7c8-4c90-b03f-71d11333e6cf nodeName:}" failed. No retries permitted until 2026-07-23 18:31:07.134502846 +0000 UTC m=+39.198735553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls") pod "dns-default-wqrjk" (UID: "4fdec47e-b7c8-4c90-b03f-71d11333e6cf") : secret "dns-default-metrics-tls" not found Jul 23 18:31:06.134684 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:06.134554 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:07.134540413 +0000 UTC m=+39.198773147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:06.351123 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.351086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:06.351818 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.351230 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:06.351818 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.351086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:06.353875 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.353852 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:31:06.354039 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.354006 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:31:06.354118 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.354010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8szp\"" Jul 23 18:31:06.354165 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.354010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ltcv\"" Jul 23 18:31:06.354215 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.354010 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:31:06.354824 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.354808 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:31:06.646938 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.646902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wlg4z" event={"ID":"97f1f06c-b84f-4a95-b24a-ff753395b11f","Type":"ContainerStarted","Data":"0f890153ff58b71b061355312c0a0939b4e008cf67de23bd7067b11b86578cef"} Jul 23 18:31:06.649873 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.649843 2556 generic.go:356] "Generic (PLEG): container finished" podID="c93af641-a2c7-48c8-bf03-7cceaebf7d46" containerID="5a3f6ef15b8180abe2ad4db96c75eea3d5bd1c4b953b5626c42a75590d43ffd7" exitCode=0 Jul 23 18:31:06.649987 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:06.649891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerDied","Data":"5a3f6ef15b8180abe2ad4db96c75eea3d5bd1c4b953b5626c42a75590d43ffd7"} Jul 23 18:31:07.142726 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:07.142677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:07.142761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:07.142808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:07.142838 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:07.142902 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls podName:4fdec47e-b7c8-4c90-b03f-71d11333e6cf nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.142884576 +0000 UTC m=+41.207117297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls") pod "dns-default-wqrjk" (UID: "4fdec47e-b7c8-4c90-b03f-71d11333e6cf") : secret "dns-default-metrics-tls" not found Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:07.142909 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:07.142920 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:07.142943 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:07.142945 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.142933322 +0000 UTC m=+41.207166043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : configmap "kube-rbac-proxy" not found Jul 23 18:31:07.143232 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:07.142985 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.142966705 +0000 UTC m=+41.207199435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:07.657112 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:07.657056 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svptc" event={"ID":"c93af641-a2c7-48c8-bf03-7cceaebf7d46","Type":"ContainerStarted","Data":"60778793bd5beec4a4423b350fe05d12993f25be8b24b9e904d64e5c28b19b43"} Jul 23 18:31:07.682560 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:07.682500 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-svptc" podStartSLOduration=7.928321875 podStartE2EDuration="38.682477323s" totalImagesPullingTime="30.754155448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:07.680832023 +0000 UTC m=+39.745064753" watchObservedRunningTime="2026-07-23 18:31:07.682477323 +0000 UTC m=+39.746710053" Jul 23 18:31:09.160382 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:09.160191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:09.160407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:09.160339 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:09.160439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:09.160487 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls podName:4fdec47e-b7c8-4c90-b03f-71d11333e6cf nodeName:}" failed. No retries permitted until 2026-07-23 18:31:13.160471647 +0000 UTC m=+45.224704379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls") pod "dns-default-wqrjk" (UID: "4fdec47e-b7c8-4c90-b03f-71d11333e6cf") : secret "dns-default-metrics-tls" not found Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:09.160511 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:09.160541 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:09.160563 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:13.160551982 +0000 UTC m=+45.224784689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : configmap "kube-rbac-proxy" not found Jul 23 18:31:09.160749 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:09.160595 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:13.160578082 +0000 UTC m=+45.224810808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:09.663697 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:09.663657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wlg4z" event={"ID":"97f1f06c-b84f-4a95-b24a-ff753395b11f","Type":"ContainerStarted","Data":"93d7d4bb84d552b5ec638179561e2ab8e7a9a27293f3b094326d855ab1520824"} Jul 23 18:31:09.679917 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:09.679872 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wlg4z" podStartSLOduration=1.511960768 podStartE2EDuration="4.679856531s" totalImagesPullingTime="3.167895763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:09.679254014 +0000 UTC m=+41.743486745" watchObservedRunningTime="2026-07-23 18:31:09.679856531 +0000 UTC m=+41.744089259" Jul 23 18:31:09.997389 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:09.997283 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-68pmv"] Jul 23 18:31:10.017228 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.017191 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-68pmv"] Jul 23 18:31:10.017417 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.017231 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.020026 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.019998 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6ftm2\"" Jul 23 18:31:10.020168 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.020045 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 23 18:31:10.020168 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.020070 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 23 18:31:10.020168 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.020045 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 23 18:31:10.020168 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.020048 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 23 18:31:10.066673 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.066633 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6feff238-12c0-4bbb-af29-7f0506af325d-signing-cabundle\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.066673 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.066671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgk7g\" (UniqueName: \"kubernetes.io/projected/6feff238-12c0-4bbb-af29-7f0506af325d-kube-api-access-kgk7g\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.066906 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.066698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6feff238-12c0-4bbb-af29-7f0506af325d-signing-key\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.167983 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.167946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6feff238-12c0-4bbb-af29-7f0506af325d-signing-cabundle\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.168404 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.167990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk7g\" (UniqueName: \"kubernetes.io/projected/6feff238-12c0-4bbb-af29-7f0506af325d-kube-api-access-kgk7g\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.168404 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.168021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6feff238-12c0-4bbb-af29-7f0506af325d-signing-key\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.168693 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.168672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6feff238-12c0-4bbb-af29-7f0506af325d-signing-cabundle\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.172339 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.172314 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6feff238-12c0-4bbb-af29-7f0506af325d-signing-key\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.177249 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.177226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgk7g\" (UniqueName: \"kubernetes.io/projected/6feff238-12c0-4bbb-af29-7f0506af325d-kube-api-access-kgk7g\") pod \"service-ca-58598695f7-68pmv\" (UID: \"6feff238-12c0-4bbb-af29-7f0506af325d\") " pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.325989 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.325903 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-68pmv" Jul 23 18:31:10.491537 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.491505 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-68pmv"] Jul 23 18:31:10.494215 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:10.494190 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6feff238_12c0_4bbb_af29_7f0506af325d.slice/crio-6300c9e9d9d34f9969125d150cbcd666ecd90f3686cc5b290edbb33c911f289a WatchSource:0}: Error finding container 6300c9e9d9d34f9969125d150cbcd666ecd90f3686cc5b290edbb33c911f289a: Status 404 returned error can't find the container with id 6300c9e9d9d34f9969125d150cbcd666ecd90f3686cc5b290edbb33c911f289a Jul 23 18:31:10.666781 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:10.666750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-68pmv" event={"ID":"6feff238-12c0-4bbb-af29-7f0506af325d","Type":"ContainerStarted","Data":"6300c9e9d9d34f9969125d150cbcd666ecd90f3686cc5b290edbb33c911f289a"} Jul 23 18:31:13.191484 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:13.191435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:13.191936 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:13.191502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:13.191936 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:13.191569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:13.191936 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:13.191590 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:13.191936 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:13.191678 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls podName:95b44360-7f38-440c-838e-a814a4829aeb nodeName:}" failed. No retries permitted until 2026-07-23 18:31:21.191659971 +0000 UTC m=+53.255892678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khm8l" (UID: "95b44360-7f38-440c-838e-a814a4829aeb") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:13.191936 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:13.191694 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:13.191936 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:31:13.191744 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls podName:4fdec47e-b7c8-4c90-b03f-71d11333e6cf nodeName:}" failed. No retries permitted until 2026-07-23 18:31:21.19172791 +0000 UTC m=+53.255960623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls") pod "dns-default-wqrjk" (UID: "4fdec47e-b7c8-4c90-b03f-71d11333e6cf") : secret "dns-default-metrics-tls" not found Jul 23 18:31:13.192127 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:13.192002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95b44360-7f38-440c-838e-a814a4829aeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:13.675757 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:13.675722 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-68pmv" event={"ID":"6feff238-12c0-4bbb-af29-7f0506af325d","Type":"ContainerStarted","Data":"f77b43d193ab50bcfb5b6d7dfe07878c86e20cedfde713c29b6734e7fc619dc3"} Jul 23 18:31:13.700187 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:13.700131 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-68pmv" podStartSLOduration=1.897858264 podStartE2EDuration="4.700113769s" totalImagesPullingTime="2.802255505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:13.698829618 +0000 UTC m=+45.763062339" watchObservedRunningTime="2026-07-23 18:31:13.700113769 +0000 UTC m=+45.764346498" Jul 23 18:31:21.256450 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.256397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:21.257113 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.256474 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:21.258999 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.258976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fdec47e-b7c8-4c90-b03f-71d11333e6cf-metrics-tls\") pod \"dns-default-wqrjk\" (UID: \"4fdec47e-b7c8-4c90-b03f-71d11333e6cf\") " pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:21.259110 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.259086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95b44360-7f38-440c-838e-a814a4829aeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khm8l\" (UID: \"95b44360-7f38-440c-838e-a814a4829aeb\") " pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:21.318131 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.318091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-khm8l" Jul 23 18:31:21.332326 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.332296 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:21.491135 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.491102 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wqrjk"] Jul 23 18:31:21.495108 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:21.495078 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fdec47e_b7c8_4c90_b03f_71d11333e6cf.slice/crio-062a61de01277354f9899abf3762324559989777142bbaeac84fd4f23933f151 WatchSource:0}: Error finding container 062a61de01277354f9899abf3762324559989777142bbaeac84fd4f23933f151: Status 404 returned error can't find the container with id 062a61de01277354f9899abf3762324559989777142bbaeac84fd4f23933f151 Jul 23 18:31:21.511464 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.511315 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-khm8l"] Jul 23 18:31:21.516461 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:21.516431 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b44360_7f38_440c_838e_a814a4829aeb.slice/crio-e69e2275fbe70cb9d73f3f7f3385b2b780e8fe1c8406c2d1978e6f8e09f521ee WatchSource:0}: Error finding container e69e2275fbe70cb9d73f3f7f3385b2b780e8fe1c8406c2d1978e6f8e09f521ee: Status 404 returned error can't find the container with id e69e2275fbe70cb9d73f3f7f3385b2b780e8fe1c8406c2d1978e6f8e09f521ee Jul 23 18:31:21.698574 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.698537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khm8l" event={"ID":"95b44360-7f38-440c-838e-a814a4829aeb","Type":"ContainerStarted","Data":"e69e2275fbe70cb9d73f3f7f3385b2b780e8fe1c8406c2d1978e6f8e09f521ee"} Jul 23 18:31:21.699673 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:21.699647 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqrjk" event={"ID":"4fdec47e-b7c8-4c90-b03f-71d11333e6cf","Type":"ContainerStarted","Data":"062a61de01277354f9899abf3762324559989777142bbaeac84fd4f23933f151"} Jul 23 18:31:24.711082 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:24.711043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqrjk" event={"ID":"4fdec47e-b7c8-4c90-b03f-71d11333e6cf","Type":"ContainerStarted","Data":"6a67def7b66197409a41b40d74588fc176cd4e7e76ae14e1868614c676ef4edb"} Jul 23 18:31:24.711573 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:24.711102 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wqrjk" event={"ID":"4fdec47e-b7c8-4c90-b03f-71d11333e6cf","Type":"ContainerStarted","Data":"fe5483234e68483d746cf485bcf1b1aca4f9a7ed39757453625e82192347d593"} Jul 23 18:31:24.711573 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:24.711204 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:24.730051 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:24.730002 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wqrjk" podStartSLOduration=17.499307431 podStartE2EDuration="19.729984962s" totalImagesPullingTime="2.230677531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:24.729176845 +0000 UTC m=+56.793409599" watchObservedRunningTime="2026-07-23 18:31:24.729984962 +0000 UTC m=+56.794217691" Jul 23 18:31:27.721800 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:27.721766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khm8l" event={"ID":"95b44360-7f38-440c-838e-a814a4829aeb","Type":"ContainerStarted","Data":"5498aa4237dcb5366e1ece25afcbf4d1b1a51170c67faefd1db825db940f6fa5"} Jul 23 18:31:29.636891 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:29.636858 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4snzp" Jul 23 18:31:29.986933 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:29.986893 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q"] Jul 23 18:31:30.006096 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.006061 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg"] Jul 23 18:31:30.006320 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.006199 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.009524 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.009500 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 18:31:30.009927 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.009882 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 18:31:30.011421 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.011170 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 23 18:31:30.011421 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.011199 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 18:31:30.012435 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.012414 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q"] Jul 23 18:31:30.012581 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.012461 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg"] Jul 23 18:31:30.012581 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.012576 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.015789 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.015547 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 23 18:31:30.015789 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.015774 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 23 18:31:30.015942 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.015832 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 23 18:31:30.016626 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.016601 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 23 18:31:30.127597 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.127773 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c22ff7-f6c9-475e-adee-b711f85083b4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.127773 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/768cf07a-0900-4087-a058-9c3713350941-tmp\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.127773 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-779vz\" (UniqueName: \"kubernetes.io/projected/768cf07a-0900-4087-a058-9c3713350941-kube-api-access-779vz\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.127773 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.127973 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-ca\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.127973 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-hub\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.127973 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/768cf07a-0900-4087-a058-9c3713350941-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.128061 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.127978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2spx\" (UniqueName: \"kubernetes.io/projected/d6c22ff7-f6c9-475e-adee-b711f85083b4-kube-api-access-c2spx\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.228627 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.228579 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c22ff7-f6c9-475e-adee-b711f85083b4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.228816 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.228656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/768cf07a-0900-4087-a058-9c3713350941-tmp\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.228816 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.228681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-779vz\" (UniqueName: \"kubernetes.io/projected/768cf07a-0900-4087-a058-9c3713350941-kube-api-access-779vz\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.228816 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.228710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.228816 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.228738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-ca\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.229419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.229107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-hub\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.229419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.229129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/768cf07a-0900-4087-a058-9c3713350941-tmp\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.229419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.229147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/768cf07a-0900-4087-a058-9c3713350941-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.229419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.229200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2spx\" (UniqueName: \"kubernetes.io/projected/d6c22ff7-f6c9-475e-adee-b711f85083b4-kube-api-access-c2spx\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.229419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.229297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.229419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.229352 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c22ff7-f6c9-475e-adee-b711f85083b4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.232085 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.232052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/768cf07a-0900-4087-a058-9c3713350941-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.232233 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.232217 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.232350 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.232323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-ca\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.232442 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.232327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-hub\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.232495 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.232443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c22ff7-f6c9-475e-adee-b711f85083b4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.243129 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.243071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-779vz\" (UniqueName: \"kubernetes.io/projected/768cf07a-0900-4087-a058-9c3713350941-kube-api-access-779vz\") pod \"klusterlet-addon-workmgr-6d9fd75d7b-zt59q\" (UID: \"768cf07a-0900-4087-a058-9c3713350941\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.244765 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.244732 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2spx\" (UniqueName: \"kubernetes.io/projected/d6c22ff7-f6c9-475e-adee-b711f85083b4-kube-api-access-c2spx\") pod \"cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg\" (UID: \"d6c22ff7-f6c9-475e-adee-b711f85083b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:30.321525 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.321493 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:30.337908 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:30.337873 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" Jul 23 18:31:31.178145 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:31.178121 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg"] Jul 23 18:31:31.180321 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:31.180295 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6c22ff7_f6c9_475e_adee_b711f85083b4.slice/crio-fbe5ba83901d6512328241723d18edc0c85242c3769f129b94197d25cb45df43 WatchSource:0}: Error finding container fbe5ba83901d6512328241723d18edc0c85242c3769f129b94197d25cb45df43: Status 404 returned error can't find the container with id fbe5ba83901d6512328241723d18edc0c85242c3769f129b94197d25cb45df43 Jul 23 18:31:31.195823 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:31.195790 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q"] Jul 23 18:31:31.199705 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:31.199668 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768cf07a_0900_4087_a058_9c3713350941.slice/crio-17cc3fc99bc79f07b81462626acbe7e31a8e012092f15cc9d3006fb076929fd4 WatchSource:0}: Error finding container 17cc3fc99bc79f07b81462626acbe7e31a8e012092f15cc9d3006fb076929fd4: Status 404 returned error can't find the container with id 17cc3fc99bc79f07b81462626acbe7e31a8e012092f15cc9d3006fb076929fd4 Jul 23 18:31:31.737007 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:31.736967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khm8l" event={"ID":"95b44360-7f38-440c-838e-a814a4829aeb","Type":"ContainerStarted","Data":"4880a704e7e25f0a938ad024d1416a5bc7baf3b6c6adb1ffa5e925a637754d60"} Jul 23 18:31:31.738098 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:31.738073 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" event={"ID":"d6c22ff7-f6c9-475e-adee-b711f85083b4","Type":"ContainerStarted","Data":"fbe5ba83901d6512328241723d18edc0c85242c3769f129b94197d25cb45df43"} Jul 23 18:31:31.738977 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:31.738955 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" event={"ID":"768cf07a-0900-4087-a058-9c3713350941","Type":"ContainerStarted","Data":"17cc3fc99bc79f07b81462626acbe7e31a8e012092f15cc9d3006fb076929fd4"} Jul 23 18:31:34.164986 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.164945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:34.165573 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.165006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:34.170320 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.168973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:31:34.170320 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.168973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:31:34.178669 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.178624 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa30c19-bbbe-4e43-9f16-c0fd591f55ba-metrics-certs\") pod \"network-metrics-daemon-j2x26\" (UID: \"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba\") " pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:34.179972 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.179917 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e6500c-f4b5-4261-9d97-7d52ddc8b50f-original-pull-secret\") pod \"global-pull-secret-syncer-98ktb\" (UID: \"08e6500c-f4b5-4261-9d97-7d52ddc8b50f\") " pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:34.266451 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.266412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:34.266713 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.266648 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98ktb" Jul 23 18:31:34.269160 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.268971 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:31:34.274191 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.274154 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8szp\"" Jul 23 18:31:34.279397 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.279355 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:31:34.282573 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.282550 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2x26" Jul 23 18:31:34.292262 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.292232 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-954zk\" (UniqueName: \"kubernetes.io/projected/9313dd27-2e51-4a76-8724-e69e100209cd-kube-api-access-954zk\") pod \"network-check-target-84nqc\" (UID: \"9313dd27-2e51-4a76-8724-e69e100209cd\") " pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:34.563834 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.563750 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ltcv\"" Jul 23 18:31:34.572473 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.572441 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:34.717155 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:34.717125 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wqrjk" Jul 23 18:31:38.721192 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.721128 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84nqc"] Jul 23 18:31:38.725438 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:38.725393 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9313dd27_2e51_4a76_8724_e69e100209cd.slice/crio-4ff1d6bcd593c79b0280028bd7d31febed5b80768934ed9ebc4a7d6a2a27a38c WatchSource:0}: Error finding container 4ff1d6bcd593c79b0280028bd7d31febed5b80768934ed9ebc4a7d6a2a27a38c: Status 404 returned error can't find the container with id 4ff1d6bcd593c79b0280028bd7d31febed5b80768934ed9ebc4a7d6a2a27a38c Jul 23 18:31:38.742190 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.742160 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2x26"] Jul 23 18:31:38.745659 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.745592 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-98ktb"] Jul 23 18:31:38.748015 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:38.747986 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa30c19_bbbe_4e43_9f16_c0fd591f55ba.slice/crio-b83bcdb877ab14a889643aee8fdc59a2c3e759e3443c3a78ed57126e045b13bc WatchSource:0}: Error finding container b83bcdb877ab14a889643aee8fdc59a2c3e759e3443c3a78ed57126e045b13bc: Status 404 returned error can't find the container with id b83bcdb877ab14a889643aee8fdc59a2c3e759e3443c3a78ed57126e045b13bc Jul 23 18:31:38.748634 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:38.748613 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e6500c_f4b5_4261_9d97_7d52ddc8b50f.slice/crio-2afb0e5d06f3a345a4e8980173f7aa4a8d0e6a4d78be4879dcf6638157b16a03 WatchSource:0}: Error finding container 2afb0e5d06f3a345a4e8980173f7aa4a8d0e6a4d78be4879dcf6638157b16a03: Status 404 returned error can't find the container with id 2afb0e5d06f3a345a4e8980173f7aa4a8d0e6a4d78be4879dcf6638157b16a03 Jul 23 18:31:38.776610 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.776577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84nqc" event={"ID":"9313dd27-2e51-4a76-8724-e69e100209cd","Type":"ContainerStarted","Data":"4ff1d6bcd593c79b0280028bd7d31febed5b80768934ed9ebc4a7d6a2a27a38c"} Jul 23 18:31:38.778838 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.778778 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khm8l" event={"ID":"95b44360-7f38-440c-838e-a814a4829aeb","Type":"ContainerStarted","Data":"3f7531febdd20711ee3f624b73f2706081126ed1755ac7f11f64fe92eb3102ec"} Jul 23 18:31:38.780150 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.780130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" event={"ID":"d6c22ff7-f6c9-475e-adee-b711f85083b4","Type":"ContainerStarted","Data":"fe89460076a61d3217a0fd40d3c77230e0b57f4620cbc36047dcfe27fecd5f06"} Jul 23 18:31:38.780247 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.780160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" event={"ID":"d6c22ff7-f6c9-475e-adee-b711f85083b4","Type":"ContainerStarted","Data":"a980b79089b838589386d79574acce49406f540846b1e58ee7252802dc6af095"} Jul 23 18:31:38.781022 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.781001 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2x26" event={"ID":"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba","Type":"ContainerStarted","Data":"b83bcdb877ab14a889643aee8fdc59a2c3e759e3443c3a78ed57126e045b13bc"} Jul 23 18:31:38.782135 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.782065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" event={"ID":"768cf07a-0900-4087-a058-9c3713350941","Type":"ContainerStarted","Data":"5d6ba3cf00988f6d042aec6454070cbe1a181c2f20a923adb56b1ff676e3f293"} Jul 23 18:31:38.782451 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.782410 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:38.782965 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.782947 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-98ktb" event={"ID":"08e6500c-f4b5-4261-9d97-7d52ddc8b50f","Type":"ContainerStarted","Data":"2afb0e5d06f3a345a4e8980173f7aa4a8d0e6a4d78be4879dcf6638157b16a03"} Jul 23 18:31:38.783713 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.783698 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" Jul 23 18:31:38.796050 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:38.796000 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-khm8l" podStartSLOduration=16.916382069 podStartE2EDuration="33.795984247s" totalImagesPullingTime="16.879602178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:31:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:38.794994202 +0000 UTC m=+70.859226933" watchObservedRunningTime="2026-07-23 18:31:38.795984247 +0000 UTC m=+70.860217001" Jul 23 18:31:39.790830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:39.790785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" event={"ID":"d6c22ff7-f6c9-475e-adee-b711f85083b4","Type":"ContainerStarted","Data":"cf94dcf4ea937c1d958d795389486d71f609f5bb7b9b4f45b27d8c0fc52dafc7"} Jul 23 18:31:39.809140 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:39.809075 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d9fd75d7b-zt59q" podStartSLOduration=3.482931937 podStartE2EDuration="10.809044934s" totalImagesPullingTime="7.326112997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:38.809548467 +0000 UTC m=+70.873781197" watchObservedRunningTime="2026-07-23 18:31:39.809044934 +0000 UTC m=+71.873277665" Jul 23 18:31:39.810156 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:39.810030 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b6d65bdb9-qbjkg" podStartSLOduration=3.448022445 podStartE2EDuration="10.810012278s" totalImagesPullingTime="7.361989833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:39.808172626 +0000 UTC m=+71.872405369" watchObservedRunningTime="2026-07-23 18:31:39.810012278 +0000 UTC m=+71.874245007" Jul 23 18:31:40.800429 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:40.800385 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2x26" event={"ID":"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba","Type":"ContainerStarted","Data":"e8cf4e18a22b172ff8ba54c443a7ea804ee76023de18558ac20b005cad636a14"} Jul 23 18:31:40.800890 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:40.800486 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2x26" event={"ID":"5aa30c19-bbbe-4e43-9f16-c0fd591f55ba","Type":"ContainerStarted","Data":"46e381c2a247d01d5e522c06634f6576efad27a131fc70baab54af3101824171"} Jul 23 18:31:40.817203 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:40.817146 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j2x26" podStartSLOduration=70.580209512 podStartE2EDuration="1m11.817129043s" totalImagesPullingTime="1.236919531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:40.816660265 +0000 UTC m=+72.880892996" watchObservedRunningTime="2026-07-23 18:31:40.817129043 +0000 UTC m=+72.881361771" Jul 23 18:31:43.812601 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:43.812512 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84nqc" event={"ID":"9313dd27-2e51-4a76-8724-e69e100209cd","Type":"ContainerStarted","Data":"d566a7b1e8664e8da01357f14886a280ec0c22e47a86534e64aa20f21cebbdbd"} Jul 23 18:31:43.812998 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:43.812614 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:31:43.814159 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:43.814138 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-98ktb" event={"ID":"08e6500c-f4b5-4261-9d97-7d52ddc8b50f","Type":"ContainerStarted","Data":"5c37624779936129ec26b11fc22335a5227672ce2b17cb4c99f3efa7a43ccfaf"} Jul 23 18:31:43.830670 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:43.830598 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-84nqc" podStartSLOduration=70.083948039 podStartE2EDuration="1m14.830578875s" totalImagesPullingTime="4.746630836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:43.830390245 +0000 UTC m=+75.894622973" watchObservedRunningTime="2026-07-23 18:31:43.830578875 +0000 UTC m=+75.894811605" Jul 23 18:31:43.848809 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:43.848740 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-98ktb" podStartSLOduration=70.121302421 podStartE2EDuration="1m14.848720027s" totalImagesPullingTime="4.727417606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:43.848213876 +0000 UTC m=+75.912446606" watchObservedRunningTime="2026-07-23 18:31:43.848720027 +0000 UTC m=+75.912952757" Jul 23 18:31:47.763395 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.763344 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rwc9t"] Jul 23 18:31:47.766799 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.766780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.769724 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.769698 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 18:31:47.769724 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.769711 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 18:31:47.769921 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.769717 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 18:31:47.770623 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.770543 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 18:31:47.770767 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.770675 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 18:31:47.770767 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.770706 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ngb6f\"" Jul 23 18:31:47.770881 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.770776 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 18:31:47.882318 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-sys\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882318 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8f1fa34-f835-47c3-b5cb-607787e1d80a-metrics-client-ca\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wtmq\" (UniqueName: \"kubernetes.io/projected/a8f1fa34-f835-47c3-b5cb-607787e1d80a-kube-api-access-8wtmq\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-root\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-tls\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-textfile\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.882605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.882589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-wtmp\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-wtmp\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-sys\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983608 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8f1fa34-f835-47c3-b5cb-607787e1d80a-metrics-client-ca\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wtmq\" (UniqueName: \"kubernetes.io/projected/a8f1fa34-f835-47c3-b5cb-607787e1d80a-kube-api-access-8wtmq\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-sys\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983719 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-wtmp\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983734 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-root\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983779 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8f1fa34-f835-47c3-b5cb-607787e1d80a-root\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-tls\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.983830 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.983814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-textfile\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.984258 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.984181 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-textfile\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.984415 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.984397 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8f1fa34-f835-47c3-b5cb-607787e1d80a-metrics-client-ca\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.984489 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.984437 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.986404 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.986355 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:47.986461 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:47.986430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8f1fa34-f835-47c3-b5cb-607787e1d80a-node-exporter-tls\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:48.000077 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.000044 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wtmq\" (UniqueName: \"kubernetes.io/projected/a8f1fa34-f835-47c3-b5cb-607787e1d80a-kube-api-access-8wtmq\") pod \"node-exporter-rwc9t\" (UID: \"a8f1fa34-f835-47c3-b5cb-607787e1d80a\") " pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:48.078998 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.078908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwc9t" Jul 23 18:31:48.090902 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:48.090868 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f1fa34_f835_47c3_b5cb_607787e1d80a.slice/crio-4b5a7f9767687af7dbb1ccb6890e13ca11680ac0295125848a46a1d9c7f053b0 WatchSource:0}: Error finding container 4b5a7f9767687af7dbb1ccb6890e13ca11680ac0295125848a46a1d9c7f053b0: Status 404 returned error can't find the container with id 4b5a7f9767687af7dbb1ccb6890e13ca11680ac0295125848a46a1d9c7f053b0 Jul 23 18:31:48.833410 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.833254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwc9t" event={"ID":"a8f1fa34-f835-47c3-b5cb-607787e1d80a","Type":"ContainerStarted","Data":"4b5a7f9767687af7dbb1ccb6890e13ca11680ac0295125848a46a1d9c7f053b0"} Jul 23 18:31:48.965695 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.965660 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 18:31:48.969315 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.969298 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972428 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972428 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972468 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972496 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972518 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972528 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 18:31:48.972631 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972448 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 18:31:48.972953 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.972853 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 18:31:48.973110 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.973087 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 18:31:48.973155 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.973114 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cb829\"" Jul 23 18:31:48.988345 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:48.988320 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 18:31:49.094196 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7139d155-50f1-4839-886b-6ca73bb1422d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094196 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094414 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094414 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094414 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7139d155-50f1-4839-886b-6ca73bb1422d-config-out\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094414 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094607 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094428 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7139d155-50f1-4839-886b-6ca73bb1422d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094607 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7139d155-50f1-4839-886b-6ca73bb1422d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094607 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094607 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-web-config\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094607 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094592 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7139d155-50f1-4839-886b-6ca73bb1422d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094772 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.094772 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.094700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrxr\" (UniqueName: \"kubernetes.io/projected/7139d155-50f1-4839-886b-6ca73bb1422d-kube-api-access-pjrxr\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195086 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7139d155-50f1-4839-886b-6ca73bb1422d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195086 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7139d155-50f1-4839-886b-6ca73bb1422d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195353 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195353 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-web-config\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195353 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7139d155-50f1-4839-886b-6ca73bb1422d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195511 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195511 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrxr\" (UniqueName: \"kubernetes.io/projected/7139d155-50f1-4839-886b-6ca73bb1422d-kube-api-access-pjrxr\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195511 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7139d155-50f1-4839-886b-6ca73bb1422d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195664 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195664 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195570 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7139d155-50f1-4839-886b-6ca73bb1422d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195664 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195664 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195864 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7139d155-50f1-4839-886b-6ca73bb1422d-config-out\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.195864 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.196027 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.195989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7139d155-50f1-4839-886b-6ca73bb1422d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.196966 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.196937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7139d155-50f1-4839-886b-6ca73bb1422d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.198733 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.198700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7139d155-50f1-4839-886b-6ca73bb1422d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199209 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199106 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199209 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199132 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199236 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199267 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199290 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199309 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7139d155-50f1-4839-886b-6ca73bb1422d-config-out\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.199689 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.199667 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-web-config\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.200700 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.200684 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7139d155-50f1-4839-886b-6ca73bb1422d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.203572 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.203553 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrxr\" (UniqueName: \"kubernetes.io/projected/7139d155-50f1-4839-886b-6ca73bb1422d-kube-api-access-pjrxr\") pod \"alertmanager-main-0\" (UID: \"7139d155-50f1-4839-886b-6ca73bb1422d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.279624 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.279589 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:31:49.427787 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.427761 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 18:31:49.429437 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:49.429410 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7139d155_50f1_4839_886b_6ca73bb1422d.slice/crio-49b3838cc09e57cae977e15978c5cde1b4a24d9b52fe08f8951a4ee58a9d9ecf WatchSource:0}: Error finding container 49b3838cc09e57cae977e15978c5cde1b4a24d9b52fe08f8951a4ee58a9d9ecf: Status 404 returned error can't find the container with id 49b3838cc09e57cae977e15978c5cde1b4a24d9b52fe08f8951a4ee58a9d9ecf Jul 23 18:31:49.838532 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.838497 2556 generic.go:356] "Generic (PLEG): container finished" podID="a8f1fa34-f835-47c3-b5cb-607787e1d80a" containerID="9ec350aa12e828aedb518bb2f0db1669ac66e5fdc8bb721aa9a36575fb2c44a1" exitCode=0 Jul 23 18:31:49.839019 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.838593 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwc9t" event={"ID":"a8f1fa34-f835-47c3-b5cb-607787e1d80a","Type":"ContainerDied","Data":"9ec350aa12e828aedb518bb2f0db1669ac66e5fdc8bb721aa9a36575fb2c44a1"} Jul 23 18:31:49.839938 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:49.839909 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"49b3838cc09e57cae977e15978c5cde1b4a24d9b52fe08f8951a4ee58a9d9ecf"} Jul 23 18:31:50.846580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:50.846493 2556 generic.go:356] "Generic (PLEG): container finished" podID="7139d155-50f1-4839-886b-6ca73bb1422d" containerID="322677327e03ce7f6830289e8e3cda24674c08660a74fe5e09c3ff0aa70d22d2" exitCode=0 Jul 23 18:31:50.847022 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:50.846582 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerDied","Data":"322677327e03ce7f6830289e8e3cda24674c08660a74fe5e09c3ff0aa70d22d2"} Jul 23 18:31:50.849443 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:50.849412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwc9t" event={"ID":"a8f1fa34-f835-47c3-b5cb-607787e1d80a","Type":"ContainerStarted","Data":"4cd2283d0bd6a957e515591638a82dd38e917e7e2367dba296e33411b7f4bea5"} Jul 23 18:31:50.849559 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:50.849461 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwc9t" event={"ID":"a8f1fa34-f835-47c3-b5cb-607787e1d80a","Type":"ContainerStarted","Data":"deb6725dfe4bd39b7529187bfe71908a260816e1d14cb37a3e8f46fc106fd63d"} Jul 23 18:31:50.898900 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:50.898844 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rwc9t" podStartSLOduration=2.940033046 podStartE2EDuration="3.898824731s" totalImagesPullingTime="886.598476ms" totalInitContainerRuntime="72.193209ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:50.897638772 +0000 UTC m=+82.961871505" watchObservedRunningTime="2026-07-23 18:31:50.898824731 +0000 UTC m=+82.963057459" Jul 23 18:31:52.860673 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.860644 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"f71f3b473a8edea30e93ad0e2b8dcd484480d5b148a9ae91c8cd01a060da84bb"} Jul 23 18:31:52.860991 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.860709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"d70ea8c481ffc29d1624776db1894c06eb1006ad96865d35af54804dc5dc3b45"} Jul 23 18:31:52.860991 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.860740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"0dc0fe8e0a504894f693592bb5987b8222966baaae3bfb82cf724733454dcdb7"} Jul 23 18:31:52.860991 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.860764 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"4bd0d206ad81eb176d39b9e3b1af9a8d08d3c7c0c9b961a12c04fb9d1c703271"} Jul 23 18:31:52.970901 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.970505 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6"] Jul 23 18:31:52.974051 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.974034 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:52.977552 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.977284 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 18:31:52.977552 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.977304 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 18:31:52.977552 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.977320 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 18:31:52.977552 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.977308 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 18:31:52.977552 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.977342 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 18:31:52.978555 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.978532 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qnw7k\"" Jul 23 18:31:52.982388 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.982316 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 18:31:52.989678 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:52.989654 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6"] Jul 23 18:31:53.130736 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv2v4\" (UniqueName: \"kubernetes.io/projected/de8bedc0-1192-45f6-85f3-850e10441943-kube-api-access-zv2v4\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130736 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130686 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130736 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130958 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-secret-telemeter-client\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130958 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-serving-certs-ca-bundle\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130958 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-telemeter-client-tls\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130958 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-federate-client-tls\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.130958 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.130845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-metrics-client-ca\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232058 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232027 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232235 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-secret-telemeter-client\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232235 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-serving-certs-ca-bundle\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232235 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-telemeter-client-tls\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232395 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-federate-client-tls\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232395 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-metrics-client-ca\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232395 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv2v4\" (UniqueName: \"kubernetes.io/projected/de8bedc0-1192-45f6-85f3-850e10441943-kube-api-access-zv2v4\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232395 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.232953 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.232897 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-serving-certs-ca-bundle\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.233255 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.233224 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-metrics-client-ca\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.233662 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.233635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de8bedc0-1192-45f6-85f3-850e10441943-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.234796 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.234766 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.234910 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.234855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-federate-client-tls\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.234973 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.234922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-telemeter-client-tls\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.234973 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.234930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/de8bedc0-1192-45f6-85f3-850e10441943-secret-telemeter-client\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.241771 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.241744 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv2v4\" (UniqueName: \"kubernetes.io/projected/de8bedc0-1192-45f6-85f3-850e10441943-kube-api-access-zv2v4\") pod \"telemeter-client-77d56f6dbf-7j5z6\" (UID: \"de8bedc0-1192-45f6-85f3-850e10441943\") " pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.284750 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.284711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" Jul 23 18:31:53.420338 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.420308 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6"] Jul 23 18:31:53.422703 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:53.422679 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8bedc0_1192_45f6_85f3_850e10441943.slice/crio-9ac40613e79a47738b4cd107298461fba5f150962613727d866f3650127745ac WatchSource:0}: Error finding container 9ac40613e79a47738b4cd107298461fba5f150962613727d866f3650127745ac: Status 404 returned error can't find the container with id 9ac40613e79a47738b4cd107298461fba5f150962613727d866f3650127745ac Jul 23 18:31:53.866234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.866204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" event={"ID":"de8bedc0-1192-45f6-85f3-850e10441943","Type":"ContainerStarted","Data":"9ac40613e79a47738b4cd107298461fba5f150962613727d866f3650127745ac"} Jul 23 18:31:53.869797 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:53.869754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"4ff81f6fef3f63b756b3e2c22b9d5abd346965589a38e33e703cc0b226c916c7"} Jul 23 18:31:54.876862 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:54.876826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7139d155-50f1-4839-886b-6ca73bb1422d","Type":"ContainerStarted","Data":"96c4ed074b21bc517dd21fb8ab5614826395538758983c2738e77d3a45db0b3d"} Jul 23 18:31:54.906179 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:54.906117 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.113221267 podStartE2EDuration="6.906099633s" totalImagesPullingTime="3.775491889s" totalInitContainerRuntime="17.386477ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:54.904194763 +0000 UTC m=+86.968427514" watchObservedRunningTime="2026-07-23 18:31:54.906099633 +0000 UTC m=+86.970332363" Jul 23 18:31:55.883074 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:55.882984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" event={"ID":"de8bedc0-1192-45f6-85f3-850e10441943","Type":"ContainerStarted","Data":"5ee0ced2df091e839e94d721cab59462e16a35988d1e948a69e0ed92eff5d5db"} Jul 23 18:31:55.883074 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:55.883049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" event={"ID":"de8bedc0-1192-45f6-85f3-850e10441943","Type":"ContainerStarted","Data":"61fcec4ea81ef83fb10f0f81d261cb651074fa7b92a4db279711fdd03cac3846"} Jul 23 18:31:55.883074 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:55.883069 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" event={"ID":"de8bedc0-1192-45f6-85f3-850e10441943","Type":"ContainerStarted","Data":"f367c939446212c2772a5a5bff1ad9421ff5965ec6bd6e622d452b4e9ad9700e"} Jul 23 18:31:55.904947 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:55.904895 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77d56f6dbf-7j5z6" podStartSLOduration=1.898174881 podStartE2EDuration="3.904854324s" totalImagesPullingTime="2.006679443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:55.90333683 +0000 UTC m=+87.967569562" watchObservedRunningTime="2026-07-23 18:31:55.904854324 +0000 UTC m=+87.969087062" Jul 23 18:31:56.561625 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.561587 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d997f85b4-2fqvx"] Jul 23 18:31:56.566865 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.566833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.569520 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.569492 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 18:31:56.570303 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570282 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 18:31:56.570459 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570353 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 18:31:56.570697 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570673 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 18:31:56.570780 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570676 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 18:31:56.570780 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570761 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 18:31:56.570877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570716 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 18:31:56.570877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.570686 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g5q6w\"" Jul 23 18:31:56.575427 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.575406 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 18:31:56.576883 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.576862 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d997f85b4-2fqvx"] Jul 23 18:31:56.660962 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.660923 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-trusted-ca-bundle\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.660962 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.660964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-oauth-serving-cert\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.661157 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.660989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-console-config\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.661157 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.661077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lnvt\" (UniqueName: \"kubernetes.io/projected/f73e5e33-0a5a-4826-9b77-af738d158057-kube-api-access-6lnvt\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.661157 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.661107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-serving-cert\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.661157 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.661138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-service-ca\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.661280 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.661198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-oauth-config\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762558 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-oauth-serving-cert\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762558 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762560 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-console-config\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lnvt\" (UniqueName: \"kubernetes.io/projected/f73e5e33-0a5a-4826-9b77-af738d158057-kube-api-access-6lnvt\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-serving-cert\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762645 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-service-ca\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762788 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-oauth-config\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.762966 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.762817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-trusted-ca-bundle\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.763379 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.763303 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-oauth-serving-cert\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.763604 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.763466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-service-ca\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.763604 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.763594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-console-config\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.763829 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.763808 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-trusted-ca-bundle\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.765161 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.765133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-serving-cert\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.765268 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.765252 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-oauth-config\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.771057 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.771034 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lnvt\" (UniqueName: \"kubernetes.io/projected/f73e5e33-0a5a-4826-9b77-af738d158057-kube-api-access-6lnvt\") pod \"console-d997f85b4-2fqvx\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:56.877346 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:56.877252 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:31:57.011777 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:57.011675 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d997f85b4-2fqvx"] Jul 23 18:31:57.014610 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:31:57.014566 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73e5e33_0a5a_4826_9b77_af738d158057.slice/crio-c019f3f89fc2693eab6d28b40e38573c60e93ed9548a9c4ee3e242793daf7a89 WatchSource:0}: Error finding container c019f3f89fc2693eab6d28b40e38573c60e93ed9548a9c4ee3e242793daf7a89: Status 404 returned error can't find the container with id c019f3f89fc2693eab6d28b40e38573c60e93ed9548a9c4ee3e242793daf7a89 Jul 23 18:31:57.893040 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:31:57.893003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d997f85b4-2fqvx" event={"ID":"f73e5e33-0a5a-4826-9b77-af738d158057","Type":"ContainerStarted","Data":"c019f3f89fc2693eab6d28b40e38573c60e93ed9548a9c4ee3e242793daf7a89"} Jul 23 18:32:00.909291 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:00.909254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d997f85b4-2fqvx" event={"ID":"f73e5e33-0a5a-4826-9b77-af738d158057","Type":"ContainerStarted","Data":"c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617"} Jul 23 18:32:00.927593 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:00.927545 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d997f85b4-2fqvx" podStartSLOduration=1.634993404 podStartE2EDuration="4.927528644s" totalImagesPullingTime="3.29253524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:00.926739048 +0000 UTC m=+92.990971780" watchObservedRunningTime="2026-07-23 18:32:00.927528644 +0000 UTC m=+92.991761373" Jul 23 18:32:06.877821 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:06.877769 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:32:06.877821 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:06.877840 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:32:06.882666 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:06.882638 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:32:06.934486 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:06.934459 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:32:14.820960 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:32:14.820929 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-84nqc" Jul 23 18:33:22.467940 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:22.467856 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d997f85b4-2fqvx"] Jul 23 18:33:48.231090 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.231040 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d997f85b4-2fqvx" podUID="f73e5e33-0a5a-4826-9b77-af738d158057" containerName="console" containerID="cri-o://c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617" gracePeriod=15 Jul 23 18:33:48.479811 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.479779 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:33:48.618520 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618429 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-console-config\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618520 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618472 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-trusted-ca-bundle\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618520 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618498 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-serving-cert\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618770 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618528 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-oauth-serving-cert\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618770 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618579 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-oauth-config\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618770 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618609 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lnvt\" (UniqueName: \"kubernetes.io/projected/f73e5e33-0a5a-4826-9b77-af738d158057-kube-api-access-6lnvt\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618770 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618645 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-service-ca\") pod \"f73e5e33-0a5a-4826-9b77-af738d158057\" (UID: \"f73e5e33-0a5a-4826-9b77-af738d158057\") " Jul 23 18:33:48.618967 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618919 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:33:48.619028 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.618991 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-console-config" (OuterVolumeSpecName: "console-config") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:33:48.619109 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.619081 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:33:48.619148 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.619108 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-service-ca" (OuterVolumeSpecName: "service-ca") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:33:48.621116 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.621081 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:33:48.621116 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.621094 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:33:48.621272 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.621112 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f73e5e33-0a5a-4826-9b77-af738d158057-kube-api-access-6lnvt" (OuterVolumeSpecName: "kube-api-access-6lnvt") pod "f73e5e33-0a5a-4826-9b77-af738d158057" (UID: "f73e5e33-0a5a-4826-9b77-af738d158057"). InnerVolumeSpecName "kube-api-access-6lnvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:33:48.719791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719739 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-trusted-ca-bundle\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:48.719791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719782 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-serving-cert\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:48.719791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719791 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-oauth-serving-cert\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:48.719791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719799 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f73e5e33-0a5a-4826-9b77-af738d158057-console-oauth-config\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:48.719791 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719807 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lnvt\" (UniqueName: \"kubernetes.io/projected/f73e5e33-0a5a-4826-9b77-af738d158057-kube-api-access-6lnvt\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:48.720080 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719817 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-service-ca\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:48.720080 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:48.719826 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f73e5e33-0a5a-4826-9b77-af738d158057-console-config\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:33:49.303647 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.303609 2556 generic.go:356] "Generic (PLEG): container finished" podID="f73e5e33-0a5a-4826-9b77-af738d158057" containerID="c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617" exitCode=0 Jul 23 18:33:49.304130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.303661 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d997f85b4-2fqvx" Jul 23 18:33:49.304130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.303704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d997f85b4-2fqvx" event={"ID":"f73e5e33-0a5a-4826-9b77-af738d158057","Type":"ContainerDied","Data":"c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617"} Jul 23 18:33:49.304130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.303805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d997f85b4-2fqvx" event={"ID":"f73e5e33-0a5a-4826-9b77-af738d158057","Type":"ContainerDied","Data":"c019f3f89fc2693eab6d28b40e38573c60e93ed9548a9c4ee3e242793daf7a89"} Jul 23 18:33:49.304130 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.303835 2556 scope.go:117] "RemoveContainer" containerID="c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617" Jul 23 18:33:49.313208 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.313180 2556 scope.go:117] "RemoveContainer" containerID="c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617" Jul 23 18:33:49.313572 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:33:49.313552 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617\": container with ID starting with c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617 not found: ID does not exist" containerID="c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617" Jul 23 18:33:49.313621 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.313583 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617"} err="failed to get container status \"c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617\": rpc error: code = NotFound desc = could not find container \"c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617\": container with ID starting with c5eb14d78c67fdbe30c63163e4bd4f73f50aeb1fa7518e1bff28032dfea76617 not found: ID does not exist" Jul 23 18:33:49.325646 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.325620 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d997f85b4-2fqvx"] Jul 23 18:33:49.327409 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:49.327386 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d997f85b4-2fqvx"] Jul 23 18:33:50.355947 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:33:50.355908 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f73e5e33-0a5a-4826-9b77-af738d158057" path="/var/lib/kubelet/pods/f73e5e33-0a5a-4826-9b77-af738d158057/volumes" Jul 23 18:35:17.357323 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.357284 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wq7vx"] Jul 23 18:35:17.357777 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.357571 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f73e5e33-0a5a-4826-9b77-af738d158057" containerName="console" Jul 23 18:35:17.357777 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.357582 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f73e5e33-0a5a-4826-9b77-af738d158057" containerName="console" Jul 23 18:35:17.357777 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.357628 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f73e5e33-0a5a-4826-9b77-af738d158057" containerName="console" Jul 23 18:35:17.360377 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.360341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.363286 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.363264 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 18:35:17.364376 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.364343 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wdsvt\"" Jul 23 18:35:17.364432 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.364418 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 18:35:17.390326 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.390295 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wq7vx"] Jul 23 18:35:17.469746 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.469712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csfjd\" (UniqueName: \"kubernetes.io/projected/582e97e2-fe56-498c-b4b7-311d0d614890-kube-api-access-csfjd\") pod \"cert-manager-webhook-6486ffd997-wq7vx\" (UID: \"582e97e2-fe56-498c-b4b7-311d0d614890\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.469921 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.469786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/582e97e2-fe56-498c-b4b7-311d0d614890-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wq7vx\" (UID: \"582e97e2-fe56-498c-b4b7-311d0d614890\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.570578 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.570539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/582e97e2-fe56-498c-b4b7-311d0d614890-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wq7vx\" (UID: \"582e97e2-fe56-498c-b4b7-311d0d614890\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.570774 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.570588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csfjd\" (UniqueName: \"kubernetes.io/projected/582e97e2-fe56-498c-b4b7-311d0d614890-kube-api-access-csfjd\") pod \"cert-manager-webhook-6486ffd997-wq7vx\" (UID: \"582e97e2-fe56-498c-b4b7-311d0d614890\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.585608 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.585578 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/582e97e2-fe56-498c-b4b7-311d0d614890-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wq7vx\" (UID: \"582e97e2-fe56-498c-b4b7-311d0d614890\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.585754 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.585734 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csfjd\" (UniqueName: \"kubernetes.io/projected/582e97e2-fe56-498c-b4b7-311d0d614890-kube-api-access-csfjd\") pod \"cert-manager-webhook-6486ffd997-wq7vx\" (UID: \"582e97e2-fe56-498c-b4b7-311d0d614890\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.670117 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.670079 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:17.809176 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:17.809140 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wq7vx"] Jul 23 18:35:17.814857 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:35:17.814827 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod582e97e2_fe56_498c_b4b7_311d0d614890.slice/crio-e0095b00279e9b04eb88335f5b69659f5e42a86c195a9c15b9233e79f2e65144 WatchSource:0}: Error finding container e0095b00279e9b04eb88335f5b69659f5e42a86c195a9c15b9233e79f2e65144: Status 404 returned error can't find the container with id e0095b00279e9b04eb88335f5b69659f5e42a86c195a9c15b9233e79f2e65144 Jul 23 18:35:18.612090 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:18.612044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" event={"ID":"582e97e2-fe56-498c-b4b7-311d0d614890","Type":"ContainerStarted","Data":"e0095b00279e9b04eb88335f5b69659f5e42a86c195a9c15b9233e79f2e65144"} Jul 23 18:35:21.625049 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:21.625005 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" event={"ID":"582e97e2-fe56-498c-b4b7-311d0d614890","Type":"ContainerStarted","Data":"96b134580b36143ca11c9218c8dc380fa293b2e75a4585dc6c7d6efb12aed480"} Jul 23 18:35:21.625049 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:21.625057 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:21.641377 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:21.641304 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" podStartSLOduration=1.854670283 podStartE2EDuration="4.641288696s" totalImagesPullingTime="2.786618413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:21.640968581 +0000 UTC m=+293.705201310" watchObservedRunningTime="2026-07-23 18:35:21.641288696 +0000 UTC m=+293.705521424" Jul 23 18:35:27.631582 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:27.631550 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wq7vx" Jul 23 18:35:28.236787 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:28.236754 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:35:28.238234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:28.238213 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:35:28.242298 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:28.242276 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 18:35:50.630957 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.630924 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z"] Jul 23 18:35:50.634181 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.634165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.638152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.638123 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 18:35:50.638276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.638162 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 18:35:50.638738 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.638720 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ldd2q\"" Jul 23 18:35:50.638840 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.638720 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 18:35:50.638840 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.638807 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 18:35:50.658488 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.658458 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z"] Jul 23 18:35:50.729692 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.729655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e979403a-0cc2-4e71-914d-3a1d92b66f83-manifests\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.729692 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.729692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e979403a-0cc2-4e71-914d-3a1d92b66f83-tmp\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.729902 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.729712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-596sj\" (UniqueName: \"kubernetes.io/projected/e979403a-0cc2-4e71-914d-3a1d92b66f83-kube-api-access-596sj\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.729902 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.729740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e979403a-0cc2-4e71-914d-3a1d92b66f83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.729902 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.729821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e979403a-0cc2-4e71-914d-3a1d92b66f83-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.831078 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.831045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e979403a-0cc2-4e71-914d-3a1d92b66f83-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.831277 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.831094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e979403a-0cc2-4e71-914d-3a1d92b66f83-manifests\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.831277 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.831122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e979403a-0cc2-4e71-914d-3a1d92b66f83-tmp\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.831277 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.831142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-596sj\" (UniqueName: \"kubernetes.io/projected/e979403a-0cc2-4e71-914d-3a1d92b66f83-kube-api-access-596sj\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.831277 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.831170 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e979403a-0cc2-4e71-914d-3a1d92b66f83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.831647 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.831624 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e979403a-0cc2-4e71-914d-3a1d92b66f83-manifests\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.833657 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.833639 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e979403a-0cc2-4e71-914d-3a1d92b66f83-tmp\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.833779 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.833762 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e979403a-0cc2-4e71-914d-3a1d92b66f83-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.833868 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.833850 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e979403a-0cc2-4e71-914d-3a1d92b66f83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.841653 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.841630 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-596sj\" (UniqueName: \"kubernetes.io/projected/e979403a-0cc2-4e71-914d-3a1d92b66f83-kube-api-access-596sj\") pod \"opendatahub-operator-controller-manager-b6c6445bc-jqs7z\" (UID: \"e979403a-0cc2-4e71-914d-3a1d92b66f83\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:50.944822 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:50.944784 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:51.086315 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:51.086286 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z"] Jul 23 18:35:51.088987 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:35:51.088963 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode979403a_0cc2_4e71_914d_3a1d92b66f83.slice/crio-afc7859bc3a062e462a98cbfb674d2655f6364c665a6f9a5b9b0561e0e0c7d79 WatchSource:0}: Error finding container afc7859bc3a062e462a98cbfb674d2655f6364c665a6f9a5b9b0561e0e0c7d79: Status 404 returned error can't find the container with id afc7859bc3a062e462a98cbfb674d2655f6364c665a6f9a5b9b0561e0e0c7d79 Jul 23 18:35:51.090911 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:51.090890 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:35:51.729385 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:51.729325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" event={"ID":"e979403a-0cc2-4e71-914d-3a1d92b66f83","Type":"ContainerStarted","Data":"afc7859bc3a062e462a98cbfb674d2655f6364c665a6f9a5b9b0561e0e0c7d79"} Jul 23 18:35:54.745244 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:54.745203 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" event={"ID":"e979403a-0cc2-4e71-914d-3a1d92b66f83","Type":"ContainerStarted","Data":"d9baabf1308b7f40eec2ec3c66f18768c0e076b6e2ba2190d904ad7e3b795a1d"} Jul 23 18:35:55.750867 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:55.750831 2556 generic.go:356] "Generic (PLEG): container finished" podID="e979403a-0cc2-4e71-914d-3a1d92b66f83" containerID="d9baabf1308b7f40eec2ec3c66f18768c0e076b6e2ba2190d904ad7e3b795a1d" exitCode=0 Jul 23 18:35:55.751240 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:55.750916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" event={"ID":"e979403a-0cc2-4e71-914d-3a1d92b66f83","Type":"ContainerDied","Data":"d9baabf1308b7f40eec2ec3c66f18768c0e076b6e2ba2190d904ad7e3b795a1d"} Jul 23 18:35:56.756310 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:56.756278 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" event={"ID":"e979403a-0cc2-4e71-914d-3a1d92b66f83","Type":"ContainerStarted","Data":"a0af4db0f73ff359adcd9e96096de78f17e551723a820fd8bbbfc1716310eea3"} Jul 23 18:35:56.756726 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:56.756412 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:35:56.790469 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:35:56.790317 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" podStartSLOduration=2.28407991 podStartE2EDuration="6.790293909s" totalImagesPullingTime="3.500928104s" totalInitContainerRuntime="1.005285895s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:56.788734535 +0000 UTC m=+328.852967265" watchObservedRunningTime="2026-07-23 18:35:56.790293909 +0000 UTC m=+328.854526638" Jul 23 18:36:07.763093 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:07.763059 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-jqs7z" Jul 23 18:36:10.757793 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.757754 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8599469554-2565t"] Jul 23 18:36:10.766759 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.766731 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.770237 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.770182 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 18:36:10.770237 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.770200 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 18:36:10.771050 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.771031 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 18:36:10.773480 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.773465 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 18:36:10.786944 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.786918 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8599469554-2565t"] Jul 23 18:36:10.796786 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.796749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xxmd\" (UniqueName: \"kubernetes.io/projected/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-kube-api-access-7xxmd\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.796932 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.796793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-tls-certs\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.796932 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.796879 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-tmp\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.897771 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.897727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xxmd\" (UniqueName: \"kubernetes.io/projected/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-kube-api-access-7xxmd\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.897976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.897798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-tls-certs\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.897976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.897857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-tmp\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.900422 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.900388 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-tmp\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.901013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.900984 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-tls-certs\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.913979 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.913946 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xxmd\" (UniqueName: \"kubernetes.io/projected/0ff7e18f-15d3-4d15-b64e-b2be8f446b2c-kube-api-access-7xxmd\") pod \"kube-auth-proxy-8599469554-2565t\" (UID: \"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c\") " pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:10.994616 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.994581 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-54j49"] Jul 23 18:36:10.998000 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:10.997981 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.002341 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.002313 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 23 18:36:11.002710 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.002691 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bmdq4\"" Jul 23 18:36:11.079800 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.079706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" Jul 23 18:36:11.090536 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.090493 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-54j49"] Jul 23 18:36:11.099677 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.099601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492db523-161e-47f0-ad61-15342de69083-cert\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.099847 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.099719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xptf\" (UniqueName: \"kubernetes.io/projected/492db523-161e-47f0-ad61-15342de69083-kube-api-access-7xptf\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.200203 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.200168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492db523-161e-47f0-ad61-15342de69083-cert\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.200418 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.200223 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xptf\" (UniqueName: \"kubernetes.io/projected/492db523-161e-47f0-ad61-15342de69083-kube-api-access-7xptf\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.200617 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:11.200587 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 23 18:36:11.200735 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:11.200658 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/492db523-161e-47f0-ad61-15342de69083-cert podName:492db523-161e-47f0-ad61-15342de69083 nodeName:}" failed. No retries permitted until 2026-07-23 18:36:11.700638157 +0000 UTC m=+343.764870869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/492db523-161e-47f0-ad61-15342de69083-cert") pod "odh-model-controller-7998c67dc4-54j49" (UID: "492db523-161e-47f0-ad61-15342de69083") : secret "odh-model-controller-webhook-cert" not found Jul 23 18:36:11.225156 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.225109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xptf\" (UniqueName: \"kubernetes.io/projected/492db523-161e-47f0-ad61-15342de69083-kube-api-access-7xptf\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.252942 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:11.252916 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff7e18f_15d3_4d15_b64e_b2be8f446b2c.slice/crio-1b9b55e8a373447b8faa109a7e6b307152a48710afba60b107bb325ed3236384 WatchSource:0}: Error finding container 1b9b55e8a373447b8faa109a7e6b307152a48710afba60b107bb325ed3236384: Status 404 returned error can't find the container with id 1b9b55e8a373447b8faa109a7e6b307152a48710afba60b107bb325ed3236384 Jul 23 18:36:11.253261 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.253240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8599469554-2565t"] Jul 23 18:36:11.704249 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.704216 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492db523-161e-47f0-ad61-15342de69083-cert\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.706859 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.706831 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492db523-161e-47f0-ad61-15342de69083-cert\") pod \"odh-model-controller-7998c67dc4-54j49\" (UID: \"492db523-161e-47f0-ad61-15342de69083\") " pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:11.814854 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.814813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" event={"ID":"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c","Type":"ContainerStarted","Data":"1b9b55e8a373447b8faa109a7e6b307152a48710afba60b107bb325ed3236384"} Jul 23 18:36:11.909227 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:11.909191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:12.103885 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.103809 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-54j49"] Jul 23 18:36:12.109267 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:12.108826 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492db523_161e_47f0_ad61_15342de69083.slice/crio-61f9dbb006aec9bd53035d1421d11b4c91241760c09bcf66a1c561f0fdbc51ce WatchSource:0}: Error finding container 61f9dbb006aec9bd53035d1421d11b4c91241760c09bcf66a1c561f0fdbc51ce: Status 404 returned error can't find the container with id 61f9dbb006aec9bd53035d1421d11b4c91241760c09bcf66a1c561f0fdbc51ce Jul 23 18:36:12.292774 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.292126 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nv5xv"] Jul 23 18:36:12.296103 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.296073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:12.305179 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.305047 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-qkfmf\"" Jul 23 18:36:12.305356 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.305257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 23 18:36:12.341812 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.341782 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nv5xv"] Jul 23 18:36:12.409525 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.409484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab71f700-f42f-42b5-8ac6-c1b229a363c8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:12.409713 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.409544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv26z\" (UniqueName: \"kubernetes.io/projected/ab71f700-f42f-42b5-8ac6-c1b229a363c8-kube-api-access-dv26z\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:12.510762 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.510722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab71f700-f42f-42b5-8ac6-c1b229a363c8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:12.510914 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.510780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv26z\" (UniqueName: \"kubernetes.io/projected/ab71f700-f42f-42b5-8ac6-c1b229a363c8-kube-api-access-dv26z\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:12.510972 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:12.510903 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 23 18:36:12.511014 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:12.510984 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab71f700-f42f-42b5-8ac6-c1b229a363c8-tls-certs podName:ab71f700-f42f-42b5-8ac6-c1b229a363c8 nodeName:}" failed. No retries permitted until 2026-07-23 18:36:13.010961671 +0000 UTC m=+345.075194381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ab71f700-f42f-42b5-8ac6-c1b229a363c8-tls-certs") pod "model-serving-api-54d89bd5fc-nv5xv" (UID: "ab71f700-f42f-42b5-8ac6-c1b229a363c8") : secret "model-serving-api-tls" not found Jul 23 18:36:12.532180 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.532150 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv26z\" (UniqueName: \"kubernetes.io/projected/ab71f700-f42f-42b5-8ac6-c1b229a363c8-kube-api-access-dv26z\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:12.821591 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:12.821426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" event={"ID":"492db523-161e-47f0-ad61-15342de69083","Type":"ContainerStarted","Data":"61f9dbb006aec9bd53035d1421d11b4c91241760c09bcf66a1c561f0fdbc51ce"} Jul 23 18:36:13.015981 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.015937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab71f700-f42f-42b5-8ac6-c1b229a363c8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:13.023705 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.023663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab71f700-f42f-42b5-8ac6-c1b229a363c8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nv5xv\" (UID: \"ab71f700-f42f-42b5-8ac6-c1b229a363c8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:13.211992 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.211683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:13.308311 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.308275 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d"] Jul 23 18:36:13.313224 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.313197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.323234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.322727 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 23 18:36:13.323234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.322790 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 23 18:36:13.323234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.322953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 23 18:36:13.323234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.323074 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 18:36:13.323234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.323161 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6jvv9\"" Jul 23 18:36:13.346986 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.338978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d"] Jul 23 18:36:13.419149 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvjjt\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-kube-api-access-nvjjt\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.419346 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.419346 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-cacerts\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.419514 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.419514 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-local-certs\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.419514 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-token\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.419514 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.419485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.431872 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.431523 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nv5xv"] Jul 23 18:36:13.520974 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.520875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.520974 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.520932 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-local-certs\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.520974 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.520966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-token\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.521551 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.521009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.521551 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.521053 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvjjt\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-kube-api-access-nvjjt\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.521551 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.521108 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.521551 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.521171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-cacerts\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.522683 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.522651 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.528932 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.528880 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.529513 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.529409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-local-certs\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.529513 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.529466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.529681 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.529567 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-cacerts\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.539041 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.538989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvjjt\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-kube-api-access-nvjjt\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.541484 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.541434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-token\") pod \"istiod-openshift-gateway-7574459656-f9d2d\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:13.631748 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:13.631710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:14.163541 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:14.163508 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab71f700_f42f_42b5_8ac6_c1b229a363c8.slice/crio-5c586bdb5f122156c6739559dfee70636d58ec83e9c5846c30f90237002d2bd6 WatchSource:0}: Error finding container 5c586bdb5f122156c6739559dfee70636d58ec83e9c5846c30f90237002d2bd6: Status 404 returned error can't find the container with id 5c586bdb5f122156c6739559dfee70636d58ec83e9c5846c30f90237002d2bd6 Jul 23 18:36:14.833056 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:14.832996 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" event={"ID":"ab71f700-f42f-42b5-8ac6-c1b229a363c8","Type":"ContainerStarted","Data":"5c586bdb5f122156c6739559dfee70636d58ec83e9c5846c30f90237002d2bd6"} Jul 23 18:36:15.638595 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:15.638552 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9a9927_d3c9_4bc7_b408_1c5db19e58cb.slice/crio-91632789aa85b0909d25551e6bb303d27f4fa4f213995c2ba5236f1440cf3def WatchSource:0}: Error finding container 91632789aa85b0909d25551e6bb303d27f4fa4f213995c2ba5236f1440cf3def: Status 404 returned error can't find the container with id 91632789aa85b0909d25551e6bb303d27f4fa4f213995c2ba5236f1440cf3def Jul 23 18:36:15.639290 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.639258 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d"] Jul 23 18:36:15.839607 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.839504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" event={"ID":"492db523-161e-47f0-ad61-15342de69083","Type":"ContainerStarted","Data":"fda8910d674b5666c2b9b796ab05bd9e9834d93fd2b3866f9be982f494054a5e"} Jul 23 18:36:15.839787 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.839609 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:15.841102 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.841064 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" event={"ID":"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb","Type":"ContainerStarted","Data":"91632789aa85b0909d25551e6bb303d27f4fa4f213995c2ba5236f1440cf3def"} Jul 23 18:36:15.843021 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.842991 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" event={"ID":"0ff7e18f-15d3-4d15-b64e-b2be8f446b2c","Type":"ContainerStarted","Data":"78b0b48cc296608be4ff4f39e8c16a0b2a1596697eefac3bb40c62c5b6b1bc99"} Jul 23 18:36:15.860047 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.859978 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" podStartSLOduration=2.440902574 podStartE2EDuration="5.85995988s" totalImagesPullingTime="3.419057306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:15.859677627 +0000 UTC m=+347.923910358" watchObservedRunningTime="2026-07-23 18:36:15.85995988 +0000 UTC m=+347.924192610" Jul 23 18:36:15.884142 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:15.884084 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8599469554-2565t" podStartSLOduration=1.665291222 podStartE2EDuration="5.884067695s" totalImagesPullingTime="4.218776473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:15.881614063 +0000 UTC m=+347.945846794" watchObservedRunningTime="2026-07-23 18:36:15.884067695 +0000 UTC m=+347.948300423" Jul 23 18:36:17.857572 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:17.856925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" event={"ID":"ab71f700-f42f-42b5-8ac6-c1b229a363c8","Type":"ContainerStarted","Data":"4e1ff9fafc6d8a547caaabe7f0d92387633f530b20f74d9a974e5d70feb23412"} Jul 23 18:36:17.857572 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:17.857096 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:17.890422 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:17.890341 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" podStartSLOduration=3.254983852 podStartE2EDuration="5.890318777s" totalImagesPullingTime="2.635334925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:17.887735056 +0000 UTC m=+349.951967786" watchObservedRunningTime="2026-07-23 18:36:17.890318777 +0000 UTC m=+349.954551508" Jul 23 18:36:19.269725 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:19.269688 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:19.270013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:19.269757 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:19.869377 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:19.869339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" event={"ID":"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb","Type":"ContainerStarted","Data":"fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7"} Jul 23 18:36:19.869589 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:19.869543 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:19.944538 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:19.944481 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" podStartSLOduration=3.315744885 podStartE2EDuration="6.944462644s" totalImagesPullingTime="3.628717759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:19.939017156 +0000 UTC m=+352.003249886" watchObservedRunningTime="2026-07-23 18:36:19.944462644 +0000 UTC m=+352.008695373" Jul 23 18:36:20.876119 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:20.876085 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-f9d2d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 18:36:20.876516 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:20.876154 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" podUID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 18:36:21.097099 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.097064 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r"] Jul 23 18:36:21.099725 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.099708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.121263 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.121223 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r"] Jul 23 18:36:21.190418 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.190418 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27w6h\" (UniqueName: \"kubernetes.io/projected/86f0964c-044f-43bb-b3fc-3f0bd43590fb-kube-api-access-27w6h\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.190671 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.190671 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.190671 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.190671 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f0964c-044f-43bb-b3fc-3f0bd43590fb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.190671 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.190602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.291880 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.291836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27w6h\" (UniqueName: \"kubernetes.io/projected/86f0964c-044f-43bb-b3fc-3f0bd43590fb-kube-api-access-27w6h\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.292081 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.291899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.292081 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.291935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.292081 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.291970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.292081 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.291997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f0964c-044f-43bb-b3fc-3f0bd43590fb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.292283 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.292130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.292283 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.292184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.293002 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.292970 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.294486 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.294456 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f0964c-044f-43bb-b3fc-3f0bd43590fb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.294599 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.294573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.294673 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.294619 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.294730 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.294717 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86f0964c-044f-43bb-b3fc-3f0bd43590fb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.307543 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.307514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27w6h\" (UniqueName: \"kubernetes.io/projected/86f0964c-044f-43bb-b3fc-3f0bd43590fb-kube-api-access-27w6h\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.310339 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.310313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f0964c-044f-43bb-b3fc-3f0bd43590fb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jq84r\" (UID: \"86f0964c-044f-43bb-b3fc-3f0bd43590fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.408858 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.408811 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:21.594013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.593971 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r"] Jul 23 18:36:21.597658 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:21.597629 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f0964c_044f_43bb_b3fc_3f0bd43590fb.slice/crio-e09f9351fa6c035b0a6c40ce2a8e79d14240f52558e846adafe3b454e718854c WatchSource:0}: Error finding container e09f9351fa6c035b0a6c40ce2a8e79d14240f52558e846adafe3b454e718854c: Status 404 returned error can't find the container with id e09f9351fa6c035b0a6c40ce2a8e79d14240f52558e846adafe3b454e718854c Jul 23 18:36:21.601839 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.601800 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:21.601962 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.601869 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:21.880669 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.880578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" event={"ID":"86f0964c-044f-43bb-b3fc-3f0bd43590fb","Type":"ContainerStarted","Data":"b799973987b50b24fe0af2d4dd84b4920dd61c5d87c6573de8c81e14ccc70c6b"} Jul 23 18:36:21.880669 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.880629 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" event={"ID":"86f0964c-044f-43bb-b3fc-3f0bd43590fb","Type":"ContainerStarted","Data":"e09f9351fa6c035b0a6c40ce2a8e79d14240f52558e846adafe3b454e718854c"} Jul 23 18:36:21.881096 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:21.880669 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:22.021708 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:22.021653 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" podStartSLOduration=1.021630346 podStartE2EDuration="1.021630346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:22.008668401 +0000 UTC m=+354.072901130" watchObservedRunningTime="2026-07-23 18:36:22.021630346 +0000 UTC m=+354.085863077" Jul 23 18:36:22.886574 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:22.886543 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq84r" Jul 23 18:36:23.221603 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.221567 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d"] Jul 23 18:36:23.221792 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.221752 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" podUID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" containerName="discovery" containerID="cri-o://fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7" gracePeriod=30 Jul 23 18:36:23.222622 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.222601 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:23.489901 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.489830 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:23.613550 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613511 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvjjt\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-kube-api-access-nvjjt\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.613735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613570 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-cacerts\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.613735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613594 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-dns-cert\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.613735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613632 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-ca-configmap\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.613735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613648 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-token\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.613735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613677 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-local-certs\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.613735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.613713 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-kubeconfig\") pod \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\" (UID: \"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb\") " Jul 23 18:36:23.614065 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.614041 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:36:23.616266 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.616233 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-local-certs" (OuterVolumeSpecName: "local-certs") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:36:23.616266 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.616242 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:36:23.616493 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.616466 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:36:23.616493 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.616478 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-cacerts" (OuterVolumeSpecName: "cacerts") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:36:23.616588 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.616572 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:36:23.616621 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.616596 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-kube-api-access-nvjjt" (OuterVolumeSpecName: "kube-api-access-nvjjt") pod "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" (UID: "2a9a9927-d3c9-4bc7-b408-1c5db19e58cb"). InnerVolumeSpecName "kube-api-access-nvjjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:36:23.715108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715073 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-cacerts\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.715108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715101 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-dns-cert\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.715108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715113 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-csr-ca-configmap\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.715108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715123 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-token\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.715407 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715131 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-local-certs\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.715407 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715139 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-istio-kubeconfig\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.715407 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.715146 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvjjt\" (UniqueName: \"kubernetes.io/projected/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb-kube-api-access-nvjjt\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:36:23.890411 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.890293 2556 generic.go:356] "Generic (PLEG): container finished" podID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" containerID="fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7" exitCode=0 Jul 23 18:36:23.890411 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.890338 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" Jul 23 18:36:23.890411 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.890388 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" event={"ID":"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb","Type":"ContainerDied","Data":"fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7"} Jul 23 18:36:23.890932 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.890444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d" event={"ID":"2a9a9927-d3c9-4bc7-b408-1c5db19e58cb","Type":"ContainerDied","Data":"91632789aa85b0909d25551e6bb303d27f4fa4f213995c2ba5236f1440cf3def"} Jul 23 18:36:23.890932 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.890483 2556 scope.go:117] "RemoveContainer" containerID="fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7" Jul 23 18:36:23.899419 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.899397 2556 scope.go:117] "RemoveContainer" containerID="fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7" Jul 23 18:36:23.899725 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:23.899704 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7\": container with ID starting with fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7 not found: ID does not exist" containerID="fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7" Jul 23 18:36:23.899782 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.899737 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7"} err="failed to get container status \"fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7\": rpc error: code = NotFound desc = could not find container \"fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7\": container with ID starting with fe69645364b38ed4b5ff2cc082093ef839a8472d49e7cff1ff086c331867fed7 not found: ID does not exist" Jul 23 18:36:23.940182 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.940139 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d"] Jul 23 18:36:23.953906 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:23.953871 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f9d2d"] Jul 23 18:36:24.356583 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:24.356544 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" path="/var/lib/kubelet/pods/2a9a9927-d3c9-4bc7-b408-1c5db19e58cb/volumes" Jul 23 18:36:25.706106 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.706071 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bw92v"] Jul 23 18:36:25.706591 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.706547 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" containerName="discovery" Jul 23 18:36:25.706591 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.706564 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" containerName="discovery" Jul 23 18:36:25.706716 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.706665 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9a9927-d3c9-4bc7-b408-1c5db19e58cb" containerName="discovery" Jul 23 18:36:25.711141 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.711116 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.717266 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:25.717231 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-jjj4z\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jjj4z\"" type="*v1.Secret" Jul 23 18:36:25.717476 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:25.717439 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kserve-controller-manager-d6f4b65b8-bw92v\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="fa27e478-5a51-41ef-be5f-379206803751" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.717531 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:25.717466 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret" Jul 23 18:36:25.737800 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.737771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bw92v"] Jul 23 18:36:25.752190 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.752158 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2"] Jul 23 18:36:25.755763 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.755737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:25.760410 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.760384 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 23 18:36:25.761286 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.761256 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hjhcs\"" Jul 23 18:36:25.776835 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.776802 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2"] Jul 23 18:36:25.832063 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.832030 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kknm5\" (UniqueName: \"kubernetes.io/projected/c218553d-9182-417c-90d3-657119af5698-kube-api-access-kknm5\") pod \"llmisvc-controller-manager-777c6bd7d5-kqxv2\" (UID: \"c218553d-9182-417c-90d3-657119af5698\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:25.832063 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.832063 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jdw4\" (UniqueName: \"kubernetes.io/projected/fa27e478-5a51-41ef-be5f-379206803751-kube-api-access-9jdw4\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.832263 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.832088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa27e478-5a51-41ef-be5f-379206803751-cert\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.832263 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.832187 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c218553d-9182-417c-90d3-657119af5698-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqxv2\" (UID: \"c218553d-9182-417c-90d3-657119af5698\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:25.933116 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.933077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kknm5\" (UniqueName: \"kubernetes.io/projected/c218553d-9182-417c-90d3-657119af5698-kube-api-access-kknm5\") pod \"llmisvc-controller-manager-777c6bd7d5-kqxv2\" (UID: \"c218553d-9182-417c-90d3-657119af5698\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:25.933116 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.933114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jdw4\" (UniqueName: \"kubernetes.io/projected/fa27e478-5a51-41ef-be5f-379206803751-kube-api-access-9jdw4\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.933401 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.933130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa27e478-5a51-41ef-be5f-379206803751-cert\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.933401 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.933167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c218553d-9182-417c-90d3-657119af5698-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqxv2\" (UID: \"c218553d-9182-417c-90d3-657119af5698\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:25.935694 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.935676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c218553d-9182-417c-90d3-657119af5698-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqxv2\" (UID: \"c218553d-9182-417c-90d3-657119af5698\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:25.947150 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.947124 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jdw4\" (UniqueName: \"kubernetes.io/projected/fa27e478-5a51-41ef-be5f-379206803751-kube-api-access-9jdw4\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:25.947261 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:25.947170 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kknm5\" (UniqueName: \"kubernetes.io/projected/c218553d-9182-417c-90d3-657119af5698-kube-api-access-kknm5\") pod \"llmisvc-controller-manager-777c6bd7d5-kqxv2\" (UID: \"c218553d-9182-417c-90d3-657119af5698\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:26.073011 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:26.072915 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:26.338224 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:26.338148 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2"] Jul 23 18:36:26.341185 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:26.341157 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc218553d_9182_417c_90d3_657119af5698.slice/crio-3276cfe2187601b5d6a7da5b3db9c1c01c62a66dbfb13bc82fafdf6d9885dd41 WatchSource:0}: Error finding container 3276cfe2187601b5d6a7da5b3db9c1c01c62a66dbfb13bc82fafdf6d9885dd41: Status 404 returned error can't find the container with id 3276cfe2187601b5d6a7da5b3db9c1c01c62a66dbfb13bc82fafdf6d9885dd41 Jul 23 18:36:26.852173 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:26.852145 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-54j49" Jul 23 18:36:26.910711 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:26.910671 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" event={"ID":"c218553d-9182-417c-90d3-657119af5698","Type":"ContainerStarted","Data":"3276cfe2187601b5d6a7da5b3db9c1c01c62a66dbfb13bc82fafdf6d9885dd41"} Jul 23 18:36:26.933673 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:26.933638 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition Jul 23 18:36:26.933840 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:36:26.933732 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa27e478-5a51-41ef-be5f-379206803751-cert podName:fa27e478-5a51-41ef-be5f-379206803751 nodeName:}" failed. No retries permitted until 2026-07-23 18:36:27.433709968 +0000 UTC m=+359.497942695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa27e478-5a51-41ef-be5f-379206803751-cert") pod "kserve-controller-manager-d6f4b65b8-bw92v" (UID: "fa27e478-5a51-41ef-be5f-379206803751") : failed to sync secret cache: timed out waiting for the condition Jul 23 18:36:26.970350 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:26.970317 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 23 18:36:27.259202 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:27.259172 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jjj4z\"" Jul 23 18:36:27.445372 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:27.445336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa27e478-5a51-41ef-be5f-379206803751-cert\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:27.447963 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:27.447935 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa27e478-5a51-41ef-be5f-379206803751-cert\") pod \"kserve-controller-manager-d6f4b65b8-bw92v\" (UID: \"fa27e478-5a51-41ef-be5f-379206803751\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:27.523482 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:27.523355 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:28.332877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:28.332845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bw92v"] Jul 23 18:36:28.337037 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:36:28.336993 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa27e478_5a51_41ef_be5f_379206803751.slice/crio-3f08e9967600cf055639071ead336a5b0e4965d003f15cb121415e578e0532e3 WatchSource:0}: Error finding container 3f08e9967600cf055639071ead336a5b0e4965d003f15cb121415e578e0532e3: Status 404 returned error can't find the container with id 3f08e9967600cf055639071ead336a5b0e4965d003f15cb121415e578e0532e3 Jul 23 18:36:28.874500 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:28.874016 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nv5xv" Jul 23 18:36:28.923001 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:28.922963 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" event={"ID":"fa27e478-5a51-41ef-be5f-379206803751","Type":"ContainerStarted","Data":"3f08e9967600cf055639071ead336a5b0e4965d003f15cb121415e578e0532e3"} Jul 23 18:36:30.933812 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:30.933767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" event={"ID":"fa27e478-5a51-41ef-be5f-379206803751","Type":"ContainerStarted","Data":"6cfdc80209016ab27030d6e64c87006fc776187ad9d7b10be19fea9442bee380"} Jul 23 18:36:30.934264 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:30.933857 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:36:30.935357 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:30.935329 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" event={"ID":"c218553d-9182-417c-90d3-657119af5698","Type":"ContainerStarted","Data":"5779879e77e92c6352bfdaf9ca42552c230fb6c88cb32550b2b7a7dd116b62e3"} Jul 23 18:36:30.935475 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:30.935397 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:36:30.964603 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:36:30.964555 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" podStartSLOduration=3.475267605 podStartE2EDuration="5.964540422s" totalImagesPullingTime="2.489272817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:30.964156119 +0000 UTC m=+363.028388848" watchObservedRunningTime="2026-07-23 18:36:30.964540422 +0000 UTC m=+363.028773151" Jul 23 18:37:01.942476 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:01.942445 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" Jul 23 18:37:01.945581 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:01.945559 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bw92v" Jul 23 18:37:01.961858 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:01.961807 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqxv2" podStartSLOduration=32.477835743 podStartE2EDuration="36.96178582s" totalImagesPullingTime="4.483950077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:30.986808006 +0000 UTC m=+363.051040736" watchObservedRunningTime="2026-07-23 18:37:01.96178582 +0000 UTC m=+394.026018597" Jul 23 18:37:49.061115 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.061033 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl"] Jul 23 18:37:49.064449 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.064432 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.068599 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.068576 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b48jj\"" Jul 23 18:37:49.068715 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.068636 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 18:37:49.078686 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.078664 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 18:37:49.103740 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.103710 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl"] Jul 23 18:37:49.151156 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.151127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cvsp\" (UniqueName: \"kubernetes.io/projected/e3eebc67-906d-48e7-858a-38ab3395110b-kube-api-access-7cvsp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.151335 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.151172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3eebc67-906d-48e7-858a-38ab3395110b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.251851 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.251820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cvsp\" (UniqueName: \"kubernetes.io/projected/e3eebc67-906d-48e7-858a-38ab3395110b-kube-api-access-7cvsp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.252027 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.251862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3eebc67-906d-48e7-858a-38ab3395110b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.252200 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.252183 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3eebc67-906d-48e7-858a-38ab3395110b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.281656 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.281624 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cvsp\" (UniqueName: \"kubernetes.io/projected/e3eebc67-906d-48e7-858a-38ab3395110b-kube-api-access-7cvsp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.374461 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.374352 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:49.601977 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:49.601945 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl"] Jul 23 18:37:49.622790 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:37:49.622759 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3eebc67_906d_48e7_858a_38ab3395110b.slice/crio-f34684bf1baded8b814e534516cfaadef724f946f52967846c46635be3375285 WatchSource:0}: Error finding container f34684bf1baded8b814e534516cfaadef724f946f52967846c46635be3375285: Status 404 returned error can't find the container with id f34684bf1baded8b814e534516cfaadef724f946f52967846c46635be3375285 Jul 23 18:37:50.272226 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:50.272190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" event={"ID":"e3eebc67-906d-48e7-858a-38ab3395110b","Type":"ContainerStarted","Data":"f34684bf1baded8b814e534516cfaadef724f946f52967846c46635be3375285"} Jul 23 18:37:55.330851 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.330814 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk"] Jul 23 18:37:55.334604 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.334578 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:37:55.338250 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.338228 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c442l\"" Jul 23 18:37:55.355020 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.354978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk"] Jul 23 18:37:55.406774 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.406739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4ljq\" (UniqueName: \"kubernetes.io/projected/c1bbf104-6b25-4ceb-8fb8-f645a5fce630-kube-api-access-p4ljq\") pod \"limitador-operator-controller-manager-859d7b78bd-4dpgk\" (UID: \"c1bbf104-6b25-4ceb-8fb8-f645a5fce630\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:37:55.507330 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.507287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4ljq\" (UniqueName: \"kubernetes.io/projected/c1bbf104-6b25-4ceb-8fb8-f645a5fce630-kube-api-access-p4ljq\") pod \"limitador-operator-controller-manager-859d7b78bd-4dpgk\" (UID: \"c1bbf104-6b25-4ceb-8fb8-f645a5fce630\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:37:55.517167 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.517129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4ljq\" (UniqueName: \"kubernetes.io/projected/c1bbf104-6b25-4ceb-8fb8-f645a5fce630-kube-api-access-p4ljq\") pod \"limitador-operator-controller-manager-859d7b78bd-4dpgk\" (UID: \"c1bbf104-6b25-4ceb-8fb8-f645a5fce630\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:37:55.647031 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.646951 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:37:55.806170 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:55.806134 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk"] Jul 23 18:37:55.810274 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:37:55.810250 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bbf104_6b25_4ceb_8fb8_f645a5fce630.slice/crio-fe936da0ad582aaaeca33bdceac1a9b7658f6043854706b7df26ee9e20f97a23 WatchSource:0}: Error finding container fe936da0ad582aaaeca33bdceac1a9b7658f6043854706b7df26ee9e20f97a23: Status 404 returned error can't find the container with id fe936da0ad582aaaeca33bdceac1a9b7658f6043854706b7df26ee9e20f97a23 Jul 23 18:37:56.299251 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:56.299213 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" event={"ID":"c1bbf104-6b25-4ceb-8fb8-f645a5fce630","Type":"ContainerStarted","Data":"fe936da0ad582aaaeca33bdceac1a9b7658f6043854706b7df26ee9e20f97a23"} Jul 23 18:37:56.300807 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:56.300783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" event={"ID":"e3eebc67-906d-48e7-858a-38ab3395110b","Type":"ContainerStarted","Data":"178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec"} Jul 23 18:37:56.300971 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:56.300953 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:37:56.323013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:56.322958 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" podStartSLOduration=1.292772751 podStartE2EDuration="7.322939666s" totalImagesPullingTime="6.030166915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:37:56.320519279 +0000 UTC m=+448.384752010" watchObservedRunningTime="2026-07-23 18:37:56.322939666 +0000 UTC m=+448.387172394" Jul 23 18:37:58.314809 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:58.314771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" event={"ID":"c1bbf104-6b25-4ceb-8fb8-f645a5fce630","Type":"ContainerStarted","Data":"155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6"} Jul 23 18:37:58.315249 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:58.314899 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:37:58.335683 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:37:58.335632 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" podStartSLOduration=1.459732771 podStartE2EDuration="3.33561675s" totalImagesPullingTime="1.875883979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:37:58.334188994 +0000 UTC m=+450.398421723" watchObservedRunningTime="2026-07-23 18:37:58.33561675 +0000 UTC m=+450.399849478" Jul 23 18:38:07.310815 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:07.310782 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.220255 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.220225 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj"] Jul 23 18:38:09.223522 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.223507 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.288817 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.288784 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj"] Jul 23 18:38:09.306971 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.306939 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl"] Jul 23 18:38:09.307201 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.307164 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" containerName="manager" containerID="cri-o://178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec" gracePeriod=2 Jul 23 18:38:09.322178 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.322153 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:38:09.322321 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.322244 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl"] Jul 23 18:38:09.329133 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.329105 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6284e71c-29bf-4477-a161-7a40d103bf63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frwfj\" (UID: \"6284e71c-29bf-4477-a161-7a40d103bf63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.329242 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.329157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt2lq\" (UniqueName: \"kubernetes.io/projected/6284e71c-29bf-4477-a161-7a40d103bf63-kube-api-access-zt2lq\") pod \"kuadrant-operator-controller-manager-86878c769f-frwfj\" (UID: \"6284e71c-29bf-4477-a161-7a40d103bf63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.336035 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.335994 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e3eebc67-906d-48e7-858a-38ab3395110b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-s8scl\": pods \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.339447 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.339416 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb"] Jul 23 18:38:09.339790 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.339776 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" containerName="manager" Jul 23 18:38:09.339838 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.339792 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" containerName="manager" Jul 23 18:38:09.339869 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.339848 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" containerName="manager" Jul 23 18:38:09.343218 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.343181 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj"] Jul 23 18:38:09.343354 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.343305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.343551 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.343510 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-zt2lq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" podUID="6284e71c-29bf-4477-a161-7a40d103bf63" Jul 23 18:38:09.360745 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.360718 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.372503 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.372451 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj"] Jul 23 18:38:09.374389 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.374340 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb"] Jul 23 18:38:09.390082 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.390055 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg"] Jul 23 18:38:09.393338 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.393316 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk"] Jul 23 18:38:09.393481 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.393469 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.393555 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.393479 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" containerName="manager" containerID="cri-o://155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6" gracePeriod=2 Jul 23 18:38:09.394198 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.394176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.399759 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.399737 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk"] Jul 23 18:38:09.413099 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.413070 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.416001 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.415976 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-frwfj\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="6284e71c-29bf-4477-a161-7a40d103bf63" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.418761 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.418736 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dpgk\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:38:09.431849 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.431812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rscz8\" (UniqueName: \"kubernetes.io/projected/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-kube-api-access-rscz8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qnkcb\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.431993 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.431877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt2lq\" (UniqueName: \"kubernetes.io/projected/6284e71c-29bf-4477-a161-7a40d103bf63-kube-api-access-zt2lq\") pod \"kuadrant-operator-controller-manager-86878c769f-frwfj\" (UID: \"6284e71c-29bf-4477-a161-7a40d103bf63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.432056 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.432006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qnkcb\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.432104 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.432061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6284e71c-29bf-4477-a161-7a40d103bf63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frwfj\" (UID: \"6284e71c-29bf-4477-a161-7a40d103bf63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.432524 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.432500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6284e71c-29bf-4477-a161-7a40d103bf63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frwfj\" (UID: \"6284e71c-29bf-4477-a161-7a40d103bf63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.434031 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.434001 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg"] Jul 23 18:38:09.438668 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.438641 2556 projected.go:196] Error preparing data for projected volume kube-api-access-zt2lq for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-frwfj" not found Jul 23 18:38:09.438797 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.438731 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6284e71c-29bf-4477-a161-7a40d103bf63-kube-api-access-zt2lq podName:6284e71c-29bf-4477-a161-7a40d103bf63 nodeName:}" failed. No retries permitted until 2026-07-23 18:38:09.938710426 +0000 UTC m=+462.002943154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zt2lq" (UniqueName: "kubernetes.io/projected/6284e71c-29bf-4477-a161-7a40d103bf63-kube-api-access-zt2lq") pod "kuadrant-operator-controller-manager-86878c769f-frwfj" (UID: "6284e71c-29bf-4477-a161-7a40d103bf63") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-frwfj" not found Jul 23 18:38:09.458778 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.458739 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.533032 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.532984 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6284e71c-29bf-4477-a161-7a40d103bf63-extensions-socket-volume\") pod \"6284e71c-29bf-4477-a161-7a40d103bf63\" (UID: \"6284e71c-29bf-4477-a161-7a40d103bf63\") " Jul 23 18:38:09.533255 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rscz8\" (UniqueName: \"kubernetes.io/projected/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-kube-api-access-rscz8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qnkcb\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.533415 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqzp\" (UniqueName: \"kubernetes.io/projected/dbbfc586-fed5-47c4-a6c5-8c06db48effa-kube-api-access-pcqzp\") pod \"kuadrant-operator-controller-manager-86878c769f-mt7fg\" (UID: \"dbbfc586-fed5-47c4-a6c5-8c06db48effa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.533415 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qnkcb\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.533525 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533436 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6284e71c-29bf-4477-a161-7a40d103bf63-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6284e71c-29bf-4477-a161-7a40d103bf63" (UID: "6284e71c-29bf-4477-a161-7a40d103bf63"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:09.533525 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533444 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbbfc586-fed5-47c4-a6c5-8c06db48effa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mt7fg\" (UID: \"dbbfc586-fed5-47c4-a6c5-8c06db48effa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.533627 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533522 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6284e71c-29bf-4477-a161-7a40d103bf63-extensions-socket-volume\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:09.533627 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533542 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt2lq\" (UniqueName: \"kubernetes.io/projected/6284e71c-29bf-4477-a161-7a40d103bf63-kube-api-access-zt2lq\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:09.533846 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.533804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qnkcb\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.571100 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.571073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rscz8\" (UniqueName: \"kubernetes.io/projected/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-kube-api-access-rscz8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qnkcb\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.633930 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.633901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqzp\" (UniqueName: \"kubernetes.io/projected/dbbfc586-fed5-47c4-a6c5-8c06db48effa-kube-api-access-pcqzp\") pod \"kuadrant-operator-controller-manager-86878c769f-mt7fg\" (UID: \"dbbfc586-fed5-47c4-a6c5-8c06db48effa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.634044 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.633948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbbfc586-fed5-47c4-a6c5-8c06db48effa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mt7fg\" (UID: \"dbbfc586-fed5-47c4-a6c5-8c06db48effa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.634298 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.634277 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbbfc586-fed5-47c4-a6c5-8c06db48effa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mt7fg\" (UID: \"dbbfc586-fed5-47c4-a6c5-8c06db48effa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.637020 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.636999 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.639044 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.639027 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:38:09.639581 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.639560 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.641931 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.641906 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-frwfj\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="6284e71c-29bf-4477-a161-7a40d103bf63" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.644384 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.644343 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dpgk\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:38:09.650793 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.650761 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-s8scl\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:09.652027 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.652004 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqzp\" (UniqueName: \"kubernetes.io/projected/dbbfc586-fed5-47c4-a6c5-8c06db48effa-kube-api-access-pcqzp\") pod \"kuadrant-operator-controller-manager-86878c769f-mt7fg\" (UID: \"dbbfc586-fed5-47c4-a6c5-8c06db48effa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.652968 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.652946 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-frwfj\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="6284e71c-29bf-4477-a161-7a40d103bf63" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:09.661879 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:09.661848 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dpgk\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:38:09.690374 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.690339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:09.735036 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.735003 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3eebc67-906d-48e7-858a-38ab3395110b-extensions-socket-volume\") pod \"e3eebc67-906d-48e7-858a-38ab3395110b\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " Jul 23 18:38:09.735234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.735060 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cvsp\" (UniqueName: \"kubernetes.io/projected/e3eebc67-906d-48e7-858a-38ab3395110b-kube-api-access-7cvsp\") pod \"e3eebc67-906d-48e7-858a-38ab3395110b\" (UID: \"e3eebc67-906d-48e7-858a-38ab3395110b\") " Jul 23 18:38:09.735234 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.735081 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4ljq\" (UniqueName: \"kubernetes.io/projected/c1bbf104-6b25-4ceb-8fb8-f645a5fce630-kube-api-access-p4ljq\") pod \"c1bbf104-6b25-4ceb-8fb8-f645a5fce630\" (UID: \"c1bbf104-6b25-4ceb-8fb8-f645a5fce630\") " Jul 23 18:38:09.735617 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.735585 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3eebc67-906d-48e7-858a-38ab3395110b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e3eebc67-906d-48e7-858a-38ab3395110b" (UID: "e3eebc67-906d-48e7-858a-38ab3395110b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:09.737409 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.737384 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3eebc67-906d-48e7-858a-38ab3395110b-kube-api-access-7cvsp" (OuterVolumeSpecName: "kube-api-access-7cvsp") pod "e3eebc67-906d-48e7-858a-38ab3395110b" (UID: "e3eebc67-906d-48e7-858a-38ab3395110b"). InnerVolumeSpecName "kube-api-access-7cvsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:38:09.737409 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.737397 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bbf104-6b25-4ceb-8fb8-f645a5fce630-kube-api-access-p4ljq" (OuterVolumeSpecName: "kube-api-access-p4ljq") pod "c1bbf104-6b25-4ceb-8fb8-f645a5fce630" (UID: "c1bbf104-6b25-4ceb-8fb8-f645a5fce630"). InnerVolumeSpecName "kube-api-access-p4ljq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:38:09.755179 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.754987 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:09.836098 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.836066 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3eebc67-906d-48e7-858a-38ab3395110b-extensions-socket-volume\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:09.836098 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.836098 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cvsp\" (UniqueName: \"kubernetes.io/projected/e3eebc67-906d-48e7-858a-38ab3395110b-kube-api-access-7cvsp\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:09.836293 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.836112 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4ljq\" (UniqueName: \"kubernetes.io/projected/c1bbf104-6b25-4ceb-8fb8-f645a5fce630-kube-api-access-p4ljq\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:09.898786 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.898750 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb"] Jul 23 18:38:09.915798 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:38:09.915774 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0d8cc3_e582_4ed0_99d9_a51bafe4d580.slice/crio-d2ed787194ba5c5d8d5badaafb64a089aabc38e33b1341db09d373ecb89d8dd4 WatchSource:0}: Error finding container d2ed787194ba5c5d8d5badaafb64a089aabc38e33b1341db09d373ecb89d8dd4: Status 404 returned error can't find the container with id d2ed787194ba5c5d8d5badaafb64a089aabc38e33b1341db09d373ecb89d8dd4 Jul 23 18:38:09.938495 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:09.938467 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg"] Jul 23 18:38:09.948557 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:38:09.948525 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbfc586_fed5_47c4_a6c5_8c06db48effa.slice/crio-13239457a6c11e2c37d5672080b5f2479a2fe4ee72ced97430dcb6d19193ef57 WatchSource:0}: Error finding container 13239457a6c11e2c37d5672080b5f2479a2fe4ee72ced97430dcb6d19193ef57: Status 404 returned error can't find the container with id 13239457a6c11e2c37d5672080b5f2479a2fe4ee72ced97430dcb6d19193ef57 Jul 23 18:38:10.356666 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.356637 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6284e71c-29bf-4477-a161-7a40d103bf63" path="/var/lib/kubelet/pods/6284e71c-29bf-4477-a161-7a40d103bf63/volumes" Jul 23 18:38:10.357006 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.356846 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" path="/var/lib/kubelet/pods/c1bbf104-6b25-4ceb-8fb8-f645a5fce630/volumes" Jul 23 18:38:10.357149 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.357136 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3eebc67-906d-48e7-858a-38ab3395110b" path="/var/lib/kubelet/pods/e3eebc67-906d-48e7-858a-38ab3395110b/volumes" Jul 23 18:38:10.367507 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.367481 2556 generic.go:356] "Generic (PLEG): container finished" podID="e3eebc67-906d-48e7-858a-38ab3395110b" containerID="178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec" exitCode=0 Jul 23 18:38:10.367648 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.367528 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s8scl" Jul 23 18:38:10.367648 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.367574 2556 scope.go:117] "RemoveContainer" containerID="178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec" Jul 23 18:38:10.370019 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.369992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" event={"ID":"dbbfc586-fed5-47c4-a6c5-8c06db48effa","Type":"ContainerStarted","Data":"21204fd789ba64f143a5ec6ef940b09a45acdbfb216c7d7ee6924c11d9ed26ee"} Jul 23 18:38:10.370135 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.370049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" event={"ID":"dbbfc586-fed5-47c4-a6c5-8c06db48effa","Type":"ContainerStarted","Data":"13239457a6c11e2c37d5672080b5f2479a2fe4ee72ced97430dcb6d19193ef57"} Jul 23 18:38:10.370135 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.370113 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:10.372251 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.372232 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" event={"ID":"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580","Type":"ContainerStarted","Data":"70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760"} Jul 23 18:38:10.372384 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.372273 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" event={"ID":"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580","Type":"ContainerStarted","Data":"d2ed787194ba5c5d8d5badaafb64a089aabc38e33b1341db09d373ecb89d8dd4"} Jul 23 18:38:10.372384 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.372317 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:10.373545 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.373527 2556 generic.go:356] "Generic (PLEG): container finished" podID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" containerID="155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6" exitCode=0 Jul 23 18:38:10.373634 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.373562 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dpgk" Jul 23 18:38:10.373634 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.373596 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:10.377551 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.377529 2556 scope.go:117] "RemoveContainer" containerID="178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec" Jul 23 18:38:10.377804 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:10.377781 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec\": container with ID starting with 178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec not found: ID does not exist" containerID="178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec" Jul 23 18:38:10.377877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.377811 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec"} err="failed to get container status \"178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec\": rpc error: code = NotFound desc = could not find container \"178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec\": container with ID starting with 178206a547dab8eeee79d144d3212567f9df3d8aa750a574159aa372efb7c9ec not found: ID does not exist" Jul 23 18:38:10.377877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.377827 2556 scope.go:117] "RemoveContainer" containerID="155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6" Jul 23 18:38:10.388027 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.388004 2556 scope.go:117] "RemoveContainer" containerID="155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6" Jul 23 18:38:10.388387 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:10.388342 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6\": container with ID starting with 155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6 not found: ID does not exist" containerID="155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6" Jul 23 18:38:10.388490 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.388388 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6"} err="failed to get container status \"155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6\": rpc error: code = NotFound desc = could not find container \"155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6\": container with ID starting with 155ca9325bdf8606fc6fbdb793d5527f962361b0a65121f94b3efae64bed29f6 not found: ID does not exist" Jul 23 18:38:10.421548 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.421490 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" podStartSLOduration=1.421473388 podStartE2EDuration="1.421473388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:38:10.419986646 +0000 UTC m=+462.484219376" watchObservedRunningTime="2026-07-23 18:38:10.421473388 +0000 UTC m=+462.485706117" Jul 23 18:38:10.457915 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:10.457867 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" podStartSLOduration=1.457851127 podStartE2EDuration="1.457851127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:38:10.45663672 +0000 UTC m=+462.520869448" watchObservedRunningTime="2026-07-23 18:38:10.457851127 +0000 UTC m=+462.522083855" Jul 23 18:38:10.459159 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:10.459123 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-frwfj\" is forbidden: User \"system:node:ip-10-0-134-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-87.ec2.internal' and this object" podUID="6284e71c-29bf-4477-a161-7a40d103bf63" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frwfj" Jul 23 18:38:21.381470 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.381435 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mt7fg" Jul 23 18:38:21.381938 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.381525 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:21.547976 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.547939 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb"] Jul 23 18:38:21.548169 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.548133 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" podUID="2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" containerName="manager" containerID="cri-o://70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760" gracePeriod=10 Jul 23 18:38:21.831588 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.831555 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:21.947750 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.947663 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-extensions-socket-volume\") pod \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " Jul 23 18:38:21.947750 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.947716 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rscz8\" (UniqueName: \"kubernetes.io/projected/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-kube-api-access-rscz8\") pod \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\" (UID: \"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580\") " Jul 23 18:38:21.948028 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.948006 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" (UID: "2b0d8cc3-e582-4ed0-99d9-a51bafe4d580"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:21.949967 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:21.949937 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-kube-api-access-rscz8" (OuterVolumeSpecName: "kube-api-access-rscz8") pod "2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" (UID: "2b0d8cc3-e582-4ed0-99d9-a51bafe4d580"). InnerVolumeSpecName "kube-api-access-rscz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:38:22.048484 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.048449 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-extensions-socket-volume\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:22.048484 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.048475 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rscz8\" (UniqueName: \"kubernetes.io/projected/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580-kube-api-access-rscz8\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:38:22.430248 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.430217 2556 generic.go:356] "Generic (PLEG): container finished" podID="2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" containerID="70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760" exitCode=0 Jul 23 18:38:22.430716 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.430261 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" Jul 23 18:38:22.430716 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.430306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" event={"ID":"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580","Type":"ContainerDied","Data":"70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760"} Jul 23 18:38:22.430716 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.430412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb" event={"ID":"2b0d8cc3-e582-4ed0-99d9-a51bafe4d580","Type":"ContainerDied","Data":"d2ed787194ba5c5d8d5badaafb64a089aabc38e33b1341db09d373ecb89d8dd4"} Jul 23 18:38:22.430716 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.430438 2556 scope.go:117] "RemoveContainer" containerID="70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760" Jul 23 18:38:22.439002 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.438985 2556 scope.go:117] "RemoveContainer" containerID="70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760" Jul 23 18:38:22.439305 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:38:22.439288 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760\": container with ID starting with 70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760 not found: ID does not exist" containerID="70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760" Jul 23 18:38:22.439356 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.439315 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760"} err="failed to get container status \"70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760\": rpc error: code = NotFound desc = could not find container \"70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760\": container with ID starting with 70f19bb63c63eda6e541e9e8fc8fabb1efa63c385f2fe5d4e8c07ec4312a8760 not found: ID does not exist" Jul 23 18:38:22.476468 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.476426 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb"] Jul 23 18:38:22.495723 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:22.495689 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qnkcb"] Jul 23 18:38:24.356535 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:24.356500 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" path="/var/lib/kubelet/pods/2b0d8cc3-e582-4ed0-99d9-a51bafe4d580/volumes" Jul 23 18:38:40.329290 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329255 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:38:40.329684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329582 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" containerName="manager" Jul 23 18:38:40.329684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329593 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" containerName="manager" Jul 23 18:38:40.329684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329618 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" containerName="manager" Jul 23 18:38:40.329684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329624 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" containerName="manager" Jul 23 18:38:40.329684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329676 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1bbf104-6b25-4ceb-8fb8-f645a5fce630" containerName="manager" Jul 23 18:38:40.329684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.329683 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0d8cc3-e582-4ed0-99d9-a51bafe4d580" containerName="manager" Jul 23 18:38:40.333523 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.333505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.340037 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.339833 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 18:38:40.340037 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.339977 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kvqqb\"" Jul 23 18:38:40.364767 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.364734 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:38:40.396011 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.395972 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btqz\" (UniqueName: \"kubernetes.io/projected/3e916207-30fa-48fd-98ad-e3c90dab11a3-kube-api-access-6btqz\") pod \"limitador-limitador-64c94fd64f-z5qp7\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.396165 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.396064 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e916207-30fa-48fd-98ad-e3c90dab11a3-config-file\") pod \"limitador-limitador-64c94fd64f-z5qp7\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.448071 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.448037 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:38:40.497506 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.497470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6btqz\" (UniqueName: \"kubernetes.io/projected/3e916207-30fa-48fd-98ad-e3c90dab11a3-kube-api-access-6btqz\") pod \"limitador-limitador-64c94fd64f-z5qp7\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.497714 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.497521 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e916207-30fa-48fd-98ad-e3c90dab11a3-config-file\") pod \"limitador-limitador-64c94fd64f-z5qp7\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.498152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.498133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e916207-30fa-48fd-98ad-e3c90dab11a3-config-file\") pod \"limitador-limitador-64c94fd64f-z5qp7\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.515066 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.515040 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btqz\" (UniqueName: \"kubernetes.io/projected/3e916207-30fa-48fd-98ad-e3c90dab11a3-kube-api-access-6btqz\") pod \"limitador-limitador-64c94fd64f-z5qp7\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.643408 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.643293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:40.817937 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:40.817902 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:38:40.821103 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:38:40.821068 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e916207_30fa_48fd_98ad_e3c90dab11a3.slice/crio-aa8414afea46ef1b2356a34434af712e52886b822fd59370b0ccf26fa4f75622 WatchSource:0}: Error finding container aa8414afea46ef1b2356a34434af712e52886b822fd59370b0ccf26fa4f75622: Status 404 returned error can't find the container with id aa8414afea46ef1b2356a34434af712e52886b822fd59370b0ccf26fa4f75622 Jul 23 18:38:41.519077 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:41.518994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" event={"ID":"3e916207-30fa-48fd-98ad-e3c90dab11a3","Type":"ContainerStarted","Data":"aa8414afea46ef1b2356a34434af712e52886b822fd59370b0ccf26fa4f75622"} Jul 23 18:38:44.534128 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:44.534091 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" event={"ID":"3e916207-30fa-48fd-98ad-e3c90dab11a3","Type":"ContainerStarted","Data":"0bd067dff2366fda75664f25ddd13c749c9e37bd0bf79218c9b14da3804d4829"} Jul 23 18:38:44.534538 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:44.534214 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:44.583567 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:44.583512 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" podStartSLOduration=1.880657201 podStartE2EDuration="4.583493197s" totalImagesPullingTime="2.702835996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:38:44.583077244 +0000 UTC m=+496.647309974" watchObservedRunningTime="2026-07-23 18:38:44.583493197 +0000 UTC m=+496.647725935" Jul 23 18:38:55.541349 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:55.541316 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:38:59.081597 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:59.081567 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:38:59.082078 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:59.081746 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" podUID="3e916207-30fa-48fd-98ad-e3c90dab11a3" containerName="limitador" containerID="cri-o://0bd067dff2366fda75664f25ddd13c749c9e37bd0bf79218c9b14da3804d4829" gracePeriod=30 Jul 23 18:38:59.601257 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:59.601225 2556 generic.go:356] "Generic (PLEG): container finished" podID="3e916207-30fa-48fd-98ad-e3c90dab11a3" containerID="0bd067dff2366fda75664f25ddd13c749c9e37bd0bf79218c9b14da3804d4829" exitCode=0 Jul 23 18:38:59.601445 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:38:59.601290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" event={"ID":"3e916207-30fa-48fd-98ad-e3c90dab11a3","Type":"ContainerDied","Data":"0bd067dff2366fda75664f25ddd13c749c9e37bd0bf79218c9b14da3804d4829"} Jul 23 18:39:00.019575 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.019551 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:39:00.167955 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.167926 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6btqz\" (UniqueName: \"kubernetes.io/projected/3e916207-30fa-48fd-98ad-e3c90dab11a3-kube-api-access-6btqz\") pod \"3e916207-30fa-48fd-98ad-e3c90dab11a3\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " Jul 23 18:39:00.168468 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.167974 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e916207-30fa-48fd-98ad-e3c90dab11a3-config-file\") pod \"3e916207-30fa-48fd-98ad-e3c90dab11a3\" (UID: \"3e916207-30fa-48fd-98ad-e3c90dab11a3\") " Jul 23 18:39:00.168468 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.168433 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e916207-30fa-48fd-98ad-e3c90dab11a3-config-file" (OuterVolumeSpecName: "config-file") pod "3e916207-30fa-48fd-98ad-e3c90dab11a3" (UID: "3e916207-30fa-48fd-98ad-e3c90dab11a3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:39:00.170122 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.170096 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e916207-30fa-48fd-98ad-e3c90dab11a3-kube-api-access-6btqz" (OuterVolumeSpecName: "kube-api-access-6btqz") pod "3e916207-30fa-48fd-98ad-e3c90dab11a3" (UID: "3e916207-30fa-48fd-98ad-e3c90dab11a3"). InnerVolumeSpecName "kube-api-access-6btqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:39:00.268821 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.268783 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6btqz\" (UniqueName: \"kubernetes.io/projected/3e916207-30fa-48fd-98ad-e3c90dab11a3-kube-api-access-6btqz\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:39:00.268821 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.268816 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e916207-30fa-48fd-98ad-e3c90dab11a3-config-file\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:39:00.607347 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.607265 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" event={"ID":"3e916207-30fa-48fd-98ad-e3c90dab11a3","Type":"ContainerDied","Data":"aa8414afea46ef1b2356a34434af712e52886b822fd59370b0ccf26fa4f75622"} Jul 23 18:39:00.607347 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.607298 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z5qp7" Jul 23 18:39:00.607569 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.607351 2556 scope.go:117] "RemoveContainer" containerID="0bd067dff2366fda75664f25ddd13c749c9e37bd0bf79218c9b14da3804d4829" Jul 23 18:39:00.636726 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.636691 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:39:00.645842 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:00.645813 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z5qp7"] Jul 23 18:39:02.219260 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.219224 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4"] Jul 23 18:39:02.219692 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.219575 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e916207-30fa-48fd-98ad-e3c90dab11a3" containerName="limitador" Jul 23 18:39:02.219692 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.219587 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e916207-30fa-48fd-98ad-e3c90dab11a3" containerName="limitador" Jul 23 18:39:02.219692 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.219646 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e916207-30fa-48fd-98ad-e3c90dab11a3" containerName="limitador" Jul 23 18:39:02.223092 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.223077 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.249074 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.249048 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 18:39:02.250071 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.250054 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 18:39:02.250332 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.250312 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vnd7r\"" Jul 23 18:39:02.251899 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.251883 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 18:39:02.261516 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.261489 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4"] Jul 23 18:39:02.286100 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.286067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgxw\" (UniqueName: \"kubernetes.io/projected/caea40d5-2edc-47ce-b9b9-82c847ef567b-kube-api-access-sxgxw\") pod \"postgres-69fb4594cf-rmzl4\" (UID: \"caea40d5-2edc-47ce-b9b9-82c847ef567b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.286240 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.286122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/caea40d5-2edc-47ce-b9b9-82c847ef567b-data\") pod \"postgres-69fb4594cf-rmzl4\" (UID: \"caea40d5-2edc-47ce-b9b9-82c847ef567b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.357437 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.357393 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e916207-30fa-48fd-98ad-e3c90dab11a3" path="/var/lib/kubelet/pods/3e916207-30fa-48fd-98ad-e3c90dab11a3/volumes" Jul 23 18:39:02.387355 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.387330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/caea40d5-2edc-47ce-b9b9-82c847ef567b-data\") pod \"postgres-69fb4594cf-rmzl4\" (UID: \"caea40d5-2edc-47ce-b9b9-82c847ef567b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.387488 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.387417 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgxw\" (UniqueName: \"kubernetes.io/projected/caea40d5-2edc-47ce-b9b9-82c847ef567b-kube-api-access-sxgxw\") pod \"postgres-69fb4594cf-rmzl4\" (UID: \"caea40d5-2edc-47ce-b9b9-82c847ef567b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.387712 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.387680 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/caea40d5-2edc-47ce-b9b9-82c847ef567b-data\") pod \"postgres-69fb4594cf-rmzl4\" (UID: \"caea40d5-2edc-47ce-b9b9-82c847ef567b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.400697 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.400662 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgxw\" (UniqueName: \"kubernetes.io/projected/caea40d5-2edc-47ce-b9b9-82c847ef567b-kube-api-access-sxgxw\") pod \"postgres-69fb4594cf-rmzl4\" (UID: \"caea40d5-2edc-47ce-b9b9-82c847ef567b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.532274 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.532194 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:02.712138 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:02.712098 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4"] Jul 23 18:39:02.717128 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:39:02.717103 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaea40d5_2edc_47ce_b9b9_82c847ef567b.slice/crio-9555da3b16a58c95ad52f02283f38b992004b67b018fca62979b3152efbc1173 WatchSource:0}: Error finding container 9555da3b16a58c95ad52f02283f38b992004b67b018fca62979b3152efbc1173: Status 404 returned error can't find the container with id 9555da3b16a58c95ad52f02283f38b992004b67b018fca62979b3152efbc1173 Jul 23 18:39:03.625000 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:03.624966 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" event={"ID":"caea40d5-2edc-47ce-b9b9-82c847ef567b","Type":"ContainerStarted","Data":"9555da3b16a58c95ad52f02283f38b992004b67b018fca62979b3152efbc1173"} Jul 23 18:39:08.651271 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:08.651233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" event={"ID":"caea40d5-2edc-47ce-b9b9-82c847ef567b","Type":"ContainerStarted","Data":"d6e99ba0ffb398fbd4c4e1fd55b2490bd8a6710c3488cfefcac000df2deb0f3c"} Jul 23 18:39:08.651667 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:08.651376 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:08.686776 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:08.686726 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" podStartSLOduration=1.327636477 podStartE2EDuration="6.686711455s" totalImagesPullingTime="5.359074978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:08.686204982 +0000 UTC m=+520.750437712" watchObservedRunningTime="2026-07-23 18:39:08.686711455 +0000 UTC m=+520.750944184" Jul 23 18:39:14.685456 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:14.685426 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rmzl4" Jul 23 18:39:23.096923 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.096833 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-799569cd8f-zb2jn"] Jul 23 18:39:23.100348 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.100326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.105698 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.105667 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 18:39:23.105893 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.105739 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t62g2\"" Jul 23 18:39:23.105893 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.105739 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 18:39:23.145158 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.145124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-799569cd8f-zb2jn"] Jul 23 18:39:23.271090 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.271059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a64ba277-3736-4d6e-af95-6dca0d7157ae-webhook-cert\") pod \"maas-controller-799569cd8f-zb2jn\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.271270 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.271099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fbfg\" (UniqueName: \"kubernetes.io/projected/a64ba277-3736-4d6e-af95-6dca0d7157ae-kube-api-access-6fbfg\") pod \"maas-controller-799569cd8f-zb2jn\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.371815 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.371731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a64ba277-3736-4d6e-af95-6dca0d7157ae-webhook-cert\") pod \"maas-controller-799569cd8f-zb2jn\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.371815 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.371773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fbfg\" (UniqueName: \"kubernetes.io/projected/a64ba277-3736-4d6e-af95-6dca0d7157ae-kube-api-access-6fbfg\") pod \"maas-controller-799569cd8f-zb2jn\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.374339 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.374307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a64ba277-3736-4d6e-af95-6dca0d7157ae-webhook-cert\") pod \"maas-controller-799569cd8f-zb2jn\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.397990 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.397958 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fbfg\" (UniqueName: \"kubernetes.io/projected/a64ba277-3736-4d6e-af95-6dca0d7157ae-kube-api-access-6fbfg\") pod \"maas-controller-799569cd8f-zb2jn\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.410827 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.410797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:23.450887 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.450848 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77c46fd484-cnlfp"] Jul 23 18:39:23.454783 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.454760 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.483318 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.483281 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c46fd484-cnlfp"] Jul 23 18:39:23.555511 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.555482 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-799569cd8f-zb2jn"] Jul 23 18:39:23.557730 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:39:23.557696 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64ba277_3736_4d6e_af95_6dca0d7157ae.slice/crio-e0a22b2f8382340c7bea5309c9425faa42c721a07849e0c221b5a78884bc5852 WatchSource:0}: Error finding container e0a22b2f8382340c7bea5309c9425faa42c721a07849e0c221b5a78884bc5852: Status 404 returned error can't find the container with id e0a22b2f8382340c7bea5309c9425faa42c721a07849e0c221b5a78884bc5852 Jul 23 18:39:23.577750 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.577719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d0d793a-2f9d-4b6f-9444-40465c2d847c-webhook-cert\") pod \"maas-controller-77c46fd484-cnlfp\" (UID: \"4d0d793a-2f9d-4b6f-9444-40465c2d847c\") " pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.577883 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.577776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4czt\" (UniqueName: \"kubernetes.io/projected/4d0d793a-2f9d-4b6f-9444-40465c2d847c-kube-api-access-g4czt\") pod \"maas-controller-77c46fd484-cnlfp\" (UID: \"4d0d793a-2f9d-4b6f-9444-40465c2d847c\") " pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.678600 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.678560 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d0d793a-2f9d-4b6f-9444-40465c2d847c-webhook-cert\") pod \"maas-controller-77c46fd484-cnlfp\" (UID: \"4d0d793a-2f9d-4b6f-9444-40465c2d847c\") " pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.678765 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.678631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4czt\" (UniqueName: \"kubernetes.io/projected/4d0d793a-2f9d-4b6f-9444-40465c2d847c-kube-api-access-g4czt\") pod \"maas-controller-77c46fd484-cnlfp\" (UID: \"4d0d793a-2f9d-4b6f-9444-40465c2d847c\") " pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.681191 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.681162 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d0d793a-2f9d-4b6f-9444-40465c2d847c-webhook-cert\") pod \"maas-controller-77c46fd484-cnlfp\" (UID: \"4d0d793a-2f9d-4b6f-9444-40465c2d847c\") " pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.689590 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.689567 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4czt\" (UniqueName: \"kubernetes.io/projected/4d0d793a-2f9d-4b6f-9444-40465c2d847c-kube-api-access-g4czt\") pod \"maas-controller-77c46fd484-cnlfp\" (UID: \"4d0d793a-2f9d-4b6f-9444-40465c2d847c\") " pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.715193 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.715158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799569cd8f-zb2jn" event={"ID":"a64ba277-3736-4d6e-af95-6dca0d7157ae","Type":"ContainerStarted","Data":"e0a22b2f8382340c7bea5309c9425faa42c721a07849e0c221b5a78884bc5852"} Jul 23 18:39:23.768495 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.768455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:23.904026 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:23.903995 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c46fd484-cnlfp"] Jul 23 18:39:23.906972 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:39:23.906944 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0d793a_2f9d_4b6f_9444_40465c2d847c.slice/crio-0861c92e669017add6b40d0d6bf794ca5295ac90aa5d8a7eaccfce2baa1c6469 WatchSource:0}: Error finding container 0861c92e669017add6b40d0d6bf794ca5295ac90aa5d8a7eaccfce2baa1c6469: Status 404 returned error can't find the container with id 0861c92e669017add6b40d0d6bf794ca5295ac90aa5d8a7eaccfce2baa1c6469 Jul 23 18:39:24.726528 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:24.726488 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c46fd484-cnlfp" event={"ID":"4d0d793a-2f9d-4b6f-9444-40465c2d847c","Type":"ContainerStarted","Data":"0861c92e669017add6b40d0d6bf794ca5295ac90aa5d8a7eaccfce2baa1c6469"} Jul 23 18:39:26.737140 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:26.737096 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799569cd8f-zb2jn" event={"ID":"a64ba277-3736-4d6e-af95-6dca0d7157ae","Type":"ContainerStarted","Data":"39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49"} Jul 23 18:39:26.737728 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:26.737164 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:26.738579 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:26.738551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c46fd484-cnlfp" event={"ID":"4d0d793a-2f9d-4b6f-9444-40465c2d847c","Type":"ContainerStarted","Data":"205e4872943e29e1c922fd60daf71d2e2a6cdef0243f5b49fd750dcf0d7a92c8"} Jul 23 18:39:26.738686 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:26.738613 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:26.761969 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:26.761926 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-799569cd8f-zb2jn" podStartSLOduration=1.184448471 podStartE2EDuration="3.761910647s" totalImagesPullingTime="2.577462176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:26.760394841 +0000 UTC m=+538.824627571" watchObservedRunningTime="2026-07-23 18:39:26.761910647 +0000 UTC m=+538.826143375" Jul 23 18:39:26.787462 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:26.787408 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77c46fd484-cnlfp" podStartSLOduration=1.551727025 podStartE2EDuration="3.787390202s" totalImagesPullingTime="2.235663177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:26.785863673 +0000 UTC m=+538.850096407" watchObservedRunningTime="2026-07-23 18:39:26.787390202 +0000 UTC m=+538.851622928" Jul 23 18:39:37.744715 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:37.744685 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:37.745143 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:37.744754 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77c46fd484-cnlfp" Jul 23 18:39:37.822535 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:37.822497 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-799569cd8f-zb2jn"] Jul 23 18:39:37.822740 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:37.822715 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-799569cd8f-zb2jn" podUID="a64ba277-3736-4d6e-af95-6dca0d7157ae" containerName="manager" containerID="cri-o://39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49" gracePeriod=30 Jul 23 18:39:38.080691 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.080661 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:38.204173 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.204139 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a64ba277-3736-4d6e-af95-6dca0d7157ae-webhook-cert\") pod \"a64ba277-3736-4d6e-af95-6dca0d7157ae\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " Jul 23 18:39:38.204356 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.204250 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fbfg\" (UniqueName: \"kubernetes.io/projected/a64ba277-3736-4d6e-af95-6dca0d7157ae-kube-api-access-6fbfg\") pod \"a64ba277-3736-4d6e-af95-6dca0d7157ae\" (UID: \"a64ba277-3736-4d6e-af95-6dca0d7157ae\") " Jul 23 18:39:38.206483 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.206450 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a64ba277-3736-4d6e-af95-6dca0d7157ae-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a64ba277-3736-4d6e-af95-6dca0d7157ae" (UID: "a64ba277-3736-4d6e-af95-6dca0d7157ae"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:39:38.206595 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.206507 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64ba277-3736-4d6e-af95-6dca0d7157ae-kube-api-access-6fbfg" (OuterVolumeSpecName: "kube-api-access-6fbfg") pod "a64ba277-3736-4d6e-af95-6dca0d7157ae" (UID: "a64ba277-3736-4d6e-af95-6dca0d7157ae"). InnerVolumeSpecName "kube-api-access-6fbfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:39:38.305624 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.305534 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fbfg\" (UniqueName: \"kubernetes.io/projected/a64ba277-3736-4d6e-af95-6dca0d7157ae-kube-api-access-6fbfg\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:39:38.305624 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.305565 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a64ba277-3736-4d6e-af95-6dca0d7157ae-webhook-cert\") on node \"ip-10-0-134-87.ec2.internal\" DevicePath \"\"" Jul 23 18:39:38.789076 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.789043 2556 generic.go:356] "Generic (PLEG): container finished" podID="a64ba277-3736-4d6e-af95-6dca0d7157ae" containerID="39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49" exitCode=0 Jul 23 18:39:38.789580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.789088 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799569cd8f-zb2jn" Jul 23 18:39:38.789580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.789123 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799569cd8f-zb2jn" event={"ID":"a64ba277-3736-4d6e-af95-6dca0d7157ae","Type":"ContainerDied","Data":"39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49"} Jul 23 18:39:38.789580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.789193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799569cd8f-zb2jn" event={"ID":"a64ba277-3736-4d6e-af95-6dca0d7157ae","Type":"ContainerDied","Data":"e0a22b2f8382340c7bea5309c9425faa42c721a07849e0c221b5a78884bc5852"} Jul 23 18:39:38.789580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.789228 2556 scope.go:117] "RemoveContainer" containerID="39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49" Jul 23 18:39:38.797492 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.797472 2556 scope.go:117] "RemoveContainer" containerID="39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49" Jul 23 18:39:38.797743 ip-10-0-134-87 kubenswrapper[2556]: E0723 18:39:38.797725 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49\": container with ID starting with 39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49 not found: ID does not exist" containerID="39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49" Jul 23 18:39:38.797800 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.797782 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49"} err="failed to get container status \"39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49\": rpc error: code = NotFound desc = could not find container \"39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49\": container with ID starting with 39066c7ae3ab23c47338608040ec0dabe800790ae92dbcf08e0495d525f79f49 not found: ID does not exist" Jul 23 18:39:38.811610 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.811586 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-799569cd8f-zb2jn"] Jul 23 18:39:38.817186 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:38.817157 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-799569cd8f-zb2jn"] Jul 23 18:39:40.356260 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:40.356226 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a64ba277-3736-4d6e-af95-6dca0d7157ae" path="/var/lib/kubelet/pods/a64ba277-3736-4d6e-af95-6dca0d7157ae/volumes" Jul 23 18:39:59.645835 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.645803 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f"] Jul 23 18:39:59.646295 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.646240 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64ba277-3736-4d6e-af95-6dca0d7157ae" containerName="manager" Jul 23 18:39:59.646295 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.646259 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64ba277-3736-4d6e-af95-6dca0d7157ae" containerName="manager" Jul 23 18:39:59.646394 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.646355 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64ba277-3736-4d6e-af95-6dca0d7157ae" containerName="manager" Jul 23 18:39:59.652703 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.652680 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.656704 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.656676 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 23 18:39:59.665561 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.665353 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f"] Jul 23 18:39:59.793040 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.793006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a46b525-4163-405f-b516-9cecb312cbb5-maas-api-tls\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.793249 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.793068 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a46b525-4163-405f-b516-9cecb312cbb5-openshift-service-ca\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.793249 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.793141 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghwj\" (UniqueName: \"kubernetes.io/projected/0a46b525-4163-405f-b516-9cecb312cbb5-kube-api-access-rghwj\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.894426 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.894387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a46b525-4163-405f-b516-9cecb312cbb5-openshift-service-ca\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.894426 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.894426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rghwj\" (UniqueName: \"kubernetes.io/projected/0a46b525-4163-405f-b516-9cecb312cbb5-kube-api-access-rghwj\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.894629 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.894500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a46b525-4163-405f-b516-9cecb312cbb5-maas-api-tls\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.895243 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.895226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a46b525-4163-405f-b516-9cecb312cbb5-openshift-service-ca\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.897111 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.897049 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a46b525-4163-405f-b516-9cecb312cbb5-maas-api-tls\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.903252 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.903225 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghwj\" (UniqueName: \"kubernetes.io/projected/0a46b525-4163-405f-b516-9cecb312cbb5-kube-api-access-rghwj\") pod \"maas-api-7b4cb74697-hfv9f\" (UID: \"0a46b525-4163-405f-b516-9cecb312cbb5\") " pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:39:59.962829 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:39:59.962795 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:40:00.101024 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.100998 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f"] Jul 23 18:40:00.103324 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:40:00.103298 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a46b525_4163_405f_b516_9cecb312cbb5.slice/crio-d707d625328bc53c8e9208b7b3cfeed516e7314ae9080a45b450414dd7c4fdef WatchSource:0}: Error finding container d707d625328bc53c8e9208b7b3cfeed516e7314ae9080a45b450414dd7c4fdef: Status 404 returned error can't find the container with id d707d625328bc53c8e9208b7b3cfeed516e7314ae9080a45b450414dd7c4fdef Jul 23 18:40:00.221943 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.221903 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv"] Jul 23 18:40:00.226517 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.226497 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.229720 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.229658 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dbwtx\"" Jul 23 18:40:00.229720 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.229677 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 23 18:40:00.238741 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.238714 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv"] Jul 23 18:40:00.245765 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.245734 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-2rjgg"] Jul 23 18:40:00.249152 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.249127 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.266285 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.266255 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-2rjgg"] Jul 23 18:40:00.297922 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.297882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7lv\" (UniqueName: \"kubernetes.io/projected/10b40015-4a2d-4091-9233-ad9a79cee4a3-kube-api-access-sp7lv\") pod \"payload-pre-processing-687dbb6cf6-7tqxv\" (UID: \"10b40015-4a2d-4091-9233-ad9a79cee4a3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.298078 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.297938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b40015-4a2d-4091-9233-ad9a79cee4a3-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7tqxv\" (UID: \"10b40015-4a2d-4091-9233-ad9a79cee4a3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.399212 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.399172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b40015-4a2d-4091-9233-ad9a79cee4a3-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7tqxv\" (UID: \"10b40015-4a2d-4091-9233-ad9a79cee4a3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.399406 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.399234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/721d9497-dc28-460c-ae8a-ced1df4b836b-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-2rjgg\" (UID: \"721d9497-dc28-460c-ae8a-ced1df4b836b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.399406 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.399280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7lv\" (UniqueName: \"kubernetes.io/projected/10b40015-4a2d-4091-9233-ad9a79cee4a3-kube-api-access-sp7lv\") pod \"payload-pre-processing-687dbb6cf6-7tqxv\" (UID: \"10b40015-4a2d-4091-9233-ad9a79cee4a3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.399406 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.399297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnv8\" (UniqueName: \"kubernetes.io/projected/721d9497-dc28-460c-ae8a-ced1df4b836b-kube-api-access-jcnv8\") pod \"payload-processing-5cc6cd444b-2rjgg\" (UID: \"721d9497-dc28-460c-ae8a-ced1df4b836b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.400086 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.400059 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b40015-4a2d-4091-9233-ad9a79cee4a3-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7tqxv\" (UID: \"10b40015-4a2d-4091-9233-ad9a79cee4a3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.408154 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.408129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7lv\" (UniqueName: \"kubernetes.io/projected/10b40015-4a2d-4091-9233-ad9a79cee4a3-kube-api-access-sp7lv\") pod \"payload-pre-processing-687dbb6cf6-7tqxv\" (UID: \"10b40015-4a2d-4091-9233-ad9a79cee4a3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.500477 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.500391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/721d9497-dc28-460c-ae8a-ced1df4b836b-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-2rjgg\" (UID: \"721d9497-dc28-460c-ae8a-ced1df4b836b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.500477 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.500455 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnv8\" (UniqueName: \"kubernetes.io/projected/721d9497-dc28-460c-ae8a-ced1df4b836b-kube-api-access-jcnv8\") pod \"payload-processing-5cc6cd444b-2rjgg\" (UID: \"721d9497-dc28-460c-ae8a-ced1df4b836b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.501379 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.501341 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/721d9497-dc28-460c-ae8a-ced1df4b836b-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-2rjgg\" (UID: \"721d9497-dc28-460c-ae8a-ced1df4b836b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.509846 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.509816 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnv8\" (UniqueName: \"kubernetes.io/projected/721d9497-dc28-460c-ae8a-ced1df4b836b-kube-api-access-jcnv8\") pod \"payload-processing-5cc6cd444b-2rjgg\" (UID: \"721d9497-dc28-460c-ae8a-ced1df4b836b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.537828 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.537792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:00.563741 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.563710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:00.690821 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.690714 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv"] Jul 23 18:40:00.694114 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:40:00.694071 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b40015_4a2d_4091_9233_ad9a79cee4a3.slice/crio-10f64c41aebabeaa03cf6a79f14470c6565c5cd11727e686cb6ee9578e27ce78 WatchSource:0}: Error finding container 10f64c41aebabeaa03cf6a79f14470c6565c5cd11727e686cb6ee9578e27ce78: Status 404 returned error can't find the container with id 10f64c41aebabeaa03cf6a79f14470c6565c5cd11727e686cb6ee9578e27ce78 Jul 23 18:40:00.721330 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.721300 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-2rjgg"] Jul 23 18:40:00.723526 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:40:00.723493 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721d9497_dc28_460c_ae8a_ced1df4b836b.slice/crio-3529d0412246ed7a06faeadf4a84047f9fbe832f933ad8b81c6e0cc14e9138d8 WatchSource:0}: Error finding container 3529d0412246ed7a06faeadf4a84047f9fbe832f933ad8b81c6e0cc14e9138d8: Status 404 returned error can't find the container with id 3529d0412246ed7a06faeadf4a84047f9fbe832f933ad8b81c6e0cc14e9138d8 Jul 23 18:40:00.887877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.887779 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" event={"ID":"10b40015-4a2d-4091-9233-ad9a79cee4a3","Type":"ContainerStarted","Data":"10f64c41aebabeaa03cf6a79f14470c6565c5cd11727e686cb6ee9578e27ce78"} Jul 23 18:40:00.889047 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.889022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" event={"ID":"0a46b525-4163-405f-b516-9cecb312cbb5","Type":"ContainerStarted","Data":"d707d625328bc53c8e9208b7b3cfeed516e7314ae9080a45b450414dd7c4fdef"} Jul 23 18:40:00.890381 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:00.890342 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" event={"ID":"721d9497-dc28-460c-ae8a-ced1df4b836b","Type":"ContainerStarted","Data":"3529d0412246ed7a06faeadf4a84047f9fbe832f933ad8b81c6e0cc14e9138d8"} Jul 23 18:40:01.899982 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:01.899835 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" event={"ID":"0a46b525-4163-405f-b516-9cecb312cbb5","Type":"ContainerStarted","Data":"1be258a57ccc9b52ade6b9737220a5ecd484140576377fe203b6720f19c8eaef"} Jul 23 18:40:01.900497 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:01.900079 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:40:01.935568 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:01.934412 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" podStartSLOduration=1.332070768 podStartE2EDuration="2.934388747s" totalImagesPullingTime="1.602317979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:01.934047496 +0000 UTC m=+573.998280228" watchObservedRunningTime="2026-07-23 18:40:01.934388747 +0000 UTC m=+573.998621476" Jul 23 18:40:03.910684 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:03.910642 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" event={"ID":"10b40015-4a2d-4091-9233-ad9a79cee4a3","Type":"ContainerStarted","Data":"b69bd5f5b099a95f3bfe59e8885059fa2f740e0d4580d9eaf84adada3aa197ad"} Jul 23 18:40:03.911122 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:03.910712 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:03.912031 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:03.912006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" event={"ID":"721d9497-dc28-460c-ae8a-ced1df4b836b","Type":"ContainerStarted","Data":"1ded9417eaa12e5a88036bfd7a4f4d6cbecdf36599be26a5f65617bc0909853e"} Jul 23 18:40:03.912117 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:03.912101 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:03.928047 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:03.928001 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" podStartSLOduration=1.523112233 podStartE2EDuration="3.927983912s" totalImagesPullingTime="2.404871679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:03.92703443 +0000 UTC m=+575.991267162" watchObservedRunningTime="2026-07-23 18:40:03.927983912 +0000 UTC m=+575.992216640" Jul 23 18:40:03.944418 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:03.944347 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" podStartSLOduration=1.562979208 podStartE2EDuration="3.944328673s" totalImagesPullingTime="2.381349465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:03.942832801 +0000 UTC m=+576.007065548" watchObservedRunningTime="2026-07-23 18:40:03.944328673 +0000 UTC m=+576.008561402" Jul 23 18:40:07.910174 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:07.910146 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b4cb74697-hfv9f" Jul 23 18:40:14.918490 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:14.918453 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7tqxv" Jul 23 18:40:14.918880 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:14.918548 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-2rjgg" Jul 23 18:40:17.704598 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.704553 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7"] Jul 23 18:40:17.708104 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.708088 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.717154 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.717128 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 18:40:17.717316 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.717274 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m5z8w\"" Jul 23 18:40:17.718057 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.718036 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 18:40:17.718448 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.718434 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 23 18:40:17.743325 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.743291 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7"] Jul 23 18:40:17.757481 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.757444 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.757618 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.757485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.757618 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.757522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.757618 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.757605 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.757735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.757637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.757735 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.757675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbmf\" (UniqueName: \"kubernetes.io/projected/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-kube-api-access-4dbmf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858440 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858440 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858693 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbmf\" (UniqueName: \"kubernetes.io/projected/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-kube-api-access-4dbmf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858693 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858693 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858693 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.858921 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.859067 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.858910 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.859067 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.859025 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.860904 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.860873 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.861285 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.861268 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:17.869949 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:17.869924 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbmf\" (UniqueName: \"kubernetes.io/projected/4ab8ef0f-6783-40af-8de1-cd2d7eaa4866-kube-api-access-4dbmf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7\" (UID: \"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:18.019702 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:18.019607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:18.166753 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:18.166649 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7"] Jul 23 18:40:18.169322 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:40:18.169287 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab8ef0f_6783_40af_8de1_cd2d7eaa4866.slice/crio-5459baf4d083c34309eefab9c6d05167c00bf7f75d0e6e3470449a6e72365324 WatchSource:0}: Error finding container 5459baf4d083c34309eefab9c6d05167c00bf7f75d0e6e3470449a6e72365324: Status 404 returned error can't find the container with id 5459baf4d083c34309eefab9c6d05167c00bf7f75d0e6e3470449a6e72365324 Jul 23 18:40:18.984208 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:18.984168 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" event={"ID":"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866","Type":"ContainerStarted","Data":"5459baf4d083c34309eefab9c6d05167c00bf7f75d0e6e3470449a6e72365324"} Jul 23 18:40:19.990414 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:19.990353 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" event={"ID":"4ab8ef0f-6783-40af-8de1-cd2d7eaa4866","Type":"ContainerStarted","Data":"283a637afcbc61e72a140453778a79548c48bc79e3d1567533177b3eb7218b4f"} Jul 23 18:40:20.037337 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:20.037284 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" podStartSLOduration=1.874149077 podStartE2EDuration="3.037267486s" totalImagesPullingTime="1.163118409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:20.034863834 +0000 UTC m=+592.099096575" watchObservedRunningTime="2026-07-23 18:40:20.037267486 +0000 UTC m=+592.101500224" Jul 23 18:40:28.020517 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:28.020480 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:28.021013 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:28.020546 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:28.033725 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:28.033694 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:28.271091 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:28.271022 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:40:28.271091 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:28.271084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4snzp_372ecdff-679d-403a-b95a-4780b82538dd/ovn-acl-logging/0.log" Jul 23 18:40:29.040721 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:29.040687 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7" Jul 23 18:40:43.532655 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.532618 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd"] Jul 23 18:40:43.538158 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.538138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.543958 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.543933 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 23 18:40:43.550995 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.550964 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd"] Jul 23 18:40:43.693276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.692951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.693276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.693118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.693276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.693157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.693276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.693198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.693276 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.693228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458z9\" (UniqueName: \"kubernetes.io/projected/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-kube-api-access-458z9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.693698 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.693296 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.793880 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.793795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.793880 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.793857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794065 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.793976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794065 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.794035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794129 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.794064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458z9\" (UniqueName: \"kubernetes.io/projected/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-kube-api-access-458z9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794129 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.794093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794337 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.794320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794506 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.794486 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.794506 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.794497 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.796304 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.796285 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.796524 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.796506 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.802995 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.802965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-458z9\" (UniqueName: \"kubernetes.io/projected/fbab5e0f-a448-4167-ac1d-6b4f180e1ae5-kube-api-access-458z9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bdwfd\" (UID: \"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.850034 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.849998 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:43.993468 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:43.993442 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd"] Jul 23 18:40:43.996122 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:40:43.996085 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbab5e0f_a448_4167_ac1d_6b4f180e1ae5.slice/crio-4761158e9a18b0789b7e896773d866728fb300d34c4d8afbc5234cbce6219641 WatchSource:0}: Error finding container 4761158e9a18b0789b7e896773d866728fb300d34c4d8afbc5234cbce6219641: Status 404 returned error can't find the container with id 4761158e9a18b0789b7e896773d866728fb300d34c4d8afbc5234cbce6219641 Jul 23 18:40:44.100913 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:44.100826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" event={"ID":"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5","Type":"ContainerStarted","Data":"4761158e9a18b0789b7e896773d866728fb300d34c4d8afbc5234cbce6219641"} Jul 23 18:40:45.107158 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:45.107123 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" event={"ID":"fbab5e0f-a448-4167-ac1d-6b4f180e1ae5","Type":"ContainerStarted","Data":"ee7c4cf4ea77e70a0ddb43f34d4971ecdb26d8675609fbae831473d306770268"} Jul 23 18:40:45.152906 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:45.152847 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" podStartSLOduration=1.942903015 podStartE2EDuration="2.152828289s" totalImagesPullingTime="209.925274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:45.150668212 +0000 UTC m=+617.214900941" watchObservedRunningTime="2026-07-23 18:40:45.152828289 +0000 UTC m=+617.217061018" Jul 23 18:40:53.850974 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:53.850939 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:53.853429 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:53.851001 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:53.863905 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:53.863880 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:40:54.160843 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:40:54.160816 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bdwfd" Jul 23 18:43:16.149855 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:16.149816 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bw92v_fa27e478-5a51-41ef-be5f-379206803751/manager/0.log" Jul 23 18:43:16.270889 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:16.270859 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kqxv2_c218553d-9182-417c-90d3-657119af5698/manager/0.log" Jul 23 18:43:16.403930 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:16.403857 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77c46fd484-cnlfp_4d0d793a-2f9d-4b6f-9444-40465c2d847c/manager/0.log" Jul 23 18:43:16.526641 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:16.526617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nv5xv_ab71f700-f42f-42b5-8ac6-c1b229a363c8/server/0.log" Jul 23 18:43:16.650181 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:16.650154 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-54j49_492db523-161e-47f0-ad61-15342de69083/manager/0.log" Jul 23 18:43:17.009829 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:17.009804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-jqs7z_e979403a-0cc2-4e71-914d-3a1d92b66f83/copy-manifests/0.log" Jul 23 18:43:17.025613 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:17.025585 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-jqs7z_e979403a-0cc2-4e71-914d-3a1d92b66f83/manager/0.log" Jul 23 18:43:17.366620 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:17.366532 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b4cb74697-hfv9f_0a46b525-4163-405f-b516-9cecb312cbb5/maas-api/0.log" Jul 23 18:43:17.478970 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:17.478947 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rmzl4_caea40d5-2edc-47ce-b9b9-82c847ef567b/postgres/0.log" Jul 23 18:43:19.416046 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:19.416017 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mt7fg_dbbfc586-fed5-47c4-a6c5-8c06db48effa/manager/0.log" Jul 23 18:43:20.163514 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:20.163486 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq84r_86f0964c-044f-43bb-b3fc-3f0bd43590fb/discovery/0.log" Jul 23 18:43:20.283807 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:20.283778 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-2565t_0ff7e18f-15d3-4d15-b64e-b2be8f446b2c/kube-auth-proxy/0.log" Jul 23 18:43:20.655882 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:20.655807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7tqxv_10b40015-4a2d-4091-9233-ad9a79cee4a3/payload-pre-processing/0.log" Jul 23 18:43:20.777452 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:20.777428 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-2rjgg_721d9497-dc28-460c-ae8a-ced1df4b836b/payload-processing/0.log" Jul 23 18:43:21.244068 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:21.244040 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kzkc7_4ab8ef0f-6783-40af-8de1-cd2d7eaa4866/main/0.log" Jul 23 18:43:21.474938 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:21.474911 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bdwfd_fbab5e0f-a448-4167-ac1d-6b4f180e1ae5/main/0.log" Jul 23 18:43:30.133546 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:30.133516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-98ktb_08e6500c-f4b5-4261-9d97-7d52ddc8b50f/global-pull-secret-syncer/0.log" Jul 23 18:43:30.272456 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:30.272427 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-btd25_730762ee-2e86-4599-81c6-a7045f3e5a8d/konnectivity-agent/0.log" Jul 23 18:43:30.323015 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:30.322986 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-87.ec2.internal_7576914ea66934410936fa139f29b46e/haproxy/0.log" Jul 23 18:43:35.232402 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:35.232341 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mt7fg_dbbfc586-fed5-47c4-a6c5-8c06db48effa/manager/0.log" Jul 23 18:43:37.069262 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.069228 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/alertmanager/0.log" Jul 23 18:43:37.105020 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.104993 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/config-reloader/0.log" Jul 23 18:43:37.149388 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.149338 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/kube-rbac-proxy-web/0.log" Jul 23 18:43:37.178753 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.178726 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/kube-rbac-proxy/0.log" Jul 23 18:43:37.212537 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.212511 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/kube-rbac-proxy-metric/0.log" Jul 23 18:43:37.290429 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.290345 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/prom-label-proxy/0.log" Jul 23 18:43:37.331973 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.331946 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7139d155-50f1-4839-886b-6ca73bb1422d/init-config-reloader/0.log" Jul 23 18:43:37.777994 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.777965 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwc9t_a8f1fa34-f835-47c3-b5cb-607787e1d80a/node-exporter/0.log" Jul 23 18:43:37.844108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.844082 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwc9t_a8f1fa34-f835-47c3-b5cb-607787e1d80a/kube-rbac-proxy/0.log" Jul 23 18:43:37.904478 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:37.904452 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwc9t_a8f1fa34-f835-47c3-b5cb-607787e1d80a/init-textfile/0.log" Jul 23 18:43:38.386105 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:38.386079 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d56f6dbf-7j5z6_de8bedc0-1192-45f6-85f3-850e10441943/telemeter-client/0.log" Jul 23 18:43:38.412136 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:38.412108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d56f6dbf-7j5z6_de8bedc0-1192-45f6-85f3-850e10441943/reload/0.log" Jul 23 18:43:38.442634 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:38.442604 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d56f6dbf-7j5z6_de8bedc0-1192-45f6-85f3-850e10441943/kube-rbac-proxy/0.log" Jul 23 18:43:39.671528 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.671495 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl"] Jul 23 18:43:39.674949 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.674930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.679465 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.679430 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n64gl\"/\"default-dockercfg-692r6\"" Jul 23 18:43:39.679465 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.679457 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n64gl\"/\"openshift-service-ca.crt\"" Jul 23 18:43:39.680123 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.680106 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n64gl\"/\"kube-root-ca.crt\"" Jul 23 18:43:39.692605 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.692578 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl"] Jul 23 18:43:39.757941 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.757905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-podres\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.757941 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.757939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-proc\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.758156 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.757985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mff9c\" (UniqueName: \"kubernetes.io/projected/1c78e63c-e508-4659-857d-f047f718d402-kube-api-access-mff9c\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.758156 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.758021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-lib-modules\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.758156 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.758044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-sys\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.858685 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-podres\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.858685 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-proc\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.858875 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mff9c\" (UniqueName: \"kubernetes.io/projected/1c78e63c-e508-4659-857d-f047f718d402-kube-api-access-mff9c\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.858875 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-lib-modules\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.858875 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-sys\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.858875 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-podres\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.859025 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858865 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-proc\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.859025 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858900 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-sys\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.859025 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.858919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c78e63c-e508-4659-857d-f047f718d402-lib-modules\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.868345 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.868307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mff9c\" (UniqueName: \"kubernetes.io/projected/1c78e63c-e508-4659-857d-f047f718d402-kube-api-access-mff9c\") pod \"perf-node-gather-daemonset-hsrpl\" (UID: \"1c78e63c-e508-4659-857d-f047f718d402\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:39.985844 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:39.985762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:40.122269 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:40.122244 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl"] Jul 23 18:43:40.124875 ip-10-0-134-87 kubenswrapper[2556]: W0723 18:43:40.124851 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c78e63c_e508_4659_857d_f047f718d402.slice/crio-db7fcf63e48a7a8ad71eb23aaef83670e06681ef942bf7b2192da56ee557c572 WatchSource:0}: Error finding container db7fcf63e48a7a8ad71eb23aaef83670e06681ef942bf7b2192da56ee557c572: Status 404 returned error can't find the container with id db7fcf63e48a7a8ad71eb23aaef83670e06681ef942bf7b2192da56ee557c572 Jul 23 18:43:40.919560 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:40.919526 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" event={"ID":"1c78e63c-e508-4659-857d-f047f718d402","Type":"ContainerStarted","Data":"14ae4b9355d333e40506b5eb1d572bca103dc828a52dfbc930de108e8c31b259"} Jul 23 18:43:40.919948 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:40.919585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" event={"ID":"1c78e63c-e508-4659-857d-f047f718d402","Type":"ContainerStarted","Data":"db7fcf63e48a7a8ad71eb23aaef83670e06681ef942bf7b2192da56ee557c572"} Jul 23 18:43:40.919948 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:40.919632 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:40.935260 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:40.935206 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" podStartSLOduration=1.935193752 podStartE2EDuration="1.935193752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:40.934835139 +0000 UTC m=+792.999067869" watchObservedRunningTime="2026-07-23 18:43:40.935193752 +0000 UTC m=+792.999426481" Jul 23 18:43:42.802089 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:42.802061 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wqrjk_4fdec47e-b7c8-4c90-b03f-71d11333e6cf/dns/0.log" Jul 23 18:43:42.829529 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:42.829507 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wqrjk_4fdec47e-b7c8-4c90-b03f-71d11333e6cf/kube-rbac-proxy/0.log" Jul 23 18:43:42.885903 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:42.885872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-884tl_039445b8-22d4-4879-a5fa-77d524773d62/dns-node-resolver/0.log" Jul 23 18:43:43.554094 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:43.554055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d9hs2_e6ad8740-0445-4268-a0ee-07a3791702ac/node-ca/0.log" Jul 23 18:43:44.584594 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:44.584554 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq84r_86f0964c-044f-43bb-b3fc-3f0bd43590fb/discovery/0.log" Jul 23 18:43:44.605374 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:44.605334 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-2565t_0ff7e18f-15d3-4d15-b64e-b2be8f446b2c/kube-auth-proxy/0.log" Jul 23 18:43:44.693108 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:44.693081 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7tqxv_10b40015-4a2d-4091-9233-ad9a79cee4a3/payload-pre-processing/0.log" Jul 23 18:43:44.721580 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:44.721553 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-2rjgg_721d9497-dc28-460c-ae8a-ced1df4b836b/payload-processing/0.log" Jul 23 18:43:45.424429 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:45.424395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wlg4z_97f1f06c-b84f-4a95-b24a-ff753395b11f/serve-healthcheck-canary/0.log" Jul 23 18:43:46.117305 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:46.117276 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-khm8l_95b44360-7f38-440c-838e-a814a4829aeb/kube-rbac-proxy/0.log" Jul 23 18:43:46.141073 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:46.141044 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-khm8l_95b44360-7f38-440c-838e-a814a4829aeb/exporter/0.log" Jul 23 18:43:46.165877 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:46.165854 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-khm8l_95b44360-7f38-440c-838e-a814a4829aeb/extractor/0.log" Jul 23 18:43:46.934297 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:46.934258 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-hsrpl" Jul 23 18:43:48.503930 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.503899 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bw92v_fa27e478-5a51-41ef-be5f-379206803751/manager/0.log" Jul 23 18:43:48.544139 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.544107 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kqxv2_c218553d-9182-417c-90d3-657119af5698/manager/0.log" Jul 23 18:43:48.570599 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.570571 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77c46fd484-cnlfp_4d0d793a-2f9d-4b6f-9444-40465c2d847c/manager/0.log" Jul 23 18:43:48.594473 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.594443 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nv5xv_ab71f700-f42f-42b5-8ac6-c1b229a363c8/server/0.log" Jul 23 18:43:48.652394 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.652347 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-54j49_492db523-161e-47f0-ad61-15342de69083/manager/0.log" Jul 23 18:43:48.806009 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.805899 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-jqs7z_e979403a-0cc2-4e71-914d-3a1d92b66f83/manager/0.log" Jul 23 18:43:48.826541 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:48.826518 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-jqs7z_e979403a-0cc2-4e71-914d-3a1d92b66f83/copy-manifests/0.log" Jul 23 18:43:50.207532 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:50.207504 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq84r_86f0964c-044f-43bb-b3fc-3f0bd43590fb/discovery/0.log" Jul 23 18:43:50.242810 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:50.242787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-2565t_0ff7e18f-15d3-4d15-b64e-b2be8f446b2c/kube-auth-proxy/0.log" Jul 23 18:43:50.300057 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:50.300027 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7tqxv_10b40015-4a2d-4091-9233-ad9a79cee4a3/payload-pre-processing/0.log" Jul 23 18:43:50.313766 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:50.313716 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-2rjgg_721d9497-dc28-460c-ae8a-ced1df4b836b/payload-processing/0.log" Jul 23 18:43:51.555267 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:51.555233 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq84r_86f0964c-044f-43bb-b3fc-3f0bd43590fb/discovery/0.log" Jul 23 18:43:51.565915 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:51.565889 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-2565t_0ff7e18f-15d3-4d15-b64e-b2be8f446b2c/kube-auth-proxy/0.log" Jul 23 18:43:51.622172 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:51.622150 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7tqxv_10b40015-4a2d-4091-9233-ad9a79cee4a3/payload-pre-processing/0.log" Jul 23 18:43:51.640233 ip-10-0-134-87 kubenswrapper[2556]: I0723 18:43:51.640206 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-2rjgg_721d9497-dc28-460c-ae8a-ced1df4b836b/payload-processing/0.log"