Jul 02 16:37:58.763921 ip-10-0-138-22 systemd[1]: Starting Kubernetes Kubelet... Jul 02 16:37:59.149184 ip-10-0-138-22 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:37:59.149184 ip-10-0-138-22 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 16:37:59.149184 ip-10-0-138-22 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:37:59.149184 ip-10-0-138-22 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 16:37:59.149184 ip-10-0-138-22 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:37:59.150183 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.150041 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 16:37:59.154412 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154387 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:37:59.154412 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154409 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:37:59.154412 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154413 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:37:59.154412 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154416 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:37:59.154412 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154419 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154423 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154426 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154429 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154432 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154435 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154438 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154440 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154443 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154445 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154449 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154454 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154457 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154459 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154462 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154464 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154467 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154469 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154472 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:37:59.154639 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154475 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154477 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154480 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154482 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154487 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154490 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154492 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154495 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154497 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154500 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154502 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154504 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154508 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154510 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154513 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154516 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154518 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154521 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154523 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154526 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:37:59.155097 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154528 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154531 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154550 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154555 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154558 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154561 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154563 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154567 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154569 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154572 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154574 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154577 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154579 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154582 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154584 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154587 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154592 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154596 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:37:59.155590 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154600 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154604 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154607 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154610 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154614 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154617 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154620 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154622 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154626 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154629 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154633 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154635 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154638 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154640 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154643 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154646 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154649 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154651 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154654 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154656 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:37:59.156028 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154659 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154661 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154665 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154668 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154671 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154673 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154676 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154678 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154681 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154684 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154686 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154688 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154691 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154693 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154696 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154698 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154701 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:37:59.156516 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.154704 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:37:59.157079 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157066 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:37:59.157079 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157078 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157082 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157086 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157089 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157092 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157095 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157097 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157100 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157104 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157108 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157111 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157113 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157115 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157118 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157120 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157123 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157126 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157128 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157131 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157133 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:37:59.157136 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157136 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157139 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157143 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157146 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157150 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157153 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157155 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157158 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157160 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157163 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157166 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157169 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157171 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157174 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157177 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157179 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157181 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157184 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157186 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:37:59.157681 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157189 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157192 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157194 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157196 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157199 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157201 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157204 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157206 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157209 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157211 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157214 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157216 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157219 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157221 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157224 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157227 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157230 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157232 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157235 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157237 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:37:59.158147 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157240 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157243 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157245 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157248 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157250 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157252 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157255 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157258 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157260 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157263 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157265 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157268 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157270 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157273 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157275 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157277 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157280 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157283 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157285 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157288 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:37:59.158647 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157290 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157293 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157297 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157301 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157304 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157307 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157309 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157313 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157315 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157318 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157320 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157323 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157325 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157328 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157330 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157333 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157335 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157338 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157340 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:37:59.159127 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157752 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157757 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157760 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157764 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157767 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157770 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157773 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157776 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157778 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157781 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157783 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157786 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157789 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157792 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157794 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157797 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157800 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157802 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157805 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:37:59.159606 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157807 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157811 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157814 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157816 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157819 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157821 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157823 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157826 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157828 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157831 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157833 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157836 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157838 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157840 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157843 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157845 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157847 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157850 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157852 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157855 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:37:59.160074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157857 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157860 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157862 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157865 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157867 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157870 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157872 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157874 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157877 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157879 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157882 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157885 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157887 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157890 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157895 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157898 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157902 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157905 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157907 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157909 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:37:59.160550 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157912 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157915 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157917 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157920 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157922 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157924 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157927 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157929 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157931 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157934 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157936 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157940 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157943 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157945 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157947 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157950 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157952 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157955 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157957 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157960 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:37:59.161045 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157963 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157965 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157969 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157973 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157975 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157979 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157981 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157984 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157986 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157989 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157991 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157994 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157997 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.157999 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158002 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158004 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158007 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158009 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158011 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158014 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:37:59.161630 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158095 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158103 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158109 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158114 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158118 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158121 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158125 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158129 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158132 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158135 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158138 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158141 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158145 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158151 2560 flags.go:64] FLAG: --cgroup-root="" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158156 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158160 2560 flags.go:64] FLAG: --client-ca-file="" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158166 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158171 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158178 2560 flags.go:64] FLAG: --cluster-domain="" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158183 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158186 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158190 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158193 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158197 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 16:37:59.162106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158200 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158203 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158206 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158209 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158212 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158215 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158218 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158221 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158225 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158228 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158231 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158233 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158236 2560 flags.go:64] FLAG: --enable-server="true" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158239 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158244 2560 flags.go:64] FLAG: --event-burst="100" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158247 2560 flags.go:64] FLAG: --event-qps="50" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158250 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158252 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158255 2560 flags.go:64] FLAG: --eviction-hard="" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158259 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158262 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158265 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158268 2560 flags.go:64] FLAG: --eviction-soft="" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158271 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158273 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 16:37:59.162732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158280 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158283 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158286 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158289 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158292 2560 flags.go:64] FLAG: --feature-gates="" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158296 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158299 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158301 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158304 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158307 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158310 2560 flags.go:64] FLAG: --help="false" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158313 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158316 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158319 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158322 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158325 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158328 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158331 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158334 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158336 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158339 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158342 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158345 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158348 2560 flags.go:64] FLAG: --kube-reserved="" Jul 02 16:37:59.163336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158351 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158354 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158357 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158359 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158362 2560 flags.go:64] FLAG: --lock-file="" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158365 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158368 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158371 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158377 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158381 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158384 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158387 2560 flags.go:64] FLAG: --logging-format="text" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158389 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158393 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158395 2560 flags.go:64] FLAG: --manifest-url="" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158398 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158403 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158405 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158409 2560 flags.go:64] FLAG: --max-pods="110" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158412 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158415 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158418 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158421 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158423 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158426 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 16:37:59.163944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158429 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158436 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158439 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158442 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158445 2560 flags.go:64] FLAG: --pod-cidr="" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158448 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158453 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158456 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158459 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158461 2560 flags.go:64] FLAG: --port="10250" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158464 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158467 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-036ceea8cfa1b6827" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158470 2560 flags.go:64] FLAG: --qos-reserved="" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158473 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158476 2560 flags.go:64] FLAG: --register-node="true" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158479 2560 flags.go:64] FLAG: --register-with-taints="" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158483 2560 flags.go:64] FLAG: --registry-burst="10" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158487 2560 flags.go:64] FLAG: --registry-qps="5" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158489 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158492 2560 flags.go:64] FLAG: --reserved-memory="" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158496 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158499 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158501 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158504 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158507 2560 flags.go:64] FLAG: --runonce="false" Jul 02 16:37:59.164549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158509 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158512 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158515 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158518 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158521 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158524 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158527 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158530 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158532 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158553 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158557 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158562 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158565 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158569 2560 flags.go:64] FLAG: --system-cgroups="" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158572 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158577 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158580 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158583 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158588 2560 flags.go:64] FLAG: --tls-min-version="" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158591 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158593 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158596 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158599 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158603 2560 flags.go:64] FLAG: --v="2" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158608 2560 flags.go:64] FLAG: --version="false" Jul 02 16:37:59.165205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158612 2560 flags.go:64] FLAG: --vmodule="" Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158616 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.158619 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158740 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158745 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158747 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158750 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158753 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158755 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158758 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158760 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158763 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158765 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158768 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158770 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158773 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158775 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158778 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158780 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158782 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:37:59.165844 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158786 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158788 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158791 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158793 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158796 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158798 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158803 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158806 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158809 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158812 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158817 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158819 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158822 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158825 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158828 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158830 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158832 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158835 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158838 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:37:59.166320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158841 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158843 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158846 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158848 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158851 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158853 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158856 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158858 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158860 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158865 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158868 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158870 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158873 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158877 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158879 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158882 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158884 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158887 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158889 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158892 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:37:59.166804 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158894 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158896 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158899 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158903 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158905 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158908 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158910 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158913 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158916 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158918 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158920 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158923 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158926 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158929 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158932 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158935 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158938 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158940 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158943 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158945 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:37:59.167282 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158947 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158950 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158952 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158955 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158957 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158961 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158963 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158966 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158968 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158971 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158973 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158976 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158978 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158980 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158983 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158987 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158989 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158992 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158994 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:37:59.167778 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.158997 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.159002 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.159005 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.159008 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.159624 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.166143 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.166165 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.166184 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.166190 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166249 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166254 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166257 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166261 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166264 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166267 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:37:59.168240 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166270 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166273 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166275 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166278 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166280 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166283 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166286 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166288 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166291 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166293 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166296 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166298 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166301 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166303 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166306 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166308 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166311 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166313 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166316 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166319 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166321 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:37:59.168640 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166324 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166327 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166330 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166333 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166335 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166338 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166340 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166343 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166345 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166348 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166351 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166353 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166356 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166358 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166360 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166363 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166365 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166368 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166372 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:37:59.169226 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166375 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166378 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166381 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166383 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166386 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166389 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166391 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166394 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166396 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166399 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166401 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166405 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166408 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166412 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166415 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166419 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166421 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166424 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166426 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166429 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:37:59.169706 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166431 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166434 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166436 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166438 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166441 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166443 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166446 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166448 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166451 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166454 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166456 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166458 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166461 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166464 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166466 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166469 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166471 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166474 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166477 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166479 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:37:59.170197 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166482 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166484 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166487 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166489 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166493 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166497 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166499 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166504 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166507 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166510 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166512 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166515 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166517 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.166522 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166652 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:37:59.170704 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166656 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166659 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166662 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166664 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166667 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166669 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166672 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166674 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166677 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166679 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166681 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166684 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166686 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166689 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166691 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166694 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166696 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166699 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166701 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166704 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:37:59.171074 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166706 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166709 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166712 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166714 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166717 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166720 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166722 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166725 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166727 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166729 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166732 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166734 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166737 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166739 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166743 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166746 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166749 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166752 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166754 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166757 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:37:59.171632 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166759 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166762 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166765 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166767 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166769 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166772 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166774 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166776 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166779 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166781 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166783 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166786 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166789 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166791 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166794 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166797 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166799 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166802 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166804 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166807 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:37:59.172122 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166809 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166812 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166814 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166817 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166819 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166822 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166824 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166827 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166829 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166833 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166836 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166838 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166841 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166844 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166846 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166849 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166851 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166854 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166857 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:37:59.172604 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166860 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166864 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166867 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166869 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166872 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166874 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166877 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166879 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166881 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166884 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166887 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166889 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166892 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166894 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166896 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166899 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166901 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166903 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:37:59.173068 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:37:59.166906 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.166910 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.167015 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.168871 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.170560 2560 server.go:1019] "Starting client certificate rotation" Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.170657 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.170712 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:37:59.173525 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.173260 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:37:59.174942 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.174926 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:37:59.184643 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.184622 2560 log.go:25] "Validated CRI v1 runtime API" Jul 02 16:37:59.186640 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.186625 2560 log.go:25] "Validated CRI v1 image API" Jul 02 16:37:59.188895 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.188870 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 16:37:59.191570 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.191529 2560 fs.go:135] Filesystem UUIDs: map[329170a1-db5c-4965-9c70-2e18396a02de:/dev/nvme0n1p4 3b19ebf3-659a-44d8-966c-6039df39a414:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 02 16:37:59.191646 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.191569 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 16:37:59.197467 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.197358 2560 manager.go:216] Machine: {Timestamp:2026-07-02 16:37:59.196020192 +0000 UTC m=+0.320091822 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094368 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bee3e2190aa56659fbd580dcb1853 SystemUUID:ec2bee3e-2190-aa56-659f-bd580dcb1853 BootID:e7cb3af4-1a14-4847-a0eb-4c3fa307be04 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:b7:57:04:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:b7:57:04:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:58:1a:70:02:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 16:37:59.197467 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.197462 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 16:37:59.197587 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.197556 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 16:37:59.200777 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.200752 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 16:37:59.200922 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.200781 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 16:37:59.202034 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.202023 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 16:37:59.202071 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.202037 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 16:37:59.202071 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.202044 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:37:59.202721 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.202710 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:37:59.203584 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.203572 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 16:37:59.206292 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206280 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:37:59.206403 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206394 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 16:37:59.206433 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206425 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 02 16:37:59.206468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206434 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 16:37:59.206468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206449 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 16:37:59.206468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206458 2560 kubelet.go:398] "Adding apiserver pod source" Jul 02 16:37:59.206468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206467 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 16:37:59.206857 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206834 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:37:59.206897 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206871 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:37:59.206897 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.206886 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:37:59.210242 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.210221 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 16:37:59.211445 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.211432 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 16:37:59.211506 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.211462 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 16:37:59.212748 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212735 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212754 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212760 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212766 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212776 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212781 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212790 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212795 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212802 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212808 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212817 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 16:37:59.212824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.212822 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 16:37:59.213419 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.213405 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 16:37:59.213419 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.213415 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 16:37:59.216976 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.216953 2560 server.go:1268] "Started kubelet" Jul 02 16:37:59.217067 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.217037 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 16:37:59.217121 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.217063 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 16:37:59.217172 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.217137 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 16:37:59.217226 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.217171 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 16:37:59.217278 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.217258 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 16:37:59.220643 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.220295 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 16:37:59.220441 ip-10-0-138-22 systemd[1]: Started Kubernetes Kubelet. Jul 02 16:37:59.220842 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.220725 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 16:37:59.222846 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.222823 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 16:37:59.224184 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.224168 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 02 16:37:59.227066 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227046 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 16:37:59.227153 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.226012 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-22.ec2.internal.18be8666f3984a2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-22.ec2.internal,UID:ip-10-0-138-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-22.ec2.internal,},FirstTimestamp:2026-07-02 16:37:59.216925227 +0000 UTC m=+0.340996856,LastTimestamp:2026-07-02 16:37:59.216925227 +0000 UTC m=+0.340996856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-22.ec2.internal,}" Jul 02 16:37:59.227153 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227051 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 16:37:59.227261 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.227161 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.227605 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227585 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 16:37:59.227605 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227587 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 16:37:59.227737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227617 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 16:37:59.227737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227739 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 02 16:37:59.227835 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227746 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 02 16:37:59.227892 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227878 2560 factory.go:55] Registering systemd factory Jul 02 16:37:59.227947 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.227897 2560 factory.go:223] Registration of the systemd container factory successfully Jul 02 16:37:59.228168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.228076 2560 factory.go:153] Registering CRI-O factory Jul 02 16:37:59.228168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.228093 2560 factory.go:223] Registration of the crio container factory successfully Jul 02 16:37:59.228168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.228143 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 16:37:59.228168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.228172 2560 factory.go:103] Registering Raw factory Jul 02 16:37:59.228347 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.228187 2560 manager.go:1196] Started watching for new ooms in manager Jul 02 16:37:59.228860 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.228848 2560 manager.go:349] Starting recovery of all containers Jul 02 16:37:59.234451 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.234424 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 16:37:59.234583 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.234561 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 16:37:59.236093 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.236068 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zhl5p" Jul 02 16:37:59.237611 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.237594 2560 manager.go:354] Recovery completed Jul 02 16:37:59.241265 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.241249 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.242991 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.242972 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.243127 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243003 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.243127 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243019 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.243127 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243031 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zhl5p" Jul 02 16:37:59.243600 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243550 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 16:37:59.243600 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243563 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 16:37:59.243600 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243578 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:37:59.243600 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.243582 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.244290 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.244276 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.244339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.244305 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.244339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.244318 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.244753 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.244690 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-22.ec2.internal.18be8666f52605e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-22.ec2.internal,UID:ip-10-0-138-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-22.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-22.ec2.internal,},FirstTimestamp:2026-07-02 16:37:59.242991075 +0000 UTC m=+0.367062709,LastTimestamp:2026-07-02 16:37:59.242991075 +0000 UTC m=+0.367062709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-22.ec2.internal,}" Jul 02 16:37:59.245146 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.245136 2560 policy_none.go:49] "None policy: Start" Jul 02 16:37:59.245183 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.245151 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 16:37:59.245183 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.245161 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 16:37:59.246171 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.246156 2560 policy_none.go:47] "Start" Jul 02 16:37:59.269149 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269132 2560 manager.go:337] "Starting Device Plugin manager" Jul 02 16:37:59.269246 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.269165 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 16:37:59.269246 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269175 2560 server.go:87] "Starting device plugin registration server" Jul 02 16:37:59.269445 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269433 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 16:37:59.269487 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269448 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 16:37:59.269671 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269568 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 16:37:59.269671 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269671 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 16:37:59.269845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.269687 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 16:37:59.270280 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.270254 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 16:37:59.270366 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.270310 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.296223 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.296183 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 16:37:59.301095 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.297503 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 16:37:59.301095 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.297562 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 16:37:59.301095 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.297601 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 16:37:59.301095 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.297636 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 16:37:59.301095 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.299742 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:37:59.370270 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.370234 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.371322 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.371307 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.371424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.371338 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.371424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.371350 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.371424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.371374 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.379377 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.379359 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.379488 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.379383 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-22.ec2.internal\": node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.398382 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.398341 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal"] Jul 02 16:37:59.398529 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.398419 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.399360 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.399316 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.399360 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.399345 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.399360 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.399355 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.400632 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.400621 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.400763 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.400748 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.400806 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.400784 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.401389 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.401371 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.401389 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.401390 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.401504 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.401400 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.401504 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.401406 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.401504 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.401415 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.401504 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.401420 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.401680 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.401633 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.402594 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.402581 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.402639 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.402604 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:37:59.403237 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.403225 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:37:59.403310 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.403252 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:37:59.403310 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.403265 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:37:59.428889 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.428856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/402c77b7f5977081ddde9d48ef88ae9f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"402c77b7f5977081ddde9d48ef88ae9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.428889 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.428888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/402c77b7f5977081ddde9d48ef88ae9f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"402c77b7f5977081ddde9d48ef88ae9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.429102 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.428907 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6ff253717128a1119568842cc848cc0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-22.ec2.internal\" (UID: \"d6ff253717128a1119568842cc848cc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.433437 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.433409 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-22.ec2.internal\" not found" node="ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.438061 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.438042 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-22.ec2.internal\" not found" node="ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.502331 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.502293 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.529967 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.529933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/402c77b7f5977081ddde9d48ef88ae9f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"402c77b7f5977081ddde9d48ef88ae9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.529967 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.529965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/402c77b7f5977081ddde9d48ef88ae9f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"402c77b7f5977081ddde9d48ef88ae9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.530172 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.529981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6ff253717128a1119568842cc848cc0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-22.ec2.internal\" (UID: \"d6ff253717128a1119568842cc848cc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.530172 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.530020 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6ff253717128a1119568842cc848cc0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-22.ec2.internal\" (UID: \"d6ff253717128a1119568842cc848cc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.530172 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.530035 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/402c77b7f5977081ddde9d48ef88ae9f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"402c77b7f5977081ddde9d48ef88ae9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.530172 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.530042 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/402c77b7f5977081ddde9d48ef88ae9f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"402c77b7f5977081ddde9d48ef88ae9f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.603404 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.603362 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.704186 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.704102 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.736838 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.736810 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.741086 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:37:59.741067 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jul 02 16:37:59.804615 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.804571 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:37:59.905136 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:37:59.905104 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:38:00.005695 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:00.005616 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:38:00.106297 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:00.106256 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:38:01.658065 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.658031 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 16:38:01.658589 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.658206 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:38:01.695371 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:01.695337 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jul 02 16:38:01.735038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.734998 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 16:33:00 +0000 UTC" deadline="2028-02-07 13:02:58.748682192 +0000 UTC" Jul 02 16:38:01.735038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.735044 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14036h24m57.013642143s" Jul 02 16:38:01.758414 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.758340 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:01.770887 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:01.770850 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402c77b7f5977081ddde9d48ef88ae9f.slice/crio-fd07246651bf0b4f8a6b59626d24429f93780dfd45ab538370d43415381604c2 WatchSource:0}: Error finding container fd07246651bf0b4f8a6b59626d24429f93780dfd45ab538370d43415381604c2: Status 404 returned error can't find the container with id fd07246651bf0b4f8a6b59626d24429f93780dfd45ab538370d43415381604c2 Jul 02 16:38:01.771237 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:01.771216 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ff253717128a1119568842cc848cc0.slice/crio-a2956e33890d3647789c5a9fff98db7c63d74960cf31a12d1fa456f7d8788159 WatchSource:0}: Error finding container a2956e33890d3647789c5a9fff98db7c63d74960cf31a12d1fa456f7d8788159: Status 404 returned error can't find the container with id a2956e33890d3647789c5a9fff98db7c63d74960cf31a12d1fa456f7d8788159 Jul 02 16:38:01.776444 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.776430 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:38:01.789035 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.789017 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:01.790213 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.790164 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" event={"ID":"d6ff253717128a1119568842cc848cc0","Type":"ContainerStarted","Data":"a2956e33890d3647789c5a9fff98db7c63d74960cf31a12d1fa456f7d8788159"} Jul 02 16:38:01.791537 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.791520 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" event={"ID":"402c77b7f5977081ddde9d48ef88ae9f","Type":"ContainerStarted","Data":"fd07246651bf0b4f8a6b59626d24429f93780dfd45ab538370d43415381604c2"} Jul 02 16:38:01.815487 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.815466 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jul 02 16:38:01.827484 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.827460 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:38:01.829491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.829476 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jul 02 16:38:01.838395 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:01.838376 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:38:02.070612 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.070588 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:02.696068 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.696036 2560 apiserver.go:52] "Watching apiserver" Jul 02 16:38:02.707633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.707602 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 16:38:02.708723 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.708676 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal","openshift-multus/multus-95rxm","openshift-multus/network-metrics-daemon-rm4nb","openshift-network-operator/iptables-alerter-dfzd4","kube-system/konnectivity-agent-4nwnt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p","openshift-image-registry/node-ca-t6tvd","openshift-multus/multus-additional-cni-plugins-h9c7m","openshift-network-diagnostics/network-check-target-8vnpf","openshift-ovn-kubernetes/ovnkube-node-dvt2w","kube-system/global-pull-secret-syncer-ntprq","kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8xpgq","openshift-dns/node-resolver-tjd45"] Jul 02 16:38:02.710462 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.710436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.711890 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.711863 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.713076 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.713059 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 16:38:02.713193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.713147 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:02.713255 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.713211 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:02.713469 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.713447 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 16:38:02.713555 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.713451 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.714559 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.714525 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7ddjr\"" Jul 02 16:38:02.714662 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.714563 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.714662 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.714606 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 16:38:02.714662 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.714610 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 16:38:02.714842 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.714824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.715880 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.715979 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ff2dw\"" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.715996 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.716171 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.716287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.716358 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.716372 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 16:38:02.716623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.716531 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 16:38:02.718324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.717134 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.718324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.717335 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.718324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.717538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kw8zv\"" Jul 02 16:38:02.718324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.717740 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.718882 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.718864 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9wl5w\"" Jul 02 16:38:02.718986 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.718913 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 16:38:02.719707 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.719171 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:02.719707 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.719232 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:02.719707 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.719237 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 16:38:02.719863 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.719845 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.720301 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.720283 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 16:38:02.720381 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.720290 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.720381 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.720326 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g64zg\"" Jul 02 16:38:02.720703 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.720668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.722018 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.722002 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.723005 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.722991 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 16:38:02.723269 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.723245 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.723342 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.723326 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.723657 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.723511 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gkrjg\"" Jul 02 16:38:02.723657 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.723530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.723657 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.723599 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:02.724280 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.724262 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.724433 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.724411 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.724539 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.724472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r4wq2\"" Jul 02 16:38:02.724764 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.724742 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.726044 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.726024 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:38:02.726137 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.726075 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.727112 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.727094 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5w76j\"" Jul 02 16:38:02.727467 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.727450 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 16:38:02.728244 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2z5n\" (UniqueName: \"kubernetes.io/projected/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-kube-api-access-r2z5n\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.728319 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-kubelet\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.728319 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728297 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-ovnkube-script-lib\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.728396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.728396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728352 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:38:02.728396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728379 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.728491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728413 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62291666-a661-47cf-a1b8-095f89bd9e6f-agent-certs\") pod \"konnectivity-agent-4nwnt\" (UID: \"62291666-a661-47cf-a1b8-095f89bd9e6f\") " pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.728491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728432 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pq7st\"" Jul 02 16:38:02.728491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.728491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728352 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 16:38:02.728491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-node-log\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.728491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 16:38:02.728720 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728511 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-log-socket\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.728906 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728873 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-ovnkube-config\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729010 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.729010 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-systemd-units\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729010 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.728977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-cni-netd\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-env-overrides\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-system-cni-dir\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.729170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62291666-a661-47cf-a1b8-095f89bd9e6f-konnectivity-ca\") pod \"konnectivity-agent-4nwnt\" (UID: \"62291666-a661-47cf-a1b8-095f89bd9e6f\") " pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.729170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729140 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-var-lib-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-cni-bin\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnqnz\" (UniqueName: \"kubernetes.io/projected/da883743-1e69-40b4-a2a1-239b6548ba35-kube-api-access-lnqnz\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-run-netns\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cnibin\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-os-release\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.729401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-hosts-file\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729407 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-systemd\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729442 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-etc-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729473 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7539d518-bc18-431d-998d-4c03ab1327de-ovn-node-metrics-cert\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqjz\" (UniqueName: \"kubernetes.io/projected/7539d518-bc18-431d-998d-4c03ab1327de-kube-api-access-2wqjz\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-tmp-dir\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q664s\" (UniqueName: \"kubernetes.io/projected/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-kube-api-access-q664s\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729592 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-slash\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-ovn\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.729762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.729720 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.749136 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.748972 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tbjhx" Jul 02 16:38:02.756931 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.756906 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tbjhx" Jul 02 16:38:02.816673 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.816638 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 16:38:02.830113 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-ovnkube-config\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.830113 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.830343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysctl-d\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.830343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-lib-modules\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.830343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59735cf-2ab8-456e-8264-74fef275a08a-cni-binary-copy\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.830343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-k8s-cni-cncf-io\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.830343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f59735cf-2ab8-456e-8264-74fef275a08a-multus-daemon-config\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.830624 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhhk\" (UniqueName: \"kubernetes.io/projected/de6629e9-cf67-4039-9676-22fe31eb485a-kube-api-access-xxhhk\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.830624 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.830624 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.830624 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-env-overrides\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.830624 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830559 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:02.830624 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830608 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/659cce3e-5ee6-4d9f-8257-43ade29569d3-dbus\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830680 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-etc-kubernetes\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnqnz\" (UniqueName: \"kubernetes.io/projected/da883743-1e69-40b4-a2a1-239b6548ba35-kube-api-access-lnqnz\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830779 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-conf-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-registration-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-system-cni-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.830932 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.830896 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-cni-multus\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.830998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-env-overrides\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.831019 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:03.33096459 +0000 UTC m=+2.966887799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-kubelet\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-host-slash\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831101 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-ovnkube-config\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgph5\" (UniqueName: \"kubernetes.io/projected/4ebe5a3d-0884-4400-848a-54bd1677b9ea-kube-api-access-wgph5\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcr6g\" (UniqueName: \"kubernetes.io/projected/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-kube-api-access-jcr6g\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831209 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-hostroot\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-etc-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7539d518-bc18-431d-998d-4c03ab1327de-ovn-node-metrics-cert\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q664s\" (UniqueName: \"kubernetes.io/projected/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-kube-api-access-q664s\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831376 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-etc-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-host\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de6629e9-cf67-4039-9676-22fe31eb485a-tmp\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-slash\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-ovn\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831555 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2z5n\" (UniqueName: \"kubernetes.io/projected/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-kube-api-access-r2z5n\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831563 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-slash\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831569 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-ovn\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831579 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-iptables-alerter-script\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x62w8\" (UniqueName: \"kubernetes.io/projected/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-kube-api-access-x62w8\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831614 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/659cce3e-5ee6-4d9f-8257-43ade29569d3-kubelet-config\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-ovnkube-script-lib\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.831813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62291666-a661-47cf-a1b8-095f89bd9e6f-agent-certs\") pod \"konnectivity-agent-4nwnt\" (UID: \"62291666-a661-47cf-a1b8-095f89bd9e6f\") " pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.831979 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-run\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-socket-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-serviceca\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-multus-certs\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832116 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-node-log\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832132 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-log-socket\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-modprobe-d\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832209 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-node-log\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832198 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-host\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-device-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832275 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-log-socket\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-os-release\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-systemd-units\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832341 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-systemd-units\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.832492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-cni-netd\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-cni-netd\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-system-cni-dir\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62291666-a661-47cf-a1b8-095f89bd9e6f-konnectivity-ca\") pod \"konnectivity-agent-4nwnt\" (UID: \"62291666-a661-47cf-a1b8-095f89bd9e6f\") " pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysconfig\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832472 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-system-cni-dir\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-sys\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-var-lib-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-cni-bin\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-systemd\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de6629e9-cf67-4039-9676-22fe31eb485a-etc-tuned\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832611 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-netns\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-var-lib-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-run-netns\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832661 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7539d518-bc18-431d-998d-4c03ab1327de-ovnkube-script-lib\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.833276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cnibin\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832745 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-cni-bin\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-run-netns\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-cnibin\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832812 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-os-release\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832925 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-os-release\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxf2\" (UniqueName: \"kubernetes.io/projected/f59735cf-2ab8-456e-8264-74fef275a08a-kube-api-access-4nxf2\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-hosts-file\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.832973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62291666-a661-47cf-a1b8-095f89bd9e6f-konnectivity-ca\") pod \"konnectivity-agent-4nwnt\" (UID: \"62291666-a661-47cf-a1b8-095f89bd9e6f\") " pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-systemd\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833019 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-hosts-file\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqjz\" (UniqueName: \"kubernetes.io/projected/7539d518-bc18-431d-998d-4c03ab1327de-kube-api-access-2wqjz\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-systemd\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-tmp-dir\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-kubernetes\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-cni-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-cnibin\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.834020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-socket-dir-parent\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysctl-conf\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-kubelet\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833423 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-tmp-dir\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833466 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-host-kubelet\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-var-lib-kubelet\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-sys-fs\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-cni-bin\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833659 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7539d518-bc18-431d-998d-4c03ab1327de-run-openvswitch\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.834705 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.833879 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.836051 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.835501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7539d518-bc18-431d-998d-4c03ab1327de-ovn-node-metrics-cert\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.836051 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.835591 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62291666-a661-47cf-a1b8-095f89bd9e6f-agent-certs\") pod \"konnectivity-agent-4nwnt\" (UID: \"62291666-a661-47cf-a1b8-095f89bd9e6f\") " pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:02.842668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.842637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q664s\" (UniqueName: \"kubernetes.io/projected/bc7c6227-b11f-4fbe-ab73-bba7c6f80888-kube-api-access-q664s\") pod \"node-resolver-tjd45\" (UID: \"bc7c6227-b11f-4fbe-ab73-bba7c6f80888\") " pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:02.842861 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.842806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2z5n\" (UniqueName: \"kubernetes.io/projected/3d6e0ce3-8e52-4f9b-be08-416e8a6d249e-kube-api-access-r2z5n\") pod \"multus-additional-cni-plugins-h9c7m\" (UID: \"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e\") " pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:02.843208 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.843188 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnqnz\" (UniqueName: \"kubernetes.io/projected/da883743-1e69-40b4-a2a1-239b6548ba35-kube-api-access-lnqnz\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:02.843477 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.843461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqjz\" (UniqueName: \"kubernetes.io/projected/7539d518-bc18-431d-998d-4c03ab1327de-kube-api-access-2wqjz\") pod \"ovnkube-node-dvt2w\" (UID: \"7539d518-bc18-431d-998d-4c03ab1327de\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:02.873996 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.873963 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:02.934248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-sys\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-systemd\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de6629e9-cf67-4039-9676-22fe31eb485a-etc-tuned\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-netns\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934321 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxf2\" (UniqueName: \"kubernetes.io/projected/f59735cf-2ab8-456e-8264-74fef275a08a-kube-api-access-4nxf2\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-kubernetes\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-sys\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-cni-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934369 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934363 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-netns\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-systemd\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-cnibin\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-kubernetes\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934451 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-cnibin\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-socket-dir-parent\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934479 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-socket-dir-parent\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysctl-conf\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934509 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-cni-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-var-lib-kubelet\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.934582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-sys-fs\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-cni-bin\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-var-lib-kubelet\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysctl-d\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysctl-conf\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-sys-fs\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-lib-modules\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-cni-bin\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934665 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59735cf-2ab8-456e-8264-74fef275a08a-cni-binary-copy\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysctl-d\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-k8s-cni-cncf-io\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f59735cf-2ab8-456e-8264-74fef275a08a-multus-daemon-config\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934757 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-k8s-cni-cncf-io\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934767 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhhk\" (UniqueName: \"kubernetes.io/projected/de6629e9-cf67-4039-9676-22fe31eb485a-kube-api-access-xxhhk\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-lib-modules\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/659cce3e-5ee6-4d9f-8257-43ade29569d3-dbus\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.935490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-etc-kubernetes\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934850 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-conf-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-registration-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-system-cni-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-cni-multus\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-kubelet\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934968 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-host-slash\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.934985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgph5\" (UniqueName: \"kubernetes.io/projected/4ebe5a3d-0884-4400-848a-54bd1677b9ea-kube-api-access-wgph5\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcr6g\" (UniqueName: \"kubernetes.io/projected/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-kube-api-access-jcr6g\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-hostroot\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935101 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-system-cni-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.935133 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-host\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de6629e9-cf67-4039-9676-22fe31eb485a-tmp\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.935196 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:03.435179904 +0000 UTC m=+3.071103087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:02.936328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-host-slash\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-iptables-alerter-script\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935227 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59735cf-2ab8-456e-8264-74fef275a08a-cni-binary-copy\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f59735cf-2ab8-456e-8264-74fef275a08a-multus-daemon-config\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935256 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-cni-multus\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x62w8\" (UniqueName: \"kubernetes.io/projected/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-kube-api-access-x62w8\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-var-lib-kubelet\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/659cce3e-5ee6-4d9f-8257-43ade29569d3-kubelet-config\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-run\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-socket-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-serviceca\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-etc-kubernetes\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935397 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-multus-certs\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935407 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/659cce3e-5ee6-4d9f-8257-43ade29569d3-dbus\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-modprobe-d\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935435 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-run\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-host\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935484 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/659cce3e-5ee6-4d9f-8257-43ade29569d3-kubelet-config\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-device-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-os-release\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-host-run-multus-certs\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935533 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-multus-conf-dir\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-socket-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935553 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysconfig\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935573 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-registration-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935582 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ebe5a3d-0884-4400-848a-54bd1677b9ea-device-dir\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-host\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-sysconfig\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935642 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-os-release\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935677 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-host\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935720 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-iptables-alerter-script\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f59735cf-2ab8-456e-8264-74fef275a08a-hostroot\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.935497 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de6629e9-cf67-4039-9676-22fe31eb485a-etc-modprobe-d\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.936068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-serviceca\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.936890 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de6629e9-cf67-4039-9676-22fe31eb485a-etc-tuned\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.937869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.937856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de6629e9-cf67-4039-9676-22fe31eb485a-tmp\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.949462 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.949392 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:02.949462 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.949422 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:02.949462 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.949436 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:02.949711 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:02.949522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:38:03.449500681 +0000 UTC m=+3.085423861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:02.952392 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.952351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhhk\" (UniqueName: \"kubernetes.io/projected/de6629e9-cf67-4039-9676-22fe31eb485a-kube-api-access-xxhhk\") pod \"tuned-8xpgq\" (UID: \"de6629e9-cf67-4039-9676-22fe31eb485a\") " pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:02.952536 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.952485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcr6g\" (UniqueName: \"kubernetes.io/projected/b33ccf49-eb8e-44fc-88cc-5f889ad9515b-kube-api-access-jcr6g\") pod \"node-ca-t6tvd\" (UID: \"b33ccf49-eb8e-44fc-88cc-5f889ad9515b\") " pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:02.952580 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.952550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxf2\" (UniqueName: \"kubernetes.io/projected/f59735cf-2ab8-456e-8264-74fef275a08a-kube-api-access-4nxf2\") pod \"multus-95rxm\" (UID: \"f59735cf-2ab8-456e-8264-74fef275a08a\") " pod="openshift-multus/multus-95rxm" Jul 02 16:38:02.952704 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.952663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgph5\" (UniqueName: \"kubernetes.io/projected/4ebe5a3d-0884-4400-848a-54bd1677b9ea-kube-api-access-wgph5\") pod \"aws-ebs-csi-driver-node-g567p\" (UID: \"4ebe5a3d-0884-4400-848a-54bd1677b9ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:02.952913 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:02.952893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x62w8\" (UniqueName: \"kubernetes.io/projected/abae6829-b4a4-4ad6-94ee-3e13d79cfacf-kube-api-access-x62w8\") pod \"iptables-alerter-dfzd4\" (UID: \"abae6829-b4a4-4ad6-94ee-3e13d79cfacf\") " pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:03.023223 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.023189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:03.028784 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.028755 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" Jul 02 16:38:03.039609 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.039584 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tjd45" Jul 02 16:38:03.045217 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.045184 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:03.051887 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.051867 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" Jul 02 16:38:03.059461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.059436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t6tvd" Jul 02 16:38:03.065078 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.065059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" Jul 02 16:38:03.072910 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.072886 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95rxm" Jul 02 16:38:03.079519 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.079495 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dfzd4" Jul 02 16:38:03.338378 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.338349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:03.338578 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.338460 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:03.338578 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.338512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:04.338500208 +0000 UTC m=+3.974423388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:03.439813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.439773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:03.439978 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.439896 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:03.439978 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.439969 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:04.439949565 +0000 UTC m=+4.075872760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:03.541000 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.540963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:03.541205 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.541114 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:03.541205 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.541138 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:03.541205 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.541150 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:03.541354 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.541213 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:38:04.541193571 +0000 UTC m=+4.177116771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:03.591846 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.591737 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6629e9_cf67_4039_9676_22fe31eb485a.slice/crio-b023602b4daab40de0d84b63aff427eea19a1d6668594f37dbd38004053db50f WatchSource:0}: Error finding container b023602b4daab40de0d84b63aff427eea19a1d6668594f37dbd38004053db50f: Status 404 returned error can't find the container with id b023602b4daab40de0d84b63aff427eea19a1d6668594f37dbd38004053db50f Jul 02 16:38:03.593038 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.593016 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7c6227_b11f_4fbe_ab73_bba7c6f80888.slice/crio-4df7378a278a0c111747f1036dfd62abb03f7dd2680a7395b9db7368a44790b7 WatchSource:0}: Error finding container 4df7378a278a0c111747f1036dfd62abb03f7dd2680a7395b9db7368a44790b7: Status 404 returned error can't find the container with id 4df7378a278a0c111747f1036dfd62abb03f7dd2680a7395b9db7368a44790b7 Jul 02 16:38:03.593715 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.593615 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59735cf_2ab8_456e_8264_74fef275a08a.slice/crio-a14cae16752f4a8bfe0fc3a02ea38a35ed34d1d21c908bba24722664c24e89c7 WatchSource:0}: Error finding container a14cae16752f4a8bfe0fc3a02ea38a35ed34d1d21c908bba24722664c24e89c7: Status 404 returned error can't find the container with id a14cae16752f4a8bfe0fc3a02ea38a35ed34d1d21c908bba24722664c24e89c7 Jul 02 16:38:03.596983 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.596959 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7539d518_bc18_431d_998d_4c03ab1327de.slice/crio-06270c06cbcf7ae67c0886d93e5c5263f98d61225152953e8f7efd5e9f4ea806 WatchSource:0}: Error finding container 06270c06cbcf7ae67c0886d93e5c5263f98d61225152953e8f7efd5e9f4ea806: Status 404 returned error can't find the container with id 06270c06cbcf7ae67c0886d93e5c5263f98d61225152953e8f7efd5e9f4ea806 Jul 02 16:38:03.598633 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.598512 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebe5a3d_0884_4400_848a_54bd1677b9ea.slice/crio-6029978ed6f6f20beb0a6124f9edf596a6bab3d6cc51a8dc340adde4b440493f WatchSource:0}: Error finding container 6029978ed6f6f20beb0a6124f9edf596a6bab3d6cc51a8dc340adde4b440493f: Status 404 returned error can't find the container with id 6029978ed6f6f20beb0a6124f9edf596a6bab3d6cc51a8dc340adde4b440493f Jul 02 16:38:03.599408 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.599381 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabae6829_b4a4_4ad6_94ee_3e13d79cfacf.slice/crio-69f9a83f76cb66da7255f910f979156dcdabfbbdf7ae3ab712c5d2b867606f58 WatchSource:0}: Error finding container 69f9a83f76cb66da7255f910f979156dcdabfbbdf7ae3ab712c5d2b867606f58: Status 404 returned error can't find the container with id 69f9a83f76cb66da7255f910f979156dcdabfbbdf7ae3ab712c5d2b867606f58 Jul 02 16:38:03.600800 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.600771 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6e0ce3_8e52_4f9b_be08_416e8a6d249e.slice/crio-5607cf81f277325521cedd2d73f3d0e4bb703424dcfc0cd28cbdf449f43a7341 WatchSource:0}: Error finding container 5607cf81f277325521cedd2d73f3d0e4bb703424dcfc0cd28cbdf449f43a7341: Status 404 returned error can't find the container with id 5607cf81f277325521cedd2d73f3d0e4bb703424dcfc0cd28cbdf449f43a7341 Jul 02 16:38:03.601909 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:03.601880 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62291666_a661_47cf_a1b8_095f89bd9e6f.slice/crio-bf9e49460727534c42e842d21e5a2c70af7fc94b18b81c3b6da16e4c9f25da39 WatchSource:0}: Error finding container bf9e49460727534c42e842d21e5a2c70af7fc94b18b81c3b6da16e4c9f25da39: Status 404 returned error can't find the container with id bf9e49460727534c42e842d21e5a2c70af7fc94b18b81c3b6da16e4c9f25da39 Jul 02 16:38:03.759245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.758992 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:33:02 +0000 UTC" deadline="2028-01-18 15:36:09.110918276 +0000 UTC" Jul 02 16:38:03.759245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.759245 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13558h58m5.351680935s" Jul 02 16:38:03.786297 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.786274 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:03.786423 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:03.786402 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:03.795951 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.795928 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerStarted","Data":"5607cf81f277325521cedd2d73f3d0e4bb703424dcfc0cd28cbdf449f43a7341"} Jul 02 16:38:03.796926 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.796906 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"06270c06cbcf7ae67c0886d93e5c5263f98d61225152953e8f7efd5e9f4ea806"} Jul 02 16:38:03.797791 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.797773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tjd45" event={"ID":"bc7c6227-b11f-4fbe-ab73-bba7c6f80888","Type":"ContainerStarted","Data":"4df7378a278a0c111747f1036dfd62abb03f7dd2680a7395b9db7368a44790b7"} Jul 02 16:38:03.802107 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.802082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" event={"ID":"d6ff253717128a1119568842cc848cc0","Type":"ContainerStarted","Data":"d66f7dfbec408fc3e8935c617fedea87d42ae2084dbe235d5eac9233393f1bc0"} Jul 02 16:38:03.803170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.803152 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t6tvd" event={"ID":"b33ccf49-eb8e-44fc-88cc-5f889ad9515b","Type":"ContainerStarted","Data":"b1908ce80f67431147541fa1e167243925644b6ace63766d5db18b753dceb3c9"} Jul 02 16:38:03.804148 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.804130 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dfzd4" event={"ID":"abae6829-b4a4-4ad6-94ee-3e13d79cfacf","Type":"ContainerStarted","Data":"69f9a83f76cb66da7255f910f979156dcdabfbbdf7ae3ab712c5d2b867606f58"} Jul 02 16:38:03.805066 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.805050 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" event={"ID":"4ebe5a3d-0884-4400-848a-54bd1677b9ea","Type":"ContainerStarted","Data":"6029978ed6f6f20beb0a6124f9edf596a6bab3d6cc51a8dc340adde4b440493f"} Jul 02 16:38:03.806158 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.806139 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95rxm" event={"ID":"f59735cf-2ab8-456e-8264-74fef275a08a","Type":"ContainerStarted","Data":"a14cae16752f4a8bfe0fc3a02ea38a35ed34d1d21c908bba24722664c24e89c7"} Jul 02 16:38:03.807160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.807139 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" event={"ID":"de6629e9-cf67-4039-9676-22fe31eb485a","Type":"ContainerStarted","Data":"b023602b4daab40de0d84b63aff427eea19a1d6668594f37dbd38004053db50f"} Jul 02 16:38:03.808092 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.808074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4nwnt" event={"ID":"62291666-a661-47cf-a1b8-095f89bd9e6f","Type":"ContainerStarted","Data":"bf9e49460727534c42e842d21e5a2c70af7fc94b18b81c3b6da16e4c9f25da39"} Jul 02 16:38:03.820517 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:03.820472 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" podStartSLOduration=2.8204598279999997 podStartE2EDuration="2.820459828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:03.820265461 +0000 UTC m=+3.456188664" watchObservedRunningTime="2026-07-02 16:38:03.820459828 +0000 UTC m=+3.456383030" Jul 02 16:38:04.349729 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.349678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:04.350261 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.349946 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:04.350261 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.350014 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:06.349993428 +0000 UTC m=+5.985916612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:04.450826 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.450783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:04.451011 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.450973 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:04.451070 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.451032 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:06.451015477 +0000 UTC m=+6.086938660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:04.551639 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.551598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:04.551834 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.551819 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:04.551896 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.551841 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:04.551896 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.551854 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:04.551994 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.551910 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:38:06.551893073 +0000 UTC m=+6.187816257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:04.759647 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.759523 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:33:02 +0000 UTC" deadline="2028-01-14 12:35:50.496564451 +0000 UTC" Jul 02 16:38:04.759647 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.759590 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13459h57m45.736978354s" Jul 02 16:38:04.787915 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.787885 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:04.788087 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.788008 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:04.788344 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.788212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:04.788344 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:04.788297 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:04.822710 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.819907 2560 generic.go:356] "Generic (PLEG): container finished" podID="402c77b7f5977081ddde9d48ef88ae9f" containerID="5ebea5672c0c15c13c29afc52a1f27f4542db3b7e459995c149e905ee2f36ae1" exitCode=0 Jul 02 16:38:04.822710 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:04.820744 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" event={"ID":"402c77b7f5977081ddde9d48ef88ae9f","Type":"ContainerDied","Data":"5ebea5672c0c15c13c29afc52a1f27f4542db3b7e459995c149e905ee2f36ae1"} Jul 02 16:38:05.786963 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:05.786924 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:05.787446 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:05.787053 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:05.846210 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:05.845086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" event={"ID":"402c77b7f5977081ddde9d48ef88ae9f","Type":"ContainerStarted","Data":"8408f92a57f33930a4323e5d94fc4dcb4c49f0a79ce2e38d37c74f84a445b694"} Jul 02 16:38:05.862536 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:05.862471 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" podStartSLOduration=4.862450429 podStartE2EDuration="4.862450429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:05.862045724 +0000 UTC m=+5.497968926" watchObservedRunningTime="2026-07-02 16:38:05.862450429 +0000 UTC m=+5.498373633" Jul 02 16:38:06.365984 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:06.365376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:06.365984 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.365561 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:06.365984 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.365622 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:10.365604777 +0000 UTC m=+10.001527971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:06.467239 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:06.466656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:06.467239 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.466834 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:06.467239 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.466898 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:10.466880901 +0000 UTC m=+10.102804088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:06.568547 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:06.567862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:06.568547 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.568072 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:06.568547 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.568092 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:06.568547 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.568106 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:06.568547 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.568164 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:38:10.568145639 +0000 UTC m=+10.204068826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:06.787845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:06.787789 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:06.788307 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.787973 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:06.788307 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:06.788061 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:06.788307 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:06.788181 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:07.786453 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:07.786413 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:07.786653 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:07.786612 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:08.786049 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:08.786013 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:08.786485 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:08.786120 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:08.786485 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:08.786474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:08.786664 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:08.786587 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:09.787228 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:09.786725 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:09.787228 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:09.786867 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:10.400068 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:10.400027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:10.400265 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.400180 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:10.400265 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.400241 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:18.400223751 +0000 UTC m=+18.036146944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:10.501495 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:10.501457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:10.501710 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.501598 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:10.501710 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.501666 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:18.50164657 +0000 UTC m=+18.137569756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:10.602633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:10.602594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:10.602858 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.602805 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:10.602858 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.602834 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:10.602858 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.602849 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:10.603010 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.602918 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:38:18.60289836 +0000 UTC m=+18.238821543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:10.787020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:10.786987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:10.787196 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.787112 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:10.787288 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:10.787264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:10.787620 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:10.787364 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:11.786301 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:11.786257 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:11.786465 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:11.786393 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:12.788347 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:12.787831 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:12.788347 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:12.787861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:12.788347 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:12.787981 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:12.788347 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:12.788054 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:13.786422 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:13.786344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:13.786579 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:13.786478 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:14.786047 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:14.786010 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:14.786487 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:14.786018 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:14.786487 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:14.786131 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:14.786487 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:14.786255 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:15.786531 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:15.786492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:15.786970 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:15.786624 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:16.786782 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:16.786751 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:16.786782 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:16.786767 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:16.787283 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:16.786897 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:16.787283 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:16.787010 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:17.786799 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:17.786755 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:17.787309 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:17.786888 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:18.462998 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:18.462963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:18.463227 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.463145 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:18.463295 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.463228 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:34.463208188 +0000 UTC m=+34.099131373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:18.564030 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:18.563977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:18.564237 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.564138 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:18.564237 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.564214 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:34.564192738 +0000 UTC m=+34.200115941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:18.665191 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:18.665146 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:18.665393 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.665349 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:18.665393 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.665375 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:18.665393 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.665389 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:18.665548 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.665459 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:38:34.665439683 +0000 UTC m=+34.301362882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:18.786701 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:18.786646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:18.786857 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:18.786646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:18.786857 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.786801 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:18.787234 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:18.786854 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:19.786332 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:19.786294 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:19.786523 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:19.786416 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:20.788463 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:20.788432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:20.788879 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:20.788541 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:20.788879 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:20.788598 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:20.788879 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:20.788704 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:21.786935 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:21.786896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:21.787127 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:21.787031 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:22.789329 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:22.789300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:22.789670 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:22.789397 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:22.789670 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:22.789450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:22.789670 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:22.789540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:23.786776 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.786582 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:23.786906 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:23.786847 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:23.880729 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.880547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t6tvd" event={"ID":"b33ccf49-eb8e-44fc-88cc-5f889ad9515b","Type":"ContainerStarted","Data":"37bd54572eedacab34d19bd306585f46165772f58805f6aee6b76fc17f3e2700"} Jul 02 16:38:23.882192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.882164 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" event={"ID":"4ebe5a3d-0884-4400-848a-54bd1677b9ea","Type":"ContainerStarted","Data":"9184eac00099164d4ccb19b7b00fbfb3ec1b6456dc90b77d37f7b738ef8f508e"} Jul 02 16:38:23.883633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.883614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95rxm" event={"ID":"f59735cf-2ab8-456e-8264-74fef275a08a","Type":"ContainerStarted","Data":"03cdf7d8eac470c43ccd9b484ced3e62e4ec1cfceb0683314e0f19816d2b2136"} Jul 02 16:38:23.885393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.885363 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" event={"ID":"de6629e9-cf67-4039-9676-22fe31eb485a","Type":"ContainerStarted","Data":"dd2329f07d627c8c1e503241704838a6fa485a72eb85d59f1f5f9be35afc4487"} Jul 02 16:38:23.886845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.886821 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4nwnt" event={"ID":"62291666-a661-47cf-a1b8-095f89bd9e6f","Type":"ContainerStarted","Data":"4428f2b9b466c696b07e1ea5e6b5f67b72a6f8a3e007e2f2f72974221a28af09"} Jul 02 16:38:23.888322 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.888295 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6e0ce3-8e52-4f9b-be08-416e8a6d249e" containerID="5104e08f362a14503ae3657067f956b327746765852defc0cb0c6845e6d0a2d8" exitCode=0 Jul 02 16:38:23.888439 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.888377 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerDied","Data":"5104e08f362a14503ae3657067f956b327746765852defc0cb0c6845e6d0a2d8"} Jul 02 16:38:23.891905 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.891889 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:38:23.892295 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892279 2560 generic.go:356] "Generic (PLEG): container finished" podID="7539d518-bc18-431d-998d-4c03ab1327de" containerID="56a1d37b4e940477cd98716029206d478ef651ccabb8e6be6ff2e509adf0adee" exitCode=1 Jul 02 16:38:23.892360 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"02cd08e4ce0caaeae66b40ddc1e8b41913af2580a7da2602e7e26f658df4c819"} Jul 02 16:38:23.892410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892394 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"ed4197db4ee3dc4d663f8ba1be87e1fccfb799f110a5e79dd1be85600b409c11"} Jul 02 16:38:23.892450 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"c39bf7b9c523dc1f22331ceaea6058cfd52e98a2d6b3dbbc933279272a0df479"} Jul 02 16:38:23.892493 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"35a01d1b829870a269c5b232e5f0f5cee0aa913a62db4821899c0ad3b697a636"} Jul 02 16:38:23.892532 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892501 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerDied","Data":"56a1d37b4e940477cd98716029206d478ef651ccabb8e6be6ff2e509adf0adee"} Jul 02 16:38:23.892570 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.892540 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"42fff48e918eaa8163ecac07ed4b5c9e2020154186432f33f52692b6d47a202b"} Jul 02 16:38:23.893664 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.893646 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tjd45" event={"ID":"bc7c6227-b11f-4fbe-ab73-bba7c6f80888","Type":"ContainerStarted","Data":"9a6d998d3c9584648ab17bb04aaba0c7529546a755a4e893bbb7781c2cf4c49f"} Jul 02 16:38:23.899592 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.899549 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t6tvd" podStartSLOduration=4.550533718 podStartE2EDuration="23.899531154s" totalImagesPullingTime="19.348997436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.898627295 +0000 UTC m=+23.534550498" watchObservedRunningTime="2026-07-02 16:38:23.899531154 +0000 UTC m=+23.535454354" Jul 02 16:38:23.919199 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.919154 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95rxm" podStartSLOduration=3.5509092730000003 podStartE2EDuration="22.919140917s" totalImagesPullingTime="19.368231644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.918950565 +0000 UTC m=+23.554873761" watchObservedRunningTime="2026-07-02 16:38:23.919140917 +0000 UTC m=+23.555064118" Jul 02 16:38:23.962581 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.962518 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tjd45" podStartSLOduration=4.604675567 podStartE2EDuration="23.962501819s" totalImagesPullingTime="19.357826252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.961947755 +0000 UTC m=+23.597870963" watchObservedRunningTime="2026-07-02 16:38:23.962501819 +0000 UTC m=+23.598425021" Jul 02 16:38:23.979915 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.979849 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4nwnt" podStartSLOduration=9.328520975 podStartE2EDuration="23.979833409s" totalImagesPullingTime="14.651312434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.979216123 +0000 UTC m=+23.615139327" watchObservedRunningTime="2026-07-02 16:38:23.979833409 +0000 UTC m=+23.615756611" Jul 02 16:38:23.995202 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:23.995121 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8xpgq" podStartSLOduration=3.634283017 podStartE2EDuration="22.995104557s" totalImagesPullingTime="19.36082154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.994992338 +0000 UTC m=+23.630915536" watchObservedRunningTime="2026-07-02 16:38:23.995104557 +0000 UTC m=+23.631027762" Jul 02 16:38:24.103554 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.103526 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:24.185496 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.185462 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:24.486268 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.486210 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:24.522391 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.522363 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 16:38:24.586372 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.586334 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:24.771146 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.770994 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T16:38:24.522384905Z","UUID":"e238b62c-d4ec-44ad-b854-725828525f8a","Handler":null,"Name":"","Endpoint":""} Jul 02 16:38:24.773498 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.772734 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 16:38:24.773498 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.772783 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 16:38:24.786341 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.786310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:24.786501 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.786310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:24.786501 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:24.786449 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:24.786616 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:24.786551 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:24.898355 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.898316 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dfzd4" event={"ID":"abae6829-b4a4-4ad6-94ee-3e13d79cfacf","Type":"ContainerStarted","Data":"34cda796c99a6dd8b8cb1e01f90a3f25f44e347f9af09d19263a58258fb44711"} Jul 02 16:38:24.900893 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.900394 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" event={"ID":"4ebe5a3d-0884-4400-848a-54bd1677b9ea","Type":"ContainerStarted","Data":"57aa9f5c467f3621ad64d655d632409c90c4f98d2779da520d3afc6068a418d0"} Jul 02 16:38:24.917179 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:24.917129 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dfzd4" podStartSLOduration=9.263860271 podStartE2EDuration="23.917114326s" totalImagesPullingTime="14.653254055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:24.916444228 +0000 UTC m=+24.552367431" watchObservedRunningTime="2026-07-02 16:38:24.917114326 +0000 UTC m=+24.553037505" Jul 02 16:38:25.288180 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.288094 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:25.615697 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.615610 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:25.616191 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.616164 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:25.681479 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.681440 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:25.736297 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.736265 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:25.786470 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.786438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:25.786643 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:25.786573 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:25.904529 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.904354 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" event={"ID":"4ebe5a3d-0884-4400-848a-54bd1677b9ea","Type":"ContainerStarted","Data":"2ac4d244ac9226a7269f8356c58f5b0145a754242b1a36dbd48e5bce65c80fa7"} Jul 02 16:38:25.920949 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.920922 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:25.921339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.921316 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4nwnt" Jul 02 16:38:25.940266 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:25.940219 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g567p" podStartSLOduration=4.240947249 podStartE2EDuration="25.94020097s" totalImagesPullingTime="21.699253721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:25.940132691 +0000 UTC m=+25.576055894" watchObservedRunningTime="2026-07-02 16:38:25.94020097 +0000 UTC m=+25.576124172" Jul 02 16:38:26.002303 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:26.002277 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:26.786899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:26.786868 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:26.787080 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:26.786867 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:26.787080 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:26.787027 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:26.787195 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:26.787082 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:26.910357 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:26.910327 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:38:26.910843 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:26.910750 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"00bba1a34d4ed2cf97910105ed3f32b9c88e16e7da400bfb04bbf416df4ad104"} Jul 02 16:38:27.786632 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:27.786595 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:27.786860 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:27.786740 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:28.786156 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.785972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:28.786933 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.786023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:28.786933 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:28.786249 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:28.786933 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:28.786339 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:28.917804 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.917767 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6e0ce3-8e52-4f9b-be08-416e8a6d249e" containerID="b5a01d999dda58b8d329e02a5d8c4a55d24455c21def00cf77e3875999d2b501" exitCode=0 Jul 02 16:38:28.917983 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.917845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerDied","Data":"b5a01d999dda58b8d329e02a5d8c4a55d24455c21def00cf77e3875999d2b501"} Jul 02 16:38:28.921336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.921318 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:38:28.921708 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.921671 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"71aef0b29d9493ab9132d7e55cdb9b9a9f5a2a51b374cc622ccf0d2343d9a293"} Jul 02 16:38:28.921938 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.921921 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:28.922038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.921971 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:28.922168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.922153 2560 scope.go:117] "RemoveContainer" containerID="56a1d37b4e940477cd98716029206d478ef651ccabb8e6be6ff2e509adf0adee" Jul 02 16:38:28.937938 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.937921 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:28.948572 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:28.948550 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:29.786907 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:29.786873 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:29.787312 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:29.786999 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:29.931657 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:29.931636 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:38:29.932099 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:29.932071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" event={"ID":"7539d518-bc18-431d-998d-4c03ab1327de","Type":"ContainerStarted","Data":"105a4abd75183cee79f3967cfcba291345bbff52affad4299e7b4e98e2412a22"} Jul 02 16:38:29.932472 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:29.932408 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:29.949431 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:29.949399 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:38:29.961144 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:29.961084 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" podStartSLOduration=10.298150555 podStartE2EDuration="29.961066224s" totalImagesPullingTime="19.662915669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:29.960504926 +0000 UTC m=+29.596428179" watchObservedRunningTime="2026-07-02 16:38:29.961066224 +0000 UTC m=+29.596989425" Jul 02 16:38:30.145041 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.144958 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntprq"] Jul 02 16:38:30.145176 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.145073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:30.145214 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:30.145177 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:30.148038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.147997 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm4nb"] Jul 02 16:38:30.148162 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.148138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:30.148331 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:30.148305 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:30.148605 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.148580 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vnpf"] Jul 02 16:38:30.148737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.148659 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:30.148821 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:30.148801 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:30.936743 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.936475 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6e0ce3-8e52-4f9b-be08-416e8a6d249e" containerID="3397ee679bdbc2789b6e260691ffd563356294b5a2860033ecf743a3afcf4db2" exitCode=0 Jul 02 16:38:30.937178 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:30.936561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerDied","Data":"3397ee679bdbc2789b6e260691ffd563356294b5a2860033ecf743a3afcf4db2"} Jul 02 16:38:31.786326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:31.786292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:31.786519 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:31.786384 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:31.786519 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:31.786301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:31.786519 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:31.786428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:31.786519 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:31.786513 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:31.786668 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:31.786573 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:32.943177 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:32.943147 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6e0ce3-8e52-4f9b-be08-416e8a6d249e" containerID="3e75cacf68a9b6e2e8ea3c09a5852efac9b10f778da05ea9e8e829edaad8ef3f" exitCode=0 Jul 02 16:38:32.943823 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:32.943216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerDied","Data":"3e75cacf68a9b6e2e8ea3c09a5852efac9b10f778da05ea9e8e829edaad8ef3f"} Jul 02 16:38:33.786552 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:33.786512 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:33.786790 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:33.786511 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:33.786790 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:33.786652 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:33.786790 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:33.786512 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:33.786790 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:33.786732 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:33.787043 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:33.786812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:34.485790 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:34.485747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:34.486502 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.485903 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:34.486502 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.485968 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:06.485952389 +0000 UTC m=+66.121875569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:34.586967 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:34.586929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:34.587151 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.587055 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:34.587151 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.587119 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret podName:659cce3e-5ee6-4d9f-8257-43ade29569d3 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:06.587101706 +0000 UTC m=+66.223024885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret") pod "global-pull-secret-syncer-ntprq" (UID: "659cce3e-5ee6-4d9f-8257-43ade29569d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:34.687595 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:34.687556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:34.687785 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.687755 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:34.687785 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.687783 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:34.687877 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.687798 2560 projected.go:196] Error preparing data for projected volume kube-api-access-nzv8s for pod openshift-network-diagnostics/network-check-target-8vnpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:34.687877 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:34.687863 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s podName:cc0f27de-6ce0-4b00-9ac5-58f5863706ac nodeName:}" failed. No retries permitted until 2026-07-02 16:39:06.687844844 +0000 UTC m=+66.323768044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzv8s" (UniqueName: "kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s") pod "network-check-target-8vnpf" (UID: "cc0f27de-6ce0-4b00-9ac5-58f5863706ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:35.486250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:35.486201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:35.546270 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:35.546225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:35.786409 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:35.786381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:35.786409 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:35.786414 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:35.786680 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:35.786381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:35.786680 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:35.786507 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:38:35.786680 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:35.786608 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntprq" podUID="659cce3e-5ee6-4d9f-8257-43ade29569d3" Jul 02 16:38:35.786848 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:35.786730 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vnpf" podUID="cc0f27de-6ce0-4b00-9ac5-58f5863706ac" Jul 02 16:38:36.688628 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.688591 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeReady" Jul 02 16:38:36.689061 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.688780 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 16:38:36.735823 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.735794 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jmb5r"] Jul 02 16:38:36.737902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.737875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:36.738765 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.738744 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5khl7"] Jul 02 16:38:36.740548 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.740527 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:36.740650 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.740619 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 16:38:36.740824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.740799 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 16:38:36.740936 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.740861 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l7cj2\"" Jul 02 16:38:36.743088 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.743066 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 16:38:36.743255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.743230 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 16:38:36.743353 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.743288 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8mdf8\"" Jul 02 16:38:36.743353 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.743329 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 16:38:36.750643 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.750608 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jmb5r"] Jul 02 16:38:36.752550 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.752527 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5khl7"] Jul 02 16:38:36.904107 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.904027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781f91e6-cc13-49a2-a124-5af29a00c296-tmp-dir\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:36.904107 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.904060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/781f91e6-cc13-49a2-a124-5af29a00c296-config-volume\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:36.904107 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.904088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:36.904107 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.904110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ssk\" (UniqueName: \"kubernetes.io/projected/b13050e8-2e3a-43b8-8bdf-7710128fb142-kube-api-access-j6ssk\") pod \"ingress-canary-5khl7\" (UID: \"b13050e8-2e3a-43b8-8bdf-7710128fb142\") " pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:36.904365 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.904127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88t9l\" (UniqueName: \"kubernetes.io/projected/781f91e6-cc13-49a2-a124-5af29a00c296-kube-api-access-88t9l\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:36.904365 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:36.904205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b13050e8-2e3a-43b8-8bdf-7710128fb142-cert\") pod \"ingress-canary-5khl7\" (UID: \"b13050e8-2e3a-43b8-8bdf-7710128fb142\") " pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:37.004570 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781f91e6-cc13-49a2-a124-5af29a00c296-tmp-dir\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.004668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004587 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/781f91e6-cc13-49a2-a124-5af29a00c296-config-volume\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.004668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.004668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ssk\" (UniqueName: \"kubernetes.io/projected/b13050e8-2e3a-43b8-8bdf-7710128fb142-kube-api-access-j6ssk\") pod \"ingress-canary-5khl7\" (UID: \"b13050e8-2e3a-43b8-8bdf-7710128fb142\") " pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:37.004853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88t9l\" (UniqueName: \"kubernetes.io/projected/781f91e6-cc13-49a2-a124-5af29a00c296-kube-api-access-88t9l\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.004853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b13050e8-2e3a-43b8-8bdf-7710128fb142-cert\") pod \"ingress-canary-5khl7\" (UID: \"b13050e8-2e3a-43b8-8bdf-7710128fb142\") " pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:37.004853 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:37.004782 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:37.004853 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:37.004849 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:37.504826659 +0000 UTC m=+37.140749853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:38:37.005047 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.004902 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781f91e6-cc13-49a2-a124-5af29a00c296-tmp-dir\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.005206 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.005176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/781f91e6-cc13-49a2-a124-5af29a00c296-config-volume\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.009415 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.009229 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b13050e8-2e3a-43b8-8bdf-7710128fb142-cert\") pod \"ingress-canary-5khl7\" (UID: \"b13050e8-2e3a-43b8-8bdf-7710128fb142\") " pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:37.013776 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.013729 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88t9l\" (UniqueName: \"kubernetes.io/projected/781f91e6-cc13-49a2-a124-5af29a00c296-kube-api-access-88t9l\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.013776 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.013744 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ssk\" (UniqueName: \"kubernetes.io/projected/b13050e8-2e3a-43b8-8bdf-7710128fb142-kube-api-access-j6ssk\") pod \"ingress-canary-5khl7\" (UID: \"b13050e8-2e3a-43b8-8bdf-7710128fb142\") " pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:37.056713 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.056650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5khl7" Jul 02 16:38:37.191958 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.191855 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5khl7"] Jul 02 16:38:37.195653 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:37.195625 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13050e8_2e3a_43b8_8bdf_7710128fb142.slice/crio-22e64ed9e71c3f686db8b99fca35241d78a40f5cc0ccbf553dfd732595559413 WatchSource:0}: Error finding container 22e64ed9e71c3f686db8b99fca35241d78a40f5cc0ccbf553dfd732595559413: Status 404 returned error can't find the container with id 22e64ed9e71c3f686db8b99fca35241d78a40f5cc0ccbf553dfd732595559413 Jul 02 16:38:37.510847 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.510759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:37.510997 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:37.510873 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:37.510997 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:37.510929 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:38.510915212 +0000 UTC m=+38.146838392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:38:37.786413 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.786378 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:38:37.786962 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.786381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:38:37.786962 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.786381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:38:37.790529 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.790504 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5xkk\"" Jul 02 16:38:37.790668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.790539 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:38:37.790668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.790563 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krqxp\"" Jul 02 16:38:37.790668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.790505 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:38:37.790668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.790662 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:38:37.790904 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.790883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:38:37.959267 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.959237 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6e0ce3-8e52-4f9b-be08-416e8a6d249e" containerID="6935e853750f09f502240b386cc2d1f18c7b4a4ad5b3b77b821b39d039a575ff" exitCode=0 Jul 02 16:38:37.959453 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.959335 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerDied","Data":"6935e853750f09f502240b386cc2d1f18c7b4a4ad5b3b77b821b39d039a575ff"} Jul 02 16:38:37.960836 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:37.960802 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5khl7" event={"ID":"b13050e8-2e3a-43b8-8bdf-7710128fb142","Type":"ContainerStarted","Data":"22e64ed9e71c3f686db8b99fca35241d78a40f5cc0ccbf553dfd732595559413"} Jul 02 16:38:38.518489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:38.518402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:38.518655 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:38.518556 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:38.518655 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:38.518636 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:40.518614778 +0000 UTC m=+40.154537965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:38:38.967228 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:38.967010 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6e0ce3-8e52-4f9b-be08-416e8a6d249e" containerID="c3b73e7b149826b437ddf8c94fa80d0beb9fd86f8b409027007328cfbd48c486" exitCode=0 Jul 02 16:38:38.967719 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:38.967106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerDied","Data":"c3b73e7b149826b437ddf8c94fa80d0beb9fd86f8b409027007328cfbd48c486"} Jul 02 16:38:38.997346 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:38.997312 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:39.056114 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:39.056074 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:39.504774 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:39.502417 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:39.558397 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:39.558361 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:39.970635 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:39.970553 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5khl7" event={"ID":"b13050e8-2e3a-43b8-8bdf-7710128fb142","Type":"ContainerStarted","Data":"d250e92e12b039f2ab0e9a445f1b503b4b551be3feca15220b2076749c924bc7"} Jul 02 16:38:39.973719 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:39.973678 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" event={"ID":"3d6e0ce3-8e52-4f9b-be08-416e8a6d249e","Type":"ContainerStarted","Data":"2867b88cffab0e5d37a5a475f3474e479f61ca322c57a3810df9b692ec3e2c05"} Jul 02 16:38:39.986737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:39.986681 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5khl7" podStartSLOduration=1.699489426 podStartE2EDuration="3.986668111s" totalImagesPullingTime="2.287178685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:39.985856373 +0000 UTC m=+39.621779576" watchObservedRunningTime="2026-07-02 16:38:39.986668111 +0000 UTC m=+39.622591313" Jul 02 16:38:40.009654 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:40.009601 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h9c7m" podStartSLOduration=9.906663694 podStartE2EDuration="40.009581623s" totalImagesPullingTime="30.102917929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:40.009180228 +0000 UTC m=+39.645103433" watchObservedRunningTime="2026-07-02 16:38:40.009581623 +0000 UTC m=+39.645504827" Jul 02 16:38:40.142582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:40.142542 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:40.197814 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:40.197782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:40.532218 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:40.532181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:40.532385 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:40.532328 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:40.532425 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:40.532396 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:44.532378079 +0000 UTC m=+44.168301259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:38:40.900163 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:40.900069 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:41.094956 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:41.094922 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:41.152023 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:41.151940 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:44.561614 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:44.561545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:44.562010 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:44.561706 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:44.562010 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:44.561767 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:52.56174892 +0000 UTC m=+52.197672102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:38:52.616921 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:52.616880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:38:52.617387 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:52.617022 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:52.617387 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:38:52.617081 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:08.61706714 +0000 UTC m=+68.252990320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:38:53.994327 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:53.994296 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5"] Jul 02 16:38:54.012470 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.012440 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.014362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.014335 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5"] Jul 02 16:38:54.016898 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.016875 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 16:38:54.017129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.016901 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 16:38:54.017129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.016910 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mp2sc\"" Jul 02 16:38:54.017309 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.016936 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 16:38:54.017309 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.016956 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 16:38:54.027220 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.027167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx56m\" (UniqueName: \"kubernetes.io/projected/54fe7914-28f7-449f-b276-b6877e37a7bc-kube-api-access-gx56m\") pod \"managed-serviceaccount-addon-agent-f59767dc4-n4rf5\" (UID: \"54fe7914-28f7-449f-b276-b6877e37a7bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.027350 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.027266 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54fe7914-28f7-449f-b276-b6877e37a7bc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f59767dc4-n4rf5\" (UID: \"54fe7914-28f7-449f-b276-b6877e37a7bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.128568 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.128529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx56m\" (UniqueName: \"kubernetes.io/projected/54fe7914-28f7-449f-b276-b6877e37a7bc-kube-api-access-gx56m\") pod \"managed-serviceaccount-addon-agent-f59767dc4-n4rf5\" (UID: \"54fe7914-28f7-449f-b276-b6877e37a7bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.128781 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.128588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54fe7914-28f7-449f-b276-b6877e37a7bc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f59767dc4-n4rf5\" (UID: \"54fe7914-28f7-449f-b276-b6877e37a7bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.132541 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.132516 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54fe7914-28f7-449f-b276-b6877e37a7bc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f59767dc4-n4rf5\" (UID: \"54fe7914-28f7-449f-b276-b6877e37a7bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.137022 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.136998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx56m\" (UniqueName: \"kubernetes.io/projected/54fe7914-28f7-449f-b276-b6877e37a7bc-kube-api-access-gx56m\") pod \"managed-serviceaccount-addon-agent-f59767dc4-n4rf5\" (UID: \"54fe7914-28f7-449f-b276-b6877e37a7bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.339011 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.338977 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" Jul 02 16:38:54.478038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:54.478002 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5"] Jul 02 16:38:54.483017 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:38:54.482993 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54fe7914_28f7_449f_b276_b6877e37a7bc.slice/crio-54e64b86f61f15fd655d58568b30e7afe10628b996d165ed6f2aaa523254064a WatchSource:0}: Error finding container 54e64b86f61f15fd655d58568b30e7afe10628b996d165ed6f2aaa523254064a: Status 404 returned error can't find the container with id 54e64b86f61f15fd655d58568b30e7afe10628b996d165ed6f2aaa523254064a Jul 02 16:38:55.010200 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:55.010155 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" event={"ID":"54fe7914-28f7-449f-b276-b6877e37a7bc","Type":"ContainerStarted","Data":"54e64b86f61f15fd655d58568b30e7afe10628b996d165ed6f2aaa523254064a"} Jul 02 16:38:57.017160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:57.017119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" event={"ID":"54fe7914-28f7-449f-b276-b6877e37a7bc","Type":"ContainerStarted","Data":"30ffa7212f872644663ac65a3ee6c90da84ac5722ff61b9867fe7590f9c9d8df"} Jul 02 16:38:57.034314 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:38:57.034259 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" podStartSLOduration=1.602355353 podStartE2EDuration="4.034241046s" totalImagesPullingTime="2.431885693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:57.033709051 +0000 UTC m=+56.669632245" watchObservedRunningTime="2026-07-02 16:38:57.034241046 +0000 UTC m=+56.670164596" Jul 02 16:39:01.958818 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:01.958785 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvt2w" Jul 02 16:39:01.989910 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:01.989876 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:39:02.071847 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:02.071807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:39:02.162859 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:02.162823 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:39:02.225612 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:02.225515 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:39:06.515115 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.515065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:39:06.518078 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.518059 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:39:06.525539 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:39:06.525513 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 16:39:06.525599 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:39:06.525587 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:40:10.525565169 +0000 UTC m=+130.161488352 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : secret "metrics-daemon-secret" not found Jul 02 16:39:06.615510 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.615473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:39:06.618434 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.618415 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:39:06.627974 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.627949 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/659cce3e-5ee6-4d9f-8257-43ade29569d3-original-pull-secret\") pod \"global-pull-secret-syncer-ntprq\" (UID: \"659cce3e-5ee6-4d9f-8257-43ade29569d3\") " pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:39:06.716296 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.716253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:39:06.719495 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.719479 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:39:06.729952 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.729924 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:39:06.739751 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.739726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzv8s\" (UniqueName: \"kubernetes.io/projected/cc0f27de-6ce0-4b00-9ac5-58f5863706ac-kube-api-access-nzv8s\") pod \"network-check-target-8vnpf\" (UID: \"cc0f27de-6ce0-4b00-9ac5-58f5863706ac\") " pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:39:06.901936 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.901908 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krqxp\"" Jul 02 16:39:06.905178 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.905160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntprq" Jul 02 16:39:06.910065 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:06.910043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:39:07.072950 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:07.072912 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntprq"] Jul 02 16:39:07.091021 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:07.090983 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vnpf"] Jul 02 16:39:07.095032 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:39:07.095003 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0f27de_6ce0_4b00_9ac5_58f5863706ac.slice/crio-fbfc8fed3fb2531c84253925bdd5736bd8e150b6f4bf5995ac3e7e5fef8373f2 WatchSource:0}: Error finding container fbfc8fed3fb2531c84253925bdd5736bd8e150b6f4bf5995ac3e7e5fef8373f2: Status 404 returned error can't find the container with id fbfc8fed3fb2531c84253925bdd5736bd8e150b6f4bf5995ac3e7e5fef8373f2 Jul 02 16:39:08.046795 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:08.046750 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntprq" event={"ID":"659cce3e-5ee6-4d9f-8257-43ade29569d3","Type":"ContainerStarted","Data":"38a755cba8fcbf4ab58e66281e4434c572e33f7456756fe08ff43beae2f00154"} Jul 02 16:39:08.048361 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:08.048299 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vnpf" event={"ID":"cc0f27de-6ce0-4b00-9ac5-58f5863706ac","Type":"ContainerStarted","Data":"fbfc8fed3fb2531c84253925bdd5736bd8e150b6f4bf5995ac3e7e5fef8373f2"} Jul 02 16:39:08.629770 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:08.629730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:39:08.629962 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:39:08.629943 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:39:08.630048 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:39:08.630025 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:40.630000445 +0000 UTC m=+100.265923644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:39:12.060852 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:12.060822 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vnpf" event={"ID":"cc0f27de-6ce0-4b00-9ac5-58f5863706ac","Type":"ContainerStarted","Data":"b7bf12c35ddd7ed1fe3fabbc056adfec0e7d7aecb2e49804f48cf40acadf0fad"} Jul 02 16:39:12.061381 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:12.061024 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:39:12.062343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:12.062323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntprq" event={"ID":"659cce3e-5ee6-4d9f-8257-43ade29569d3","Type":"ContainerStarted","Data":"53f406ee685183200fb3976433b5c8b3425e35c018ba84ab5249e469325b370f"} Jul 02 16:39:12.077164 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:12.077104 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vnpf" podStartSLOduration=67.573757445 podStartE2EDuration="1m12.07708921s" totalImagesPullingTime="4.503331765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:39:12.076635964 +0000 UTC m=+71.712559180" watchObservedRunningTime="2026-07-02 16:39:12.07708921 +0000 UTC m=+71.713012412" Jul 02 16:39:12.092306 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:12.092257 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ntprq" podStartSLOduration=66.566627152 podStartE2EDuration="1m11.092244287s" totalImagesPullingTime="4.525617135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:39:12.091970331 +0000 UTC m=+71.727893535" watchObservedRunningTime="2026-07-02 16:39:12.092244287 +0000 UTC m=+71.728167488" Jul 02 16:39:40.651133 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:40.651072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:39:40.651535 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:39:40.651241 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:39:40.651535 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:39:40.651336 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:40:44.651318701 +0000 UTC m=+164.287241881 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:39:43.066930 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:39:43.066895 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vnpf" Jul 02 16:40:10.556198 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:10.556157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:40:10.556602 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:40:10.556272 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 16:40:10.556602 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:40:10.556349 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs podName:da883743-1e69-40b4-a2a1-239b6548ba35 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:12.556333987 +0000 UTC m=+252.192257179 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs") pod "network-metrics-daemon-rm4nb" (UID: "da883743-1e69-40b4-a2a1-239b6548ba35") : secret "metrics-daemon-secret" not found Jul 02 16:40:39.749833 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:40:39.749792 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jmb5r" podUID="781f91e6-cc13-49a2-a124-5af29a00c296" Jul 02 16:40:40.268534 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:40.268499 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmb5r" Jul 02 16:40:40.810792 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:40:40.810743 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rm4nb" podUID="da883743-1e69-40b4-a2a1-239b6548ba35" Jul 02 16:40:44.686614 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:44.686576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:40:44.687010 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:40:44.686713 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:40:44.687010 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:40:44.686781 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls podName:781f91e6-cc13-49a2-a124-5af29a00c296 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:46.686764298 +0000 UTC m=+286.322687479 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls") pod "dns-default-jmb5r" (UID: "781f91e6-cc13-49a2-a124-5af29a00c296") : secret "dns-default-metrics-tls" not found Jul 02 16:40:53.786342 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:53.786256 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:40:57.311155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:57.311062 2560 generic.go:356] "Generic (PLEG): container finished" podID="54fe7914-28f7-449f-b276-b6877e37a7bc" containerID="30ffa7212f872644663ac65a3ee6c90da84ac5722ff61b9867fe7590f9c9d8df" exitCode=255 Jul 02 16:40:57.311155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:57.311126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" event={"ID":"54fe7914-28f7-449f-b276-b6877e37a7bc","Type":"ContainerDied","Data":"30ffa7212f872644663ac65a3ee6c90da84ac5722ff61b9867fe7590f9c9d8df"} Jul 02 16:40:57.316813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:57.316797 2560 scope.go:117] "RemoveContainer" containerID="30ffa7212f872644663ac65a3ee6c90da84ac5722ff61b9867fe7590f9c9d8df" Jul 02 16:40:58.315651 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:40:58.315612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f59767dc4-n4rf5" event={"ID":"54fe7914-28f7-449f-b276-b6877e37a7bc","Type":"ContainerStarted","Data":"5bbf5d999b98763a223ca06f1975f3cb3ad4de932ade53ce4733d700d2ff3368"} Jul 02 16:41:08.826085 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:08.826057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:38.524409 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.524375 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7756654f9c-m96zj"] Jul 02 16:41:38.526285 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.526260 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.530526 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.530501 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 16:41:38.530715 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.530673 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 16:41:38.530806 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.530795 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 16:41:38.530958 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.530873 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zcnkb\"" Jul 02 16:41:38.530958 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.530952 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 16:41:38.531650 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.531629 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 16:41:38.531924 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.531907 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 16:41:38.545493 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.545470 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7756654f9c-m96zj"] Jul 02 16:41:38.602468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.602434 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh"] Jul 02 16:41:38.604207 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.604191 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.606803 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.606774 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 16:41:38.606910 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.606833 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 16:41:38.606968 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.606780 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:41:38.606968 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.606932 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 16:41:38.606968 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.606943 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8nk26\"" Jul 02 16:41:38.610577 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.610561 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr"] Jul 02 16:41:38.612489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.612473 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5"] Jul 02 16:41:38.612625 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.612605 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.614008 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.613992 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62"] Jul 02 16:41:38.614108 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.614051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" Jul 02 16:41:38.615280 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.615261 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 16:41:38.615395 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.615360 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6rjf6\"" Jul 02 16:41:38.615819 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.615797 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 16:41:38.615939 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.615823 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 16:41:38.615939 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.615929 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:41:38.616399 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.616180 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85c94b6c84-r7d95"] Jul 02 16:41:38.617193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.616621 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 16:41:38.617193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.616636 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-htq5v\"" Jul 02 16:41:38.617193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.616623 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.617193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.616878 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:41:38.618049 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.618032 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh"] Jul 02 16:41:38.618158 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.618106 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.619412 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.619391 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2mjkt\"" Jul 02 16:41:38.621139 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.621115 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 16:41:38.621245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.621143 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 16:41:38.621245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.621171 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 16:41:38.621245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.621210 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 16:41:38.621245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.621126 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 16:41:38.622424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.622363 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 16:41:38.622424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.622394 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 16:41:38.622713 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.622470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgh7x\"" Jul 02 16:41:38.624741 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.624718 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr"] Jul 02 16:41:38.627706 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.627669 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5"] Jul 02 16:41:38.628429 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.628408 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 16:41:38.628811 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.628792 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62"] Jul 02 16:41:38.629920 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.629897 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c94b6c84-r7d95"] Jul 02 16:41:38.648608 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56116f10-8b55-417d-8f6e-19ee3a305460-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.648798 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56116f10-8b55-417d-8f6e-19ee3a305460-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.648798 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-default-certificate\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.648798 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84pp6\" (UniqueName: \"kubernetes.io/projected/56116f10-8b55-417d-8f6e-19ee3a305460-kube-api-access-84pp6\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.648798 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-stats-auth\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.648798 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9lcj\" (UniqueName: \"kubernetes.io/projected/297bc4ac-108f-4ecd-a48f-85c78933e417-kube-api-access-z9lcj\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.649009 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.649009 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.648841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.750231 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv6rx\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-kube-api-access-zv6rx\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750231 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84pp6\" (UniqueName: \"kubernetes.io/projected/56116f10-8b55-417d-8f6e-19ee3a305460-kube-api-access-84pp6\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-installation-pull-secrets\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-image-registry-private-configuration\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9lcj\" (UniqueName: \"kubernetes.io/projected/297bc4ac-108f-4ecd-a48f-85c78933e417-kube-api-access-z9lcj\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750329 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-ca-trust-extracted\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79sv6\" (UniqueName: \"kubernetes.io/projected/fece07cd-ca98-4ea6-b924-47fbd03e6728-kube-api-access-79sv6\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-certificates\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56116f10-8b55-417d-8f6e-19ee3a305460-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.750524 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:39.250511042 +0000 UTC m=+218.886434255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : configmap references non-existent config key: service-ca.crt Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-default-certificate\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zlrz\" (UniqueName: \"kubernetes.io/projected/1ee1956e-ed0e-460e-90f4-0231c5f4b46f-kube-api-access-4zlrz\") pod \"volume-data-source-validator-69d9f679db-s68k5\" (UID: \"1ee1956e-ed0e-460e-90f4-0231c5f4b46f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/70d865ab-e514-46a8-873d-cce6c047b5e7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-stats-auth\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fece07cd-ca98-4ea6-b924-47fbd03e6728-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-trusted-ca\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.750834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-bound-sa-token\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fece07cd-ca98-4ea6-b924-47fbd03e6728-config\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750927 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rg2\" (UniqueName: \"kubernetes.io/projected/70d865ab-e514-46a8-873d-cce6c047b5e7-kube-api-access-87rg2\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.750958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56116f10-8b55-417d-8f6e-19ee3a305460-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.750980 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.751067 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:39.251048476 +0000 UTC m=+218.886971678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : secret "router-metrics-certs-default" not found Jul 02 16:41:38.751250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.751168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56116f10-8b55-417d-8f6e-19ee3a305460-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.752564 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.752534 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:38.753412 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.753392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56116f10-8b55-417d-8f6e-19ee3a305460-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.753494 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.753443 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-stats-auth\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.753557 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.753543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-default-certificate\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.759350 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.759326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9lcj\" (UniqueName: \"kubernetes.io/projected/297bc4ac-108f-4ecd-a48f-85c78933e417-kube-api-access-z9lcj\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:38.759990 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.759970 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84pp6\" (UniqueName: \"kubernetes.io/projected/56116f10-8b55-417d-8f6e-19ee3a305460-kube-api-access-84pp6\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qrtkh\" (UID: \"56116f10-8b55-417d-8f6e-19ee3a305460\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.851546 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87rg2\" (UniqueName: \"kubernetes.io/projected/70d865ab-e514-46a8-873d-cce6c047b5e7-kube-api-access-87rg2\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.851767 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv6rx\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-kube-api-access-zv6rx\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.851767 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-installation-pull-secrets\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.851767 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851646 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-image-registry-private-configuration\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.851767 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-ca-trust-extracted\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.851992 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79sv6\" (UniqueName: \"kubernetes.io/projected/fece07cd-ca98-4ea6-b924-47fbd03e6728-kube-api-access-79sv6\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.851992 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-certificates\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.851992 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.851992 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.851965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlrz\" (UniqueName: \"kubernetes.io/projected/1ee1956e-ed0e-460e-90f4-0231c5f4b46f-kube-api-access-4zlrz\") pod \"volume-data-source-validator-69d9f679db-s68k5\" (UID: \"1ee1956e-ed0e-460e-90f4-0231c5f4b46f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/70d865ab-e514-46a8-873d-cce6c047b5e7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fece07cd-ca98-4ea6-b924-47fbd03e6728-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.852075 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-trusted-ca\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.852091 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c94b6c84-r7d95: secret "image-registry-tls" not found Jul 02 16:41:38.852202 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.852179 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls podName:21e5d5b7-23e9-433c-869e-5e4ff9aa90a7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:39.352161476 +0000 UTC m=+218.988084677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls") pod "image-registry-85c94b6c84-r7d95" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7") : secret "image-registry-tls" not found Jul 02 16:41:38.852559 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.852095 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:38.852559 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:38.852394 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls podName:70d865ab-e514-46a8-873d-cce6c047b5e7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:39.352375381 +0000 UTC m=+218.988298561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-qht62" (UID: "70d865ab-e514-46a8-873d-cce6c047b5e7") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:38.852559 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-bound-sa-token\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.852559 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fece07cd-ca98-4ea6-b924-47fbd03e6728-config\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.852559 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852513 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-certificates\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.852938 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.852906 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/70d865ab-e514-46a8-873d-cce6c047b5e7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.853043 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.853023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-ca-trust-extracted\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.853198 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.853059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fece07cd-ca98-4ea6-b924-47fbd03e6728-config\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.853362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.853340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-trusted-ca\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.853731 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.853703 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:38.854885 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.854867 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fece07cd-ca98-4ea6-b924-47fbd03e6728-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.855070 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.855049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-image-registry-private-configuration\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.855184 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.855167 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-installation-pull-secrets\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.861649 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.861624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-bound-sa-token\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.861999 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.861975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv6rx\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-kube-api-access-zv6rx\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:38.862083 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.862029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zlrz\" (UniqueName: \"kubernetes.io/projected/1ee1956e-ed0e-460e-90f4-0231c5f4b46f-kube-api-access-4zlrz\") pod \"volume-data-source-validator-69d9f679db-s68k5\" (UID: \"1ee1956e-ed0e-460e-90f4-0231c5f4b46f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" Jul 02 16:41:38.862326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.862308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rg2\" (UniqueName: \"kubernetes.io/projected/70d865ab-e514-46a8-873d-cce6c047b5e7-kube-api-access-87rg2\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:38.862643 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.862627 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79sv6\" (UniqueName: \"kubernetes.io/projected/fece07cd-ca98-4ea6-b924-47fbd03e6728-kube-api-access-79sv6\") pod \"service-ca-operator-5d7b7dc95c-dh9lr\" (UID: \"fece07cd-ca98-4ea6-b924-47fbd03e6728\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.913116 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.913067 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" Jul 02 16:41:38.923356 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.923329 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" Jul 02 16:41:38.932734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:38.932679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" Jul 02 16:41:39.070809 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.070777 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh"] Jul 02 16:41:39.073789 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:41:39.073756 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56116f10_8b55_417d_8f6e_19ee3a305460.slice/crio-d7c86550cf1c36f890c957179a34a090bb6f67b39b99d1847f8b83aac4c674af WatchSource:0}: Error finding container d7c86550cf1c36f890c957179a34a090bb6f67b39b99d1847f8b83aac4c674af: Status 404 returned error can't find the container with id d7c86550cf1c36f890c957179a34a090bb6f67b39b99d1847f8b83aac4c674af Jul 02 16:41:39.075880 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.075824 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr"] Jul 02 16:41:39.079320 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:41:39.079296 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfece07cd_ca98_4ea6_b924_47fbd03e6728.slice/crio-006606034dd610d0733c955a752174325f2bd2cd3b4b99654f0e057c5eb70202 WatchSource:0}: Error finding container 006606034dd610d0733c955a752174325f2bd2cd3b4b99654f0e057c5eb70202: Status 404 returned error can't find the container with id 006606034dd610d0733c955a752174325f2bd2cd3b4b99654f0e057c5eb70202 Jul 02 16:41:39.091992 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.091963 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5"] Jul 02 16:41:39.097375 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:41:39.097346 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee1956e_ed0e_460e_90f4_0231c5f4b46f.slice/crio-355aabe2c14e71b9cf056393568dd2425ef34347f3da0bbd226fdcf001203d6a WatchSource:0}: Error finding container 355aabe2c14e71b9cf056393568dd2425ef34347f3da0bbd226fdcf001203d6a: Status 404 returned error can't find the container with id 355aabe2c14e71b9cf056393568dd2425ef34347f3da0bbd226fdcf001203d6a Jul 02 16:41:39.256114 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.256011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:39.256114 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.256101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:39.256316 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.256188 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:40.256164226 +0000 UTC m=+219.892087420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : configmap references non-existent config key: service-ca.crt Jul 02 16:41:39.256316 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.256192 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:41:39.256316 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.256227 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:40.256219999 +0000 UTC m=+219.892143180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : secret "router-metrics-certs-default" not found Jul 02 16:41:39.356737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.356678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:39.356903 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.356744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:39.356903 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.356842 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:41:39.356903 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.356867 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c94b6c84-r7d95: secret "image-registry-tls" not found Jul 02 16:41:39.356903 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.356894 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:39.357026 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.356925 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls podName:21e5d5b7-23e9-433c-869e-5e4ff9aa90a7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:40.356910117 +0000 UTC m=+219.992833312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls") pod "image-registry-85c94b6c84-r7d95" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7") : secret "image-registry-tls" not found Jul 02 16:41:39.357026 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:39.356945 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls podName:70d865ab-e514-46a8-873d-cce6c047b5e7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:40.356931466 +0000 UTC m=+219.992854645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-qht62" (UID: "70d865ab-e514-46a8-873d-cce6c047b5e7") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:39.431052 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.431019 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" event={"ID":"1ee1956e-ed0e-460e-90f4-0231c5f4b46f","Type":"ContainerStarted","Data":"355aabe2c14e71b9cf056393568dd2425ef34347f3da0bbd226fdcf001203d6a"} Jul 02 16:41:39.433113 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.432497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" event={"ID":"fece07cd-ca98-4ea6-b924-47fbd03e6728","Type":"ContainerStarted","Data":"006606034dd610d0733c955a752174325f2bd2cd3b4b99654f0e057c5eb70202"} Jul 02 16:41:39.437179 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:39.437140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" event={"ID":"56116f10-8b55-417d-8f6e-19ee3a305460","Type":"ContainerStarted","Data":"d7c86550cf1c36f890c957179a34a090bb6f67b39b99d1847f8b83aac4c674af"} Jul 02 16:41:40.265277 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:40.265233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:40.265785 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:40.265347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:40.265785 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.265430 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:42.265409001 +0000 UTC m=+221.901332181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : configmap references non-existent config key: service-ca.crt Jul 02 16:41:40.265785 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.265483 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:41:40.265785 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.265542 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:42.265524981 +0000 UTC m=+221.901448161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : secret "router-metrics-certs-default" not found Jul 02 16:41:40.366151 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:40.366112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:40.366151 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:40.366163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:40.366403 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.366285 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:40.366403 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.366301 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:41:40.366403 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.366325 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c94b6c84-r7d95: secret "image-registry-tls" not found Jul 02 16:41:40.366403 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.366346 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls podName:70d865ab-e514-46a8-873d-cce6c047b5e7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:42.366327541 +0000 UTC m=+222.002250736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-qht62" (UID: "70d865ab-e514-46a8-873d-cce6c047b5e7") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:40.366403 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:40.366378 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls podName:21e5d5b7-23e9-433c-869e-5e4ff9aa90a7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:42.366359914 +0000 UTC m=+222.002283106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls") pod "image-registry-85c94b6c84-r7d95" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7") : secret "image-registry-tls" not found Jul 02 16:41:41.448642 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:41.448606 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" event={"ID":"1ee1956e-ed0e-460e-90f4-0231c5f4b46f","Type":"ContainerStarted","Data":"3e4a6c418c5dfa31012f7f3efab7f80ab4fd5be0188c849871c83d0b1e2365c5"} Jul 02 16:41:41.464947 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:41.464893 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68k5" podStartSLOduration=1.784517227 podStartE2EDuration="3.464873867s" totalImagesPullingTime="1.68035664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:41:41.463015991 +0000 UTC m=+221.098939213" watchObservedRunningTime="2026-07-02 16:41:41.464873867 +0000 UTC m=+221.100797050" Jul 02 16:41:41.536810 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:41.536754 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:41.589047 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:41.589012 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:42.283126 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.283102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:42.283240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.283153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:42.283306 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.283253 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:46.283235134 +0000 UTC m=+225.919158315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : configmap references non-existent config key: service-ca.crt Jul 02 16:41:42.283306 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.283258 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:41:42.283397 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.283314 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:46.283297899 +0000 UTC m=+225.919221096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : secret "router-metrics-certs-default" not found Jul 02 16:41:42.384396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.384356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:42.384605 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.384416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:42.384605 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.384478 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:41:42.384605 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.384502 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c94b6c84-r7d95: secret "image-registry-tls" not found Jul 02 16:41:42.384605 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.384522 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:42.384605 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.384562 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls podName:21e5d5b7-23e9-433c-869e-5e4ff9aa90a7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:46.384541328 +0000 UTC m=+226.020464508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls") pod "image-registry-85c94b6c84-r7d95" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7") : secret "image-registry-tls" not found Jul 02 16:41:42.384605 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:42.384579 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls podName:70d865ab-e514-46a8-873d-cce6c047b5e7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:46.384571441 +0000 UTC m=+226.020494625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-qht62" (UID: "70d865ab-e514-46a8-873d-cce6c047b5e7") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:42.453874 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.453832 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" event={"ID":"fece07cd-ca98-4ea6-b924-47fbd03e6728","Type":"ContainerStarted","Data":"3127a82f67345cae7b1cbffa1c14ccb265f1b193ff902091ed95570772634f39"} Jul 02 16:41:42.455419 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.455395 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" event={"ID":"56116f10-8b55-417d-8f6e-19ee3a305460","Type":"ContainerStarted","Data":"27a998d236feb3b789b0ed240be25da82e9c9c91cc1c2a60d1beba901cf2d17b"} Jul 02 16:41:42.469160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.469109 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" podStartSLOduration=1.282349938 podStartE2EDuration="4.469094931s" totalImagesPullingTime="3.186744993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:41:42.46827795 +0000 UTC m=+222.104201153" watchObservedRunningTime="2026-07-02 16:41:42.469094931 +0000 UTC m=+222.105018110" Jul 02 16:41:42.483294 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:42.483247 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" podStartSLOduration=1.292508384 podStartE2EDuration="4.483231476s" totalImagesPullingTime="3.190723092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:41:42.483153187 +0000 UTC m=+222.119076391" watchObservedRunningTime="2026-07-02 16:41:42.483231476 +0000 UTC m=+222.119154702" Jul 02 16:41:43.151218 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.151183 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:43.217579 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.217535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:43.279446 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.279411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:43.386756 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.386714 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:43.439309 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.439235 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:43.825468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.825433 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:43.878097 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:43.878068 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:44.091500 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.091416 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h9zg8"] Jul 02 16:41:44.094015 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.093989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.096607 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.096584 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 16:41:44.096768 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.096735 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 16:41:44.096859 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.096765 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 16:41:44.097021 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.097006 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 16:41:44.097965 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.097947 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2cr9q\"" Jul 02 16:41:44.106901 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.106873 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h9zg8"] Jul 02 16:41:44.109563 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.109534 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:44.165751 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.165711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:44.199158 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.199120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd496151-7624-4dde-9e1e-8023c1c42457-crio-socket\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.199254 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.199173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.199254 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.199233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.199321 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.199283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjpx\" (UniqueName: \"kubernetes.io/projected/cd496151-7624-4dde-9e1e-8023c1c42457-kube-api-access-pjjpx\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.199369 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.199319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd496151-7624-4dde-9e1e-8023c1c42457-data-volume\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300135 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjpx\" (UniqueName: \"kubernetes.io/projected/cd496151-7624-4dde-9e1e-8023c1c42457-kube-api-access-pjjpx\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300135 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd496151-7624-4dde-9e1e-8023c1c42457-data-volume\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd496151-7624-4dde-9e1e-8023c1c42457-crio-socket\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300321 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd496151-7624-4dde-9e1e-8023c1c42457-crio-socket\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.300362 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.300329 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:41:44.300598 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.300341 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:44.300598 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.300419 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:44.800397631 +0000 UTC m=+224.436320822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : configmap "kube-rbac-proxy" not found Jul 02 16:41:44.300598 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.300452 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:44.80044017 +0000 UTC m=+224.436363354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:44.300598 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.300478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd496151-7624-4dde-9e1e-8023c1c42457-data-volume\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.310439 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.310407 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjpx\" (UniqueName: \"kubernetes.io/projected/cd496151-7624-4dde-9e1e-8023c1c42457-kube-api-access-pjjpx\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.805764 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.805724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.805764 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:44.805767 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:44.805982 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.805841 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:41:44.805982 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.805878 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:44.805982 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.805919 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:45.805903698 +0000 UTC m=+225.441826878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : configmap "kube-rbac-proxy" not found Jul 02 16:41:44.805982 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:44.805934 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:45.805928359 +0000 UTC m=+225.441851539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:45.722146 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:45.722109 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:45.778085 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:45.778053 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:45.814748 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:45.814720 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:45.814885 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:45.814758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:45.814885 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:45.814845 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:41:45.814963 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:45.814890 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:45.814963 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:45.814900 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:47.814885909 +0000 UTC m=+227.450809089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : configmap "kube-rbac-proxy" not found Jul 02 16:41:45.814963 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:45.814932 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:47.81492064 +0000 UTC m=+227.450843820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:45.981545 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:45.981462 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:46.318050 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:46.318003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:46.318213 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:46.318109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:46.318213 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.318150 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:41:46.318213 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.318213 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:54.318197095 +0000 UTC m=+233.954120276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : secret "router-metrics-certs-default" not found Jul 02 16:41:46.318323 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.318247 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:54.318236032 +0000 UTC m=+233.954159212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : configmap references non-existent config key: service-ca.crt Jul 02 16:41:46.419032 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:46.418982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:46.419032 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:46.419036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:46.419241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.419125 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:46.419241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.419137 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:41:46.419241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.419154 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c94b6c84-r7d95: secret "image-registry-tls" not found Jul 02 16:41:46.419241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.419178 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls podName:70d865ab-e514-46a8-873d-cce6c047b5e7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:54.419165797 +0000 UTC m=+234.055088980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-qht62" (UID: "70d865ab-e514-46a8-873d-cce6c047b5e7") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:46.419241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:46.419198 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls podName:21e5d5b7-23e9-433c-869e-5e4ff9aa90a7 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:54.419185995 +0000 UTC m=+234.055109201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls") pod "image-registry-85c94b6c84-r7d95" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7") : secret "image-registry-tls" not found Jul 02 16:41:46.594063 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:46.593979 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:47.089261 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:47.089233 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tjd45_bc7c6227-b11f-4fbe-ab73-bba7c6f80888/dns-node-resolver/0.log" Jul 02 16:41:47.311283 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:47.311246 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:47.830307 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:47.830261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:47.830522 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:47.830379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:47.830522 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:47.830442 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:47.830645 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:47.830523 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:51.830503236 +0000 UTC m=+231.466426416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:47.830897 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:47.830877 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd496151-7624-4dde-9e1e-8023c1c42457-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:48.089306 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:48.089225 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t6tvd_b33ccf49-eb8e-44fc-88cc-5f889ad9515b/node-ca/0.log" Jul 02 16:41:48.490449 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:48.490369 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5khl7_b13050e8-2e3a-43b8-8bdf-7710128fb142/serve-healthcheck-canary/0.log" Jul 02 16:41:49.246450 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.246413 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:49.347648 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.347614 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:49.456200 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.456156 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:49.492346 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.492320 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qrtkh_56116f10-8b55-417d-8f6e-19ee3a305460/kube-storage-version-migrator-operator/0.log" Jul 02 16:41:49.555598 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.555572 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:49.657197 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.657159 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:49.757335 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.757301 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:49.856465 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:49.856377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:50.351212 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:50.351171 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:50.751181 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:50.751098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:51.139479 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:51.139447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:51.344700 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:51.344664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:51.539205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:51.539173 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:51.865903 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:51.865807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:51.866057 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:51.865954 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:51.866057 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:51.866018 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls podName:cd496151-7624-4dde-9e1e-8023c1c42457 nodeName:}" failed. No retries permitted until 2026-07-02 16:41:59.866002699 +0000 UTC m=+239.501925879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h9zg8" (UID: "cd496151-7624-4dde-9e1e-8023c1c42457") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:52.543346 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:52.543310 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:52.971801 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:52.971714 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:53.075464 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:53.075430 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:53.174927 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:53.174885 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:53.274674 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:53.274591 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:53.374946 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:53.374908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:53.435100 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:53.435067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:53.745173 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:53.745079 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:54.143604 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.143559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:54.386612 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.386569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:54.386807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.386678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:54.386807 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:54.386757 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle podName:297bc4ac-108f-4ecd-a48f-85c78933e417 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:10.386735047 +0000 UTC m=+250.022658250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle") pod "router-default-7756654f9c-m96zj" (UID: "297bc4ac-108f-4ecd-a48f-85c78933e417") : configmap references non-existent config key: service-ca.crt Jul 02 16:41:54.389209 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.389178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297bc4ac-108f-4ecd-a48f-85c78933e417-metrics-certs\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:41:54.487218 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.487136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:54.487218 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.487175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:41:54.487417 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:54.487263 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:54.487417 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:41:54.487317 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls podName:70d865ab-e514-46a8-873d-cce6c047b5e7 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:10.487302527 +0000 UTC m=+250.123225709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-qht62" (UID: "70d865ab-e514-46a8-873d-cce6c047b5e7") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:41:54.489734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.489715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"image-registry-85c94b6c84-r7d95\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:54.543517 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.543480 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:54.672207 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.672174 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c94b6c84-r7d95"] Jul 02 16:41:54.675458 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:41:54.675429 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e5d5b7_23e9_433c_869e_5e4ff9aa90a7.slice/crio-972d8d2ab07d9e4c1f437dc5800e415c63b045122f0a0261576a84790a78c393 WatchSource:0}: Error finding container 972d8d2ab07d9e4c1f437dc5800e415c63b045122f0a0261576a84790a78c393: Status 404 returned error can't find the container with id 972d8d2ab07d9e4c1f437dc5800e415c63b045122f0a0261576a84790a78c393 Jul 02 16:41:54.739934 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:54.739867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:55.338890 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.338850 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:55.492961 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.492926 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" event={"ID":"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7","Type":"ContainerStarted","Data":"6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4"} Jul 02 16:41:55.493121 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.492974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" event={"ID":"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7","Type":"ContainerStarted","Data":"972d8d2ab07d9e4c1f437dc5800e415c63b045122f0a0261576a84790a78c393"} Jul 02 16:41:55.493121 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.493049 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:41:55.514953 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.514912 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" podStartSLOduration=17.514897985 podStartE2EDuration="17.514897985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:41:55.514149037 +0000 UTC m=+235.150072243" watchObservedRunningTime="2026-07-02 16:41:55.514897985 +0000 UTC m=+235.150821187" Jul 02 16:41:55.537181 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.537155 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:55.746724 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.746621 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:55.801255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:55.801223 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:56.145006 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:56.144972 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:56.745492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:56.745448 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:57.135779 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:57.135737 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:57.341175 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:57.341137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:57.751246 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:57.751207 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:58.144409 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:58.144374 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:58.742549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:58.742519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:59.142254 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:59.142212 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:59.546626 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:59.546598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:59.741609 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:59.741578 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:41:59.932059 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:59.931973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:59.934700 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:59.934660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd496151-7624-4dde-9e1e-8023c1c42457-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9zg8\" (UID: \"cd496151-7624-4dde-9e1e-8023c1c42457\") " pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:41:59.940869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:41:59.940839 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:00.003541 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:00.003503 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h9zg8" Jul 02 16:42:00.126617 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:00.126589 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h9zg8"] Jul 02 16:42:00.129742 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:00.129717 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd496151_7624_4dde_9e1e_8023c1c42457.slice/crio-435957c7cd3c921d856a3ed3911030ebe677b7d1beee398e769f4d11d4fd520a WatchSource:0}: Error finding container 435957c7cd3c921d856a3ed3911030ebe677b7d1beee398e769f4d11d4fd520a: Status 404 returned error can't find the container with id 435957c7cd3c921d856a3ed3911030ebe677b7d1beee398e769f4d11d4fd520a Jul 02 16:42:00.508260 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:00.508223 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9zg8" event={"ID":"cd496151-7624-4dde-9e1e-8023c1c42457","Type":"ContainerStarted","Data":"435957c7cd3c921d856a3ed3911030ebe677b7d1beee398e769f4d11d4fd520a"} Jul 02 16:42:01.623544 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:01.623506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:01.678343 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:01.678304 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:04.523634 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:04.523599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9zg8" event={"ID":"cd496151-7624-4dde-9e1e-8023c1c42457","Type":"ContainerStarted","Data":"81a6be58964e807c4cb07524e6452bdca8e45b7747cbc0e8b3170d782aadb8c3"} Jul 02 16:42:05.225327 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.225289 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:05.326338 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.326275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:05.529065 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.529027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9zg8" event={"ID":"cd496151-7624-4dde-9e1e-8023c1c42457","Type":"ContainerStarted","Data":"d7059c600dbff8cdafbbf47ca0f503f05e0aa10550421568ea90c2a6b0764d26"} Jul 02 16:42:05.696954 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.696886 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:05.755521 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.755484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:05.890405 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.890303 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:05.990614 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:05.990558 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:06.317678 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:06.317641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:06.372894 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:06.372857 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:06.904900 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:06.904863 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:07.114781 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:07.114712 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:07.126813 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:07.126787 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c94b6c84-r7d95"] Jul 02 16:42:07.207734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:07.207626 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:07.308910 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:07.308887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:07.538304 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:07.538268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9zg8" event={"ID":"cd496151-7624-4dde-9e1e-8023c1c42457","Type":"ContainerStarted","Data":"a8ff48df2c1c11ab6ada0218ed724221e3b53f9a5308d6855d772c3f794ce203"} Jul 02 16:42:07.555359 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:07.555314 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h9zg8" podStartSLOduration=16.584233094 podStartE2EDuration="23.555298118s" totalImagesPullingTime="6.971065024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:41:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:07.55450463 +0000 UTC m=+247.190427834" watchObservedRunningTime="2026-07-02 16:42:07.555298118 +0000 UTC m=+247.191221320" Jul 02 16:42:10.375180 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.375143 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:10.414036 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.414012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:10.414591 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.414573 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/297bc4ac-108f-4ecd-a48f-85c78933e417-service-ca-bundle\") pod \"router-default-7756654f9c-m96zj\" (UID: \"297bc4ac-108f-4ecd-a48f-85c78933e417\") " pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:10.478494 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.478459 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:10.514829 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.514805 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:42:10.517265 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.517243 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d865ab-e514-46a8-873d-cce6c047b5e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-qht62\" (UID: \"70d865ab-e514-46a8-873d-cce6c047b5e7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:42:10.639331 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.639266 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zcnkb\"" Jul 02 16:42:10.646487 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.646471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:10.741776 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.741754 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2mjkt\"" Jul 02 16:42:10.750082 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.750051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" Jul 02 16:42:10.777410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.776173 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7756654f9c-m96zj"] Jul 02 16:42:10.781460 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:10.781435 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297bc4ac_108f_4ecd_a48f_85c78933e417.slice/crio-f9dec13cb79d5b7af867d20a2fc55c08cb79fed1746bf9d2db01fdb58c666d74 WatchSource:0}: Error finding container f9dec13cb79d5b7af867d20a2fc55c08cb79fed1746bf9d2db01fdb58c666d74: Status 404 returned error can't find the container with id f9dec13cb79d5b7af867d20a2fc55c08cb79fed1746bf9d2db01fdb58c666d74 Jul 02 16:42:10.885978 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:10.885838 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62"] Jul 02 16:42:10.888607 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:10.888573 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d865ab_e514_46a8_873d_cce6c047b5e7.slice/crio-4c4b8249c309ec084b3641a95f394de4cf43f3b8335cdbd15c8c2db162bea4cf WatchSource:0}: Error finding container 4c4b8249c309ec084b3641a95f394de4cf43f3b8335cdbd15c8c2db162bea4cf: Status 404 returned error can't find the container with id 4c4b8249c309ec084b3641a95f394de4cf43f3b8335cdbd15c8c2db162bea4cf Jul 02 16:42:11.552457 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:11.552413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" event={"ID":"70d865ab-e514-46a8-873d-cce6c047b5e7","Type":"ContainerStarted","Data":"4c4b8249c309ec084b3641a95f394de4cf43f3b8335cdbd15c8c2db162bea4cf"} Jul 02 16:42:11.554101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:11.554069 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7756654f9c-m96zj" event={"ID":"297bc4ac-108f-4ecd-a48f-85c78933e417","Type":"ContainerStarted","Data":"c51b97b54232d90d7397d9d98487e78777d6480e0f5012c371461d37ae76486e"} Jul 02 16:42:11.554101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:11.554111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7756654f9c-m96zj" event={"ID":"297bc4ac-108f-4ecd-a48f-85c78933e417","Type":"ContainerStarted","Data":"f9dec13cb79d5b7af867d20a2fc55c08cb79fed1746bf9d2db01fdb58c666d74"} Jul 02 16:42:11.573364 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:11.573304 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7756654f9c-m96zj" podStartSLOduration=33.573289305 podStartE2EDuration="33.573289305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:11.572038251 +0000 UTC m=+251.207961470" watchObservedRunningTime="2026-07-02 16:42:11.573289305 +0000 UTC m=+251.209212506" Jul 02 16:42:11.646808 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:11.646767 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:11.649255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:11.649231 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:12.319811 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.319779 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:12.367536 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.367503 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:12.557702 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.557653 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:12.559494 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.559469 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7756654f9c-m96zj" Jul 02 16:42:12.628246 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.627949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:42:12.630567 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.630531 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da883743-1e69-40b4-a2a1-239b6548ba35-metrics-certs\") pod \"network-metrics-daemon-rm4nb\" (UID: \"da883743-1e69-40b4-a2a1-239b6548ba35\") " pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:42:12.689342 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.689312 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5xkk\"" Jul 02 16:42:12.697671 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:12.697643 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm4nb" Jul 02 16:42:13.210945 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.210897 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm4nb"] Jul 02 16:42:13.212910 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:13.212882 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda883743_1e69_40b4_a2a1_239b6548ba35.slice/crio-40c8bee5752fe1644f8d5b99c7481f804aa286db788fbf09fd6b72b1eeb2214c WatchSource:0}: Error finding container 40c8bee5752fe1644f8d5b99c7481f804aa286db788fbf09fd6b72b1eeb2214c: Status 404 returned error can't find the container with id 40c8bee5752fe1644f8d5b99c7481f804aa286db788fbf09fd6b72b1eeb2214c Jul 02 16:42:13.466877 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.466793 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:13.562699 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.562657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" event={"ID":"70d865ab-e514-46a8-873d-cce6c047b5e7","Type":"ContainerStarted","Data":"7cee72428a12c6e04404af7874e3c74ebc83a52a0e3b2307451aae47fc443ef6"} Jul 02 16:42:13.563943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.563919 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm4nb" event={"ID":"da883743-1e69-40b4-a2a1-239b6548ba35","Type":"ContainerStarted","Data":"40c8bee5752fe1644f8d5b99c7481f804aa286db788fbf09fd6b72b1eeb2214c"} Jul 02 16:42:13.569191 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.569154 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:13.583480 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.583422 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-qht62" podStartSLOduration=33.334869918 podStartE2EDuration="35.583400396s" totalImagesPullingTime="2.248530478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:13.582197575 +0000 UTC m=+253.218120775" watchObservedRunningTime="2026-07-02 16:42:13.583400396 +0000 UTC m=+253.219323591" Jul 02 16:42:13.621155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.621108 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc"] Jul 02 16:42:13.624215 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.624194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:13.626984 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.626958 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v4hwz\"" Jul 02 16:42:13.626984 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.626982 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 16:42:13.633958 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.633900 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc"] Jul 02 16:42:13.636401 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.636104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49355d03-b436-4926-a9c6-63184f179285-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-v28pc\" (UID: \"49355d03-b436-4926-a9c6-63184f179285\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:13.650346 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.650263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:13.707973 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.707918 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:13.737059 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.736955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49355d03-b436-4926-a9c6-63184f179285-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-v28pc\" (UID: \"49355d03-b436-4926-a9c6-63184f179285\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:13.737241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:13.737104 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 16:42:13.737241 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:13.737179 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49355d03-b436-4926-a9c6-63184f179285-tls-certificates podName:49355d03-b436-4926-a9c6-63184f179285 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:14.237159645 +0000 UTC m=+253.873082831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/49355d03-b436-4926-a9c6-63184f179285-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-v28pc" (UID: "49355d03-b436-4926-a9c6-63184f179285") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 16:42:13.910665 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:13.910629 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:14.241244 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.241219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49355d03-b436-4926-a9c6-63184f179285-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-v28pc\" (UID: \"49355d03-b436-4926-a9c6-63184f179285\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:14.248465 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.248151 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49355d03-b436-4926-a9c6-63184f179285-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-v28pc\" (UID: \"49355d03-b436-4926-a9c6-63184f179285\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:14.523723 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.523617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:14.536333 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.536307 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:14.568947 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.568893 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm4nb" event={"ID":"da883743-1e69-40b4-a2a1-239b6548ba35","Type":"ContainerStarted","Data":"2db4cac6a2f77d974676b3434d465815bf946ffdf28e22d3bf8898ba6646e0de"} Jul 02 16:42:14.569376 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.568983 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm4nb" event={"ID":"da883743-1e69-40b4-a2a1-239b6548ba35","Type":"ContainerStarted","Data":"ce79039c8ed87223f06c0a6b89563675439cbee2bbf39a4528bbe2fe9c2888c8"} Jul 02 16:42:14.573258 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.573215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:14.586294 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.586070 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rm4nb" podStartSLOduration=253.73659496 podStartE2EDuration="4m14.586052754s" totalImagesPullingTime="849.457794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:14.584847619 +0000 UTC m=+254.220770823" watchObservedRunningTime="2026-07-02 16:42:14.586052754 +0000 UTC m=+254.221975957" Jul 02 16:42:14.669823 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.669774 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:14.677362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.677338 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc"] Jul 02 16:42:14.680276 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:14.680256 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49355d03_b436_4926_a9c6_63184f179285.slice/crio-3c5a94935c800582f4d8818eb4f60283fbc994b27bf7344dae4d0e99e081511a WatchSource:0}: Error finding container 3c5a94935c800582f4d8818eb4f60283fbc994b27bf7344dae4d0e99e081511a: Status 404 returned error can't find the container with id 3c5a94935c800582f4d8818eb4f60283fbc994b27bf7344dae4d0e99e081511a Jul 02 16:42:14.771128 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:14.771090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:15.573580 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:15.573547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" event={"ID":"49355d03-b436-4926-a9c6-63184f179285","Type":"ContainerStarted","Data":"3c5a94935c800582f4d8818eb4f60283fbc994b27bf7344dae4d0e99e081511a"} Jul 02 16:42:16.578345 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.578313 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" event={"ID":"49355d03-b436-4926-a9c6-63184f179285","Type":"ContainerStarted","Data":"f39e9ada17f71ed0d43834b96a8c69a2df1f3e3a8eef302268d925085ae8266c"} Jul 02 16:42:16.578762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.578365 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:16.583220 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.583192 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" Jul 02 16:42:16.595824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.595782 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-v28pc" podStartSLOduration=2.18130464 podStartE2EDuration="3.595767267s" totalImagesPullingTime="1.414462627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:16.593812015 +0000 UTC m=+256.229735218" watchObservedRunningTime="2026-07-02 16:42:16.595767267 +0000 UTC m=+256.231690469" Jul 02 16:42:16.624200 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.624160 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:16.721646 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.721613 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:16.780068 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:16.780029 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:17.132461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.132419 2560 patch_prober.go:28] interesting pod/image-registry-85c94b6c84-r7d95 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:17.132621 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.132478 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:17.646094 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.646050 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:17.679582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.679549 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-g7zl6"] Jul 02 16:42:17.682072 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.682057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.684567 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.684547 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 16:42:17.684672 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.684624 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 16:42:17.685780 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.685763 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 16:42:17.685863 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.685783 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-c25xm\"" Jul 02 16:42:17.692138 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.692120 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-g7zl6"] Jul 02 16:42:17.711993 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.711964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:17.764677 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.764644 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb53613-b4e8-45c9-bf46-26f61a70019e-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.764845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.764680 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.764845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.764771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.764845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.764797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgx84\" (UniqueName: \"kubernetes.io/projected/3fb53613-b4e8-45c9-bf46-26f61a70019e-kube-api-access-pgx84\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.865310 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.865273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb53613-b4e8-45c9-bf46-26f61a70019e-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.865310 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.865313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.865461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.865340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.865461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.865360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgx84\" (UniqueName: \"kubernetes.io/projected/3fb53613-b4e8-45c9-bf46-26f61a70019e-kube-api-access-pgx84\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.865461 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:17.865442 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 02 16:42:17.865554 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:17.865515 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-tls podName:3fb53613-b4e8-45c9-bf46-26f61a70019e nodeName:}" failed. No retries permitted until 2026-07-02 16:42:18.365496189 +0000 UTC m=+258.001419370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-g7zl6" (UID: "3fb53613-b4e8-45c9-bf46-26f61a70019e") : secret "prometheus-operator-tls" not found Jul 02 16:42:17.866054 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.866033 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb53613-b4e8-45c9-bf46-26f61a70019e-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.867899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.867880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:17.875974 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:17.875954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgx84\" (UniqueName: \"kubernetes.io/projected/3fb53613-b4e8-45c9-bf46-26f61a70019e-kube-api-access-pgx84\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:18.322986 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:18.322949 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:18.370260 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:18.370231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:18.372710 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:18.372660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fb53613-b4e8-45c9-bf46-26f61a70019e-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-g7zl6\" (UID: \"3fb53613-b4e8-45c9-bf46-26f61a70019e\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:18.590841 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:18.590756 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" Jul 02 16:42:18.713507 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:18.713476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-g7zl6"] Jul 02 16:42:18.716569 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:18.716547 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb53613_b4e8_45c9_bf46_26f61a70019e.slice/crio-63085db0f032d562e33970efe656a8ef0f0482780018431b625ce46a3d5ba4ab WatchSource:0}: Error finding container 63085db0f032d562e33970efe656a8ef0f0482780018431b625ce46a3d5ba4ab: Status 404 returned error can't find the container with id 63085db0f032d562e33970efe656a8ef0f0482780018431b625ce46a3d5ba4ab Jul 02 16:42:19.589335 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:19.589296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" event={"ID":"3fb53613-b4e8-45c9-bf46-26f61a70019e","Type":"ContainerStarted","Data":"63085db0f032d562e33970efe656a8ef0f0482780018431b625ce46a3d5ba4ab"} Jul 02 16:42:20.297063 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:20.297015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:20.594812 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:20.594779 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" event={"ID":"3fb53613-b4e8-45c9-bf46-26f61a70019e","Type":"ContainerStarted","Data":"87bd99433dc8d6b056ef6df0a17690de85ebd50de2bd3451dcb14cec08ad068f"} Jul 02 16:42:20.594989 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:20.594836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" event={"ID":"3fb53613-b4e8-45c9-bf46-26f61a70019e","Type":"ContainerStarted","Data":"bade2aa8c8f298985e31ff3da3a24dd753a4e8b6ea6b51712e410c063c2f3381"} Jul 02 16:42:20.610702 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:20.610636 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-g7zl6" podStartSLOduration=2.275262624 podStartE2EDuration="3.610622061s" totalImagesPullingTime="1.335359437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:20.610442029 +0000 UTC m=+260.246365231" watchObservedRunningTime="2026-07-02 16:42:20.610622061 +0000 UTC m=+260.246545262" Jul 02 16:42:21.136200 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:21.136162 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:21.187943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:21.187854 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:21.793208 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:21.793178 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:21.914388 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:21.914341 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.022092 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.022059 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.031843 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.031812 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl"] Jul 02 16:42:22.035229 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.035209 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.037824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.037799 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 16:42:22.038038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.038025 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 16:42:22.038089 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.038071 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xh2xd\"" Jul 02 16:42:22.069094 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.069009 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl"] Jul 02 16:42:22.091210 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.091177 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zg6nd"] Jul 02 16:42:22.094329 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.094313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.097067 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.097043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/873051f4-5086-4815-a827-bb3d07936331-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.097198 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.097097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.097198 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.097143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rljb6\" (UniqueName: \"kubernetes.io/projected/873051f4-5086-4815-a827-bb3d07936331-kube-api-access-rljb6\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.097198 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.097165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.100241 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.100076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 16:42:22.100241 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.100119 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 16:42:22.100632 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.100615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 16:42:22.101118 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.101104 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gv5v7\"" Jul 02 16:42:22.156715 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.156659 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.198197 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198159 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98fb\" (UniqueName: \"kubernetes.io/projected/f0745687-d075-44d2-8667-d3b7da5a7bac-kube-api-access-q98fb\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198197 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-tls\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198225 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/873051f4-5086-4815-a827-bb3d07936331-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.198393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-root\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.198545 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-textfile\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198545 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rljb6\" (UniqueName: \"kubernetes.io/projected/873051f4-5086-4815-a827-bb3d07936331-kube-api-access-rljb6\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.198545 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.198545 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0745687-d075-44d2-8667-d3b7da5a7bac-metrics-client-ca\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198545 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-accelerators-collector-config\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198545 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:22.198528 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 16:42:22.198802 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-sys\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198802 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:22.198583 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-tls podName:873051f4-5086-4815-a827-bb3d07936331 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:22.698564692 +0000 UTC m=+262.334487876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-lhjxl" (UID: "873051f4-5086-4815-a827-bb3d07936331") : secret "openshift-state-metrics-tls" not found Jul 02 16:42:22.198882 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-wtmp\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.198952 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.198936 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/873051f4-5086-4815-a827-bb3d07936331-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.201141 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.201114 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.207899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.207873 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rljb6\" (UniqueName: \"kubernetes.io/projected/873051f4-5086-4815-a827-bb3d07936331-kube-api-access-rljb6\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.257437 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.257405 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.299943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.299895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-sys\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.299943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.299945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-wtmp\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300196 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-sys\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300196 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300056 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-wtmp\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300196 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q98fb\" (UniqueName: \"kubernetes.io/projected/f0745687-d075-44d2-8667-d3b7da5a7bac-kube-api-access-q98fb\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300196 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-tls\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300196 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300402 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-root\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300402 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300280 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0745687-d075-44d2-8667-d3b7da5a7bac-root\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300402 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-textfile\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300402 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0745687-d075-44d2-8667-d3b7da5a7bac-metrics-client-ca\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300539 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300408 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-accelerators-collector-config\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.300702 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.300656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-textfile\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.301056 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.301036 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-accelerators-collector-config\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.301204 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.301185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0745687-d075-44d2-8667-d3b7da5a7bac-metrics-client-ca\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.302766 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.302745 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-tls\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.302847 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.302754 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0745687-d075-44d2-8667-d3b7da5a7bac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.309189 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.309159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98fb\" (UniqueName: \"kubernetes.io/projected/f0745687-d075-44d2-8667-d3b7da5a7bac-kube-api-access-q98fb\") pod \"node-exporter-zg6nd\" (UID: \"f0745687-d075-44d2-8667-d3b7da5a7bac\") " pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.403485 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.403398 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zg6nd" Jul 02 16:42:22.415139 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:22.415108 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0745687_d075_44d2_8667_d3b7da5a7bac.slice/crio-6b645beaa3c55c94eeaea106425a7b39cbb5e102be78c3fc1520b9bef76fec39 WatchSource:0}: Error finding container 6b645beaa3c55c94eeaea106425a7b39cbb5e102be78c3fc1520b9bef76fec39: Status 404 returned error can't find the container with id 6b645beaa3c55c94eeaea106425a7b39cbb5e102be78c3fc1520b9bef76fec39 Jul 02 16:42:22.520032 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.519980 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.602622 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.602582 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg6nd" event={"ID":"f0745687-d075-44d2-8667-d3b7da5a7bac","Type":"ContainerStarted","Data":"6b645beaa3c55c94eeaea106425a7b39cbb5e102be78c3fc1520b9bef76fec39"} Jul 02 16:42:22.621623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.621586 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.702863 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.702785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.705243 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.705224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/873051f4-5086-4815-a827-bb3d07936331-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lhjxl\" (UID: \"873051f4-5086-4815-a827-bb3d07936331\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:22.764727 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.764665 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:22.944974 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:22.944940 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" Jul 02 16:42:23.039961 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.039909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:23.109193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.109158 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl"] Jul 02 16:42:23.114150 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:23.114120 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873051f4_5086_4815_a827_bb3d07936331.slice/crio-95d43c339db56335662bc2172ab0698b420d745cd59e6238d8ff64091de2a11e WatchSource:0}: Error finding container 95d43c339db56335662bc2172ab0698b420d745cd59e6238d8ff64091de2a11e: Status 404 returned error can't find the container with id 95d43c339db56335662bc2172ab0698b420d745cd59e6238d8ff64091de2a11e Jul 02 16:42:23.117552 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.117518 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:23.556485 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.556442 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:23.608129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.608094 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg6nd" event={"ID":"f0745687-d075-44d2-8667-d3b7da5a7bac","Type":"ContainerStarted","Data":"abceea0c7c441fa47919eabc701cd82c502cf3b6037388149663f34cf5b06f91"} Jul 02 16:42:23.610022 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.609987 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" event={"ID":"873051f4-5086-4815-a827-bb3d07936331","Type":"ContainerStarted","Data":"ab702b44c15488719769f368fcd10c6ba33a49d3292ccc4fba1eea4390787edd"} Jul 02 16:42:23.610154 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.610039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" event={"ID":"873051f4-5086-4815-a827-bb3d07936331","Type":"ContainerStarted","Data":"75b2ea531ba446f652e9019be32a2eadb87148a451c5f38dd1391d2dd3c53ea4"} Jul 02 16:42:23.610154 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:23.610066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" event={"ID":"873051f4-5086-4815-a827-bb3d07936331","Type":"ContainerStarted","Data":"95d43c339db56335662bc2172ab0698b420d745cd59e6238d8ff64091de2a11e"} Jul 02 16:42:24.615108 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:24.615007 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" event={"ID":"873051f4-5086-4815-a827-bb3d07936331","Type":"ContainerStarted","Data":"21cac1238db48297892cdda40bbc3ce829ee8bf566b9ee6d65d5e8581b700203"} Jul 02 16:42:24.616468 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:24.616447 2560 generic.go:356] "Generic (PLEG): container finished" podID="f0745687-d075-44d2-8667-d3b7da5a7bac" containerID="abceea0c7c441fa47919eabc701cd82c502cf3b6037388149663f34cf5b06f91" exitCode=0 Jul 02 16:42:24.616570 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:24.616476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg6nd" event={"ID":"f0745687-d075-44d2-8667-d3b7da5a7bac","Type":"ContainerDied","Data":"abceea0c7c441fa47919eabc701cd82c502cf3b6037388149663f34cf5b06f91"} Jul 02 16:42:24.637482 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:24.637433 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lhjxl" podStartSLOduration=1.609583018 podStartE2EDuration="2.637416132s" totalImagesPullingTime="1.027833114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:24.63573323 +0000 UTC m=+264.271656433" watchObservedRunningTime="2026-07-02 16:42:24.637416132 +0000 UTC m=+264.273339335" Jul 02 16:42:24.959140 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:24.959062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:25.041018 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.040982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:25.108939 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.108907 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:25.181028 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.180988 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:25.326019 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.325977 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:25.622273 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.622175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg6nd" event={"ID":"f0745687-d075-44d2-8667-d3b7da5a7bac","Type":"ContainerStarted","Data":"0cbb11718dd2d9fb87ce117472d36aa347103e9dbc00f9c393590165f8cd4d52"} Jul 02 16:42:25.622273 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.622238 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg6nd" event={"ID":"f0745687-d075-44d2-8667-d3b7da5a7bac","Type":"ContainerStarted","Data":"6085306f26869b0c89621264fd249b7b8641351a44f68ffdc6a1dfec58a1dfb1"} Jul 02 16:42:25.651535 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:25.651481 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zg6nd" podStartSLOduration=2.488826663 podStartE2EDuration="3.651467997s" totalImagesPullingTime="1.091245141s" totalInitContainerRuntime="71.396193ms" isStatefulPod=true podCreationTimestamp="2026-07-02 16:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:25.650411364 +0000 UTC m=+265.286334568" watchObservedRunningTime="2026-07-02 16:42:25.651467997 +0000 UTC m=+265.287391199" Jul 02 16:42:26.818515 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.818476 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6"] Jul 02 16:42:26.821646 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.821630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:26.824420 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.824204 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 16:42:26.824540 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.824425 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7jtm8\"" Jul 02 16:42:26.830930 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.830904 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6"] Jul 02 16:42:26.833982 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.833961 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:26.842164 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.842144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:26.842261 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.842175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zczld\" (UniqueName: \"kubernetes.io/projected/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-kube-api-access-zczld\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:26.861145 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.861108 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d75bfffcc-77p4s"] Jul 02 16:42:26.864206 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.864187 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867040 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867078 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867100 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867108 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867127 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9ctbj\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867157 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867078 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 16:42:26.867248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.867172 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 16:42:26.871916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.871898 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 16:42:26.874643 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.874622 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d75bfffcc-77p4s"] Jul 02 16:42:26.924192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.924158 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:26.943000 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.942969 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zczld\" (UniqueName: \"kubernetes.io/projected/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-kube-api-access-zczld\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:26.943174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943017 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-config\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-trusted-ca-bundle\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943068 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-serving-cert\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-service-ca\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj8l5\" (UniqueName: \"kubernetes.io/projected/abdf3919-b6bf-4589-9b62-cceb2f204a4f-kube-api-access-jj8l5\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943407 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-oauth-config\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943407 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-oauth-serving-cert\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:26.943407 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.943260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:26.943407 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:26.943356 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 16:42:26.943407 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:26.943402 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-monitoring-plugin-cert podName:9b37bd49-fd9a-4ea8-ad7c-6aa716861e02 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:27.443388632 +0000 UTC m=+267.079311825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-2pxq6" (UID: "9b37bd49-fd9a-4ea8-ad7c-6aa716861e02") : secret "monitoring-plugin-cert" not found Jul 02 16:42:26.955659 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:26.955626 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zczld\" (UniqueName: \"kubernetes.io/projected/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-kube-api-access-zczld\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:27.044038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.043996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-config\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-trusted-ca-bundle\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044271 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-serving-cert\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044271 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044077 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-service-ca\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044271 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj8l5\" (UniqueName: \"kubernetes.io/projected/abdf3919-b6bf-4589-9b62-cceb2f204a4f-kube-api-access-jj8l5\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044271 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-oauth-config\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044271 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-oauth-serving-cert\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044979 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-service-ca\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.044979 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.044901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-config\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.045147 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.045008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-oauth-serving-cert\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.045147 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.045050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-trusted-ca-bundle\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.046612 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.046593 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-oauth-config\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.046726 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.046709 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-serving-cert\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.051673 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.051655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj8l5\" (UniqueName: \"kubernetes.io/projected/abdf3919-b6bf-4589-9b62-cceb2f204a4f-kube-api-access-jj8l5\") pod \"console-6d75bfffcc-77p4s\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.131529 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.131459 2560 patch_prober.go:28] interesting pod/image-registry-85c94b6c84-r7d95 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:27.131529 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.131503 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:27.173583 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.173546 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:27.271412 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.271377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:27.305311 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.305282 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d75bfffcc-77p4s"] Jul 02 16:42:27.306913 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:27.306892 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdf3919_b6bf_4589_9b62_cceb2f204a4f.slice/crio-396c6ee31219835745de20abb2fa40a72c12e25959e7684c79c5cf297bfdd296 WatchSource:0}: Error finding container 396c6ee31219835745de20abb2fa40a72c12e25959e7684c79c5cf297bfdd296: Status 404 returned error can't find the container with id 396c6ee31219835745de20abb2fa40a72c12e25959e7684c79c5cf297bfdd296 Jul 02 16:42:27.448326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.448235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:27.450727 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.450707 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b37bd49-fd9a-4ea8-ad7c-6aa716861e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2pxq6\" (UID: \"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:27.630702 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.630651 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d75bfffcc-77p4s" event={"ID":"abdf3919-b6bf-4589-9b62-cceb2f204a4f","Type":"ContainerStarted","Data":"396c6ee31219835745de20abb2fa40a72c12e25959e7684c79c5cf297bfdd296"} Jul 02 16:42:27.732875 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.732791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:27.860778 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:27.860749 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6"] Jul 02 16:42:27.863480 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:27.863450 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b37bd49_fd9a_4ea8_ad7c_6aa716861e02.slice/crio-8bbd532d6bf88af3b1bc22492a133a49a944df237b8d104b1e974354c4ea13f4 WatchSource:0}: Error finding container 8bbd532d6bf88af3b1bc22492a133a49a944df237b8d104b1e974354c4ea13f4: Status 404 returned error can't find the container with id 8bbd532d6bf88af3b1bc22492a133a49a944df237b8d104b1e974354c4ea13f4 Jul 02 16:42:28.225737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:28.225679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:28.639883 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:28.637365 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" event={"ID":"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02","Type":"ContainerStarted","Data":"8bbd532d6bf88af3b1bc22492a133a49a944df237b8d104b1e974354c4ea13f4"} Jul 02 16:42:29.220665 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:29.220628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:29.274459 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:29.274367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:29.333913 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:29.333877 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:31.650534 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:31.650495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" event={"ID":"9b37bd49-fd9a-4ea8-ad7c-6aa716861e02","Type":"ContainerStarted","Data":"043a11d5d1f7f1f1f88da6a1efac957cfef5352db9adb351dfa5e3e3999befae"} Jul 02 16:42:31.651015 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:31.650553 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:31.652150 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:31.652124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d75bfffcc-77p4s" event={"ID":"abdf3919-b6bf-4589-9b62-cceb2f204a4f","Type":"ContainerStarted","Data":"7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e"} Jul 02 16:42:31.655901 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:31.655882 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" Jul 02 16:42:31.667892 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:31.667851 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2pxq6" podStartSLOduration=2.78966176 podStartE2EDuration="5.667837999s" totalImagesPullingTime="2.878176239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:31.667302744 +0000 UTC m=+271.303225946" watchObservedRunningTime="2026-07-02 16:42:31.667837999 +0000 UTC m=+271.303761201" Jul 02 16:42:31.698927 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:31.698875 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d75bfffcc-77p4s" podStartSLOduration=2.262988049 podStartE2EDuration="5.69885905s" totalImagesPullingTime="3.435871001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:31.698422646 +0000 UTC m=+271.334345847" watchObservedRunningTime="2026-07-02 16:42:31.69885905 +0000 UTC m=+271.334782251" Jul 02 16:42:32.147810 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.147776 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerName="registry" containerID="cri-o://6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4" gracePeriod=30 Jul 02 16:42:32.390894 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.390869 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:42:32.494434 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494343 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-installation-pull-secrets\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494434 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494389 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-bound-sa-token\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494434 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494417 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-ca-trust-extracted\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494434 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494439 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494783 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494469 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-certificates\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494783 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494493 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-image-registry-private-configuration\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494783 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494529 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv6rx\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-kube-api-access-zv6rx\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.494783 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.494551 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-trusted-ca\") pod \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\" (UID: \"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7\") " Jul 02 16:42:32.495091 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.495035 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:42:32.495305 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.495097 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:42:32.497112 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.497085 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:42:32.497305 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.497278 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:42:32.497423 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.497380 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:42:32.497530 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.497508 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-kube-api-access-zv6rx" (OuterVolumeSpecName: "kube-api-access-zv6rx") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "kube-api-access-zv6rx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:42:32.497591 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.497509 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:42:32.502641 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.502621 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" (UID: "21e5d5b7-23e9-433c-869e-5e4ff9aa90a7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:42:32.595957 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595911 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-certificates\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.595957 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595949 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-image-registry-private-configuration\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.595957 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595959 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv6rx\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-kube-api-access-zv6rx\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.595957 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595968 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-trusted-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.596192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595978 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-installation-pull-secrets\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.596192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595987 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-bound-sa-token\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.596192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.595995 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-ca-trust-extracted\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.596192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.596003 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7-registry-tls\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:42:32.657084 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.657050 2560 generic.go:356] "Generic (PLEG): container finished" podID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerID="6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4" exitCode=0 Jul 02 16:42:32.657528 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.657095 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" Jul 02 16:42:32.657528 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.657151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" event={"ID":"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7","Type":"ContainerDied","Data":"6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4"} Jul 02 16:42:32.657528 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.657206 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c94b6c84-r7d95" event={"ID":"21e5d5b7-23e9-433c-869e-5e4ff9aa90a7","Type":"ContainerDied","Data":"972d8d2ab07d9e4c1f437dc5800e415c63b045122f0a0261576a84790a78c393"} Jul 02 16:42:32.657528 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.657240 2560 scope.go:117] "RemoveContainer" containerID="6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4" Jul 02 16:42:32.665619 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.665603 2560 scope.go:117] "RemoveContainer" containerID="6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4" Jul 02 16:42:32.665898 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:32.665878 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4\": container with ID starting with 6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4 not found: ID does not exist" containerID="6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4" Jul 02 16:42:32.665958 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.665905 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4"} err="failed to get container status \"6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4\": rpc error: code = NotFound desc = could not find container \"6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4\": container with ID starting with 6e9211a71411d0685799fa159a5b56ee105c83140e16ee22053fb7f5097d8bd4 not found: ID does not exist" Jul 02 16:42:32.681965 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.681938 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c94b6c84-r7d95"] Jul 02 16:42:32.684032 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.684011 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85c94b6c84-r7d95"] Jul 02 16:42:32.791437 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:32.791407 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" path="/var/lib/kubelet/pods/21e5d5b7-23e9-433c-869e-5e4ff9aa90a7/volumes" Jul 02 16:42:37.174299 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:37.174267 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:37.174719 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:37.174323 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:37.175815 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:37.175791 2560 patch_prober.go:28] interesting pod/console-6d75bfffcc-77p4s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jul 02 16:42:37.175902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:37.175834 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d75bfffcc-77p4s" podUID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jul 02 16:42:42.183350 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:42.183313 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:43.270161 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:42:43.270117 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jmb5r" podUID="781f91e6-cc13-49a2-a124-5af29a00c296" Jul 02 16:42:43.416483 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:43.416442 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:43.696379 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:43.696347 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmb5r" Jul 02 16:42:45.297393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:45.297359 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:45.370096 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:45.370057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:46.711300 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:46.711262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:42:46.713698 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:46.713669 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/781f91e6-cc13-49a2-a124-5af29a00c296-metrics-tls\") pod \"dns-default-jmb5r\" (UID: \"781f91e6-cc13-49a2-a124-5af29a00c296\") " pod="openshift-dns/dns-default-jmb5r" Jul 02 16:42:46.999234 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:46.999153 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l7cj2\"" Jul 02 16:42:47.007318 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.007292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmb5r" Jul 02 16:42:47.155885 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.155859 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jmb5r"] Jul 02 16:42:47.158246 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:42:47.158219 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781f91e6_cc13_49a2_a124_5af29a00c296.slice/crio-fe866a269dc932544ba7d60ed4335a8c7ff4343ea258b1ceab43e014cc601fda WatchSource:0}: Error finding container fe866a269dc932544ba7d60ed4335a8c7ff4343ea258b1ceab43e014cc601fda: Status 404 returned error can't find the container with id fe866a269dc932544ba7d60ed4335a8c7ff4343ea258b1ceab43e014cc601fda Jul 02 16:42:47.177888 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.177864 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:47.181857 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.181835 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:42:47.199415 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.199385 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:47.267380 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.267303 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:47.400113 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.400076 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:47.543248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.543199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:47.712039 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:47.712004 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmb5r" event={"ID":"781f91e6-cc13-49a2-a124-5af29a00c296","Type":"ContainerStarted","Data":"fe866a269dc932544ba7d60ed4335a8c7ff4343ea258b1ceab43e014cc601fda"} Jul 02 16:42:49.300607 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:49.300568 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:49.399289 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:49.399254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:49.721492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:49.721404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmb5r" event={"ID":"781f91e6-cc13-49a2-a124-5af29a00c296","Type":"ContainerStarted","Data":"e7605872bfec3336067238aee90c67ba5e7365c4cc84b2ae5d62bb71b34cc41f"} Jul 02 16:42:49.721492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:49.721460 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmb5r" event={"ID":"781f91e6-cc13-49a2-a124-5af29a00c296","Type":"ContainerStarted","Data":"fc28c48c082befba2f9f0f57f1e747fffab14468516a2f6c5c7a699d4ff1849a"} Jul 02 16:42:49.721665 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:49.721549 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jmb5r" Jul 02 16:42:49.739850 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:49.739800 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jmb5r" podStartSLOduration=252.253339856 podStartE2EDuration="4m13.7397846s" totalImagesPullingTime="1.486444744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:49.738529262 +0000 UTC m=+289.374452476" watchObservedRunningTime="2026-07-02 16:42:49.7397846 +0000 UTC m=+289.375707800" Jul 02 16:42:53.738403 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:53.738369 2560 generic.go:356] "Generic (PLEG): container finished" podID="56116f10-8b55-417d-8f6e-19ee3a305460" containerID="27a998d236feb3b789b0ed240be25da82e9c9c91cc1c2a60d1beba901cf2d17b" exitCode=0 Jul 02 16:42:53.738871 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:53.738431 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" event={"ID":"56116f10-8b55-417d-8f6e-19ee3a305460","Type":"ContainerDied","Data":"27a998d236feb3b789b0ed240be25da82e9c9c91cc1c2a60d1beba901cf2d17b"} Jul 02 16:42:53.738871 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:53.738754 2560 scope.go:117] "RemoveContainer" containerID="27a998d236feb3b789b0ed240be25da82e9c9c91cc1c2a60d1beba901cf2d17b" Jul 02 16:42:54.747655 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:54.747619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qrtkh" event={"ID":"56116f10-8b55-417d-8f6e-19ee3a305460","Type":"ContainerStarted","Data":"ed7c023a5f29a40d74893583218b1989d4ed224ab817582429a7909e44fc92b9"} Jul 02 16:42:57.594549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:57.594499 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:57.662024 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:57.661997 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:57.741474 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:57.741441 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:57.799661 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:57.799627 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:42:59.727704 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:42:59.727653 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jmb5r" Jul 02 16:43:00.136773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:00.136743 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:00.195156 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:00.195121 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:00.731675 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:00.731648 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:43:00.741077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:00.741052 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 16:43:00.741956 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:00.741858 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:43:01.622899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:01.622852 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:01.723079 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:01.723043 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:06.763120 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:06.763087 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:06.874607 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:06.874573 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:07.800046 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:07.800012 2560 generic.go:356] "Generic (PLEG): container finished" podID="fece07cd-ca98-4ea6-b924-47fbd03e6728" containerID="3127a82f67345cae7b1cbffa1c14ccb265f1b193ff902091ed95570772634f39" exitCode=0 Jul 02 16:43:07.800400 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:07.800059 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" event={"ID":"fece07cd-ca98-4ea6-b924-47fbd03e6728","Type":"ContainerDied","Data":"3127a82f67345cae7b1cbffa1c14ccb265f1b193ff902091ed95570772634f39"} Jul 02 16:43:07.800460 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:07.800442 2560 scope.go:117] "RemoveContainer" containerID="3127a82f67345cae7b1cbffa1c14ccb265f1b193ff902091ed95570772634f39" Jul 02 16:43:08.805207 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:08.805172 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-dh9lr" event={"ID":"fece07cd-ca98-4ea6-b924-47fbd03e6728","Type":"ContainerStarted","Data":"2fc11ec6ff20490e03e5eb48e261fb35b77d52b59f936c61fb61f2997ebc2b23"} Jul 02 16:43:09.215608 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:09.215514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:09.273915 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:09.273873 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:14.013437 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:14.013397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:14.114316 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:14.114285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:15.759315 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:15.759284 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:15.807173 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:15.807140 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:16.627448 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:16.627412 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:16.685549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:16.685520 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:24.049317 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:24.049280 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:24.152895 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:24.152849 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:24.200123 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:24.200094 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:31.624588 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:31.624550 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:31.690987 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:31.690947 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:34.987003 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:34.986971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:35.047154 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:35.047122 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:41.216076 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:41.216032 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:41.639471 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:41.639435 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:46.641025 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:46.640991 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:46.710546 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:46.710516 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:49.642852 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:49.642819 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:49.707486 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:49.707450 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:50.265222 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.265181 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-688fbb7cd8-v7mvc"] Jul 02 16:43:50.265475 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.265463 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerName="registry" Jul 02 16:43:50.265529 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.265478 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerName="registry" Jul 02 16:43:50.265565 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.265536 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e5d5b7-23e9-433c-869e-5e4ff9aa90a7" containerName="registry" Jul 02 16:43:50.269768 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.269745 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.280246 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.280225 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688fbb7cd8-v7mvc"] Jul 02 16:43:50.288532 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-serving-cert\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.288616 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288544 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz9sv\" (UniqueName: \"kubernetes.io/projected/4c58e770-b0b1-4b0e-a19d-17db69f61f92-kube-api-access-lz9sv\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.288616 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-oauth-serving-cert\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.288706 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-service-ca\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.288706 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-trusted-ca-bundle\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.288773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-config\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.288805 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.288791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-oauth-config\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.309898 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.309865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:50.389641 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-oauth-config\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.389641 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-serving-cert\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.389899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9sv\" (UniqueName: \"kubernetes.io/projected/4c58e770-b0b1-4b0e-a19d-17db69f61f92-kube-api-access-lz9sv\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.389899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-oauth-serving-cert\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.389899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-service-ca\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.389899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-trusted-ca-bundle\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.389899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.389801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-config\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.390784 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.390753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-service-ca\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.390930 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.390785 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-config\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.390930 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.390765 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-oauth-serving-cert\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.390930 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.390824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-trusted-ca-bundle\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.392511 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.392487 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-serving-cert\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.392610 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.392543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-oauth-config\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.401510 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.401484 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz9sv\" (UniqueName: \"kubernetes.io/projected/4c58e770-b0b1-4b0e-a19d-17db69f61f92-kube-api-access-lz9sv\") pod \"console-688fbb7cd8-v7mvc\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.411390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.411363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:50.579335 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.579294 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:43:50.728131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.728053 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688fbb7cd8-v7mvc"] Jul 02 16:43:50.731790 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:43:50.731765 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c58e770_b0b1_4b0e_a19d_17db69f61f92.slice/crio-d3bbfe2e14de82ca2128323b454ff402288dbfd9323fb6972725e441c3c5534e WatchSource:0}: Error finding container d3bbfe2e14de82ca2128323b454ff402288dbfd9323fb6972725e441c3c5534e: Status 404 returned error can't find the container with id d3bbfe2e14de82ca2128323b454ff402288dbfd9323fb6972725e441c3c5534e Jul 02 16:43:50.957159 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.957072 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fbb7cd8-v7mvc" event={"ID":"4c58e770-b0b1-4b0e-a19d-17db69f61f92","Type":"ContainerStarted","Data":"23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818"} Jul 02 16:43:50.957159 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.957119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fbb7cd8-v7mvc" event={"ID":"4c58e770-b0b1-4b0e-a19d-17db69f61f92","Type":"ContainerStarted","Data":"d3bbfe2e14de82ca2128323b454ff402288dbfd9323fb6972725e441c3c5534e"} Jul 02 16:43:50.974436 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:50.974389 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-688fbb7cd8-v7mvc" podStartSLOduration=0.974375227 podStartE2EDuration="974.375227ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:43:50.974047439 +0000 UTC m=+350.609970654" watchObservedRunningTime="2026-07-02 16:43:50.974375227 +0000 UTC m=+350.610298428" Jul 02 16:43:56.431626 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:56.431589 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:43:56.484794 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:43:56.484756 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:00.083085 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:00.083051 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:00.135104 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:00.135073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:00.579802 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:00.579767 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:44:00.579975 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:00.579845 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:44:00.584682 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:00.584656 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:44:00.998225 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:00.998143 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:44:01.040359 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.040327 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d75bfffcc-77p4s"] Jul 02 16:44:01.154115 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.154084 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8f86667-55h6h"] Jul 02 16:44:01.157287 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.157268 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.161473 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.161444 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:01.168992 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.168968 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8f86667-55h6h"] Jul 02 16:44:01.261167 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.261075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:01.278026 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.277996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-oauth-serving-cert\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.278165 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.278036 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7xxl\" (UniqueName: \"kubernetes.io/projected/452df36c-7962-4632-b535-f1290440db9e-kube-api-access-f7xxl\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.278165 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.278060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-trusted-ca-bundle\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.278165 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.278134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-console-config\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.278275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.278217 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-oauth-config\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.278275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.278248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-serving-cert\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.278339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.278296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-service-ca\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.378964 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.378930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-oauth-config\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.378964 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.378970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-serving-cert\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.379179 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-service-ca\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.379179 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-oauth-serving-cert\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.379179 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7xxl\" (UniqueName: \"kubernetes.io/projected/452df36c-7962-4632-b535-f1290440db9e-kube-api-access-f7xxl\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.379334 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-trusted-ca-bundle\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.379334 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-console-config\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.379914 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379891 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-service-ca\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.380001 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.379897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-console-config\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.380070 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.380048 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-oauth-serving-cert\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.380390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.380367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-trusted-ca-bundle\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.381566 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.381528 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-serving-cert\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.381674 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.381658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-oauth-config\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.388191 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.388168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7xxl\" (UniqueName: \"kubernetes.io/projected/452df36c-7962-4632-b535-f1290440db9e-kube-api-access-f7xxl\") pod \"console-5b8f86667-55h6h\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.467155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.467111 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:01.491868 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.491839 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:01.547900 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.547861 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:01.605463 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.605439 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8f86667-55h6h"] Jul 02 16:44:01.607929 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:44:01.607902 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452df36c_7962_4632_b535_f1290440db9e.slice/crio-ff9033358da9bd978736375f2dbbf77d540b52d6559f6dffe770b967d076362e WatchSource:0}: Error finding container ff9033358da9bd978736375f2dbbf77d540b52d6559f6dffe770b967d076362e: Status 404 returned error can't find the container with id ff9033358da9bd978736375f2dbbf77d540b52d6559f6dffe770b967d076362e Jul 02 16:44:01.999706 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.999647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8f86667-55h6h" event={"ID":"452df36c-7962-4632-b535-f1290440db9e","Type":"ContainerStarted","Data":"ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5"} Jul 02 16:44:01.999886 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:01.999716 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8f86667-55h6h" event={"ID":"452df36c-7962-4632-b535-f1290440db9e","Type":"ContainerStarted","Data":"ff9033358da9bd978736375f2dbbf77d540b52d6559f6dffe770b967d076362e"} Jul 02 16:44:02.019806 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:02.019756 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b8f86667-55h6h" podStartSLOduration=1.01974009 podStartE2EDuration="1.01974009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:44:02.01829648 +0000 UTC m=+361.654219672" watchObservedRunningTime="2026-07-02 16:44:02.01974009 +0000 UTC m=+361.655663292" Jul 02 16:44:11.468275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:11.468217 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:11.468810 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:11.468299 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:11.472866 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:11.472845 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:12.042134 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:12.042103 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:44:12.086233 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:12.086202 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688fbb7cd8-v7mvc"] Jul 02 16:44:12.190410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:12.190378 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:12.250098 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:12.250067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:12.307307 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:12.307220 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:16.636633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:16.636598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:16.738081 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:16.738047 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:44:26.062645 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.062589 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d75bfffcc-77p4s" podUID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" containerName="console" containerID="cri-o://7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e" gracePeriod=15 Jul 02 16:44:26.308235 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.308210 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:44:26.387960 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.387874 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-service-ca\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.387960 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.387910 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-trusted-ca-bundle\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.387960 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.387934 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-oauth-config\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.387960 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.387956 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-config\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.388272 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388053 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-oauth-serving-cert\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.388272 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388104 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-serving-cert\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.388272 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388128 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj8l5\" (UniqueName: \"kubernetes.io/projected/abdf3919-b6bf-4589-9b62-cceb2f204a4f-kube-api-access-jj8l5\") pod \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\" (UID: \"abdf3919-b6bf-4589-9b62-cceb2f204a4f\") " Jul 02 16:44:26.388486 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388360 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-service-ca" (OuterVolumeSpecName: "service-ca") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:26.388561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388481 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-config" (OuterVolumeSpecName: "console-config") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:26.388561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388354 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:26.388561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.388545 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:26.390367 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.390342 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:44:26.390456 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.390394 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:44:26.390456 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.390404 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abdf3919-b6bf-4589-9b62-cceb2f204a4f-kube-api-access-jj8l5" (OuterVolumeSpecName: "kube-api-access-jj8l5") pod "abdf3919-b6bf-4589-9b62-cceb2f204a4f" (UID: "abdf3919-b6bf-4589-9b62-cceb2f204a4f"). InnerVolumeSpecName "kube-api-access-jj8l5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:44:26.489633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489592 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-service-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:26.489633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489623 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-trusted-ca-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:26.489633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489633 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-oauth-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:26.489633 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489643 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:26.489916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489651 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abdf3919-b6bf-4589-9b62-cceb2f204a4f-oauth-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:26.489916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489660 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abdf3919-b6bf-4589-9b62-cceb2f204a4f-console-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:26.489916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:26.489668 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj8l5\" (UniqueName: \"kubernetes.io/projected/abdf3919-b6bf-4589-9b62-cceb2f204a4f-kube-api-access-jj8l5\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:27.092480 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.092393 2560 generic.go:356] "Generic (PLEG): container finished" podID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" containerID="7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e" exitCode=0 Jul 02 16:44:27.092480 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.092447 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d75bfffcc-77p4s" event={"ID":"abdf3919-b6bf-4589-9b62-cceb2f204a4f","Type":"ContainerDied","Data":"7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e"} Jul 02 16:44:27.092480 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.092465 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d75bfffcc-77p4s" Jul 02 16:44:27.093005 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.092486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d75bfffcc-77p4s" event={"ID":"abdf3919-b6bf-4589-9b62-cceb2f204a4f","Type":"ContainerDied","Data":"396c6ee31219835745de20abb2fa40a72c12e25959e7684c79c5cf297bfdd296"} Jul 02 16:44:27.093005 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.092506 2560 scope.go:117] "RemoveContainer" containerID="7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e" Jul 02 16:44:27.101017 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.100999 2560 scope.go:117] "RemoveContainer" containerID="7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e" Jul 02 16:44:27.101292 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:44:27.101273 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e\": container with ID starting with 7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e not found: ID does not exist" containerID="7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e" Jul 02 16:44:27.101339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.101303 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e"} err="failed to get container status \"7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e\": rpc error: code = NotFound desc = could not find container \"7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e\": container with ID starting with 7d0bde3dd11edb32134c631e12c385f56c7bbe37a9457adc998fcef9e5fa290e not found: ID does not exist" Jul 02 16:44:27.109176 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.109155 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d75bfffcc-77p4s"] Jul 02 16:44:27.112389 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:27.112370 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d75bfffcc-77p4s"] Jul 02 16:44:28.791139 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:28.791111 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" path="/var/lib/kubelet/pods/abdf3919-b6bf-4589-9b62-cceb2f204a4f/volumes" Jul 02 16:44:37.109150 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.109110 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-688fbb7cd8-v7mvc" podUID="4c58e770-b0b1-4b0e-a19d-17db69f61f92" containerName="console" containerID="cri-o://23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818" gracePeriod=15 Jul 02 16:44:37.354270 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.354247 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:44:37.469566 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469460 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-service-ca\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.469566 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469527 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-serving-cert\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.469566 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469568 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-oauth-serving-cert\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.469891 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469599 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-oauth-config\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.469891 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469630 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-trusted-ca-bundle\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.469891 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469670 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-config\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.469891 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469835 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz9sv\" (UniqueName: \"kubernetes.io/projected/4c58e770-b0b1-4b0e-a19d-17db69f61f92-kube-api-access-lz9sv\") pod \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\" (UID: \"4c58e770-b0b1-4b0e-a19d-17db69f61f92\") " Jul 02 16:44:37.470101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.469917 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:37.470101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.470045 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:37.470101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.470055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-config" (OuterVolumeSpecName: "console-config") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:37.470248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.470107 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:44:37.470248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.470136 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-oauth-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:37.470248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.470150 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:37.470248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.470159 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-service-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:37.471931 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.471903 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:44:37.472031 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.471977 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c58e770-b0b1-4b0e-a19d-17db69f61f92-kube-api-access-lz9sv" (OuterVolumeSpecName: "kube-api-access-lz9sv") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "kube-api-access-lz9sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:44:37.472070 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.472048 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c58e770-b0b1-4b0e-a19d-17db69f61f92" (UID: "4c58e770-b0b1-4b0e-a19d-17db69f61f92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:44:37.570577 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.570536 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-oauth-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:37.570577 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.570567 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c58e770-b0b1-4b0e-a19d-17db69f61f92-trusted-ca-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:37.570577 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.570577 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz9sv\" (UniqueName: \"kubernetes.io/projected/4c58e770-b0b1-4b0e-a19d-17db69f61f92-kube-api-access-lz9sv\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:37.570826 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:37.570589 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c58e770-b0b1-4b0e-a19d-17db69f61f92-console-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:44:38.136015 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.135980 2560 generic.go:356] "Generic (PLEG): container finished" podID="4c58e770-b0b1-4b0e-a19d-17db69f61f92" containerID="23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818" exitCode=0 Jul 02 16:44:38.136015 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.136020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fbb7cd8-v7mvc" event={"ID":"4c58e770-b0b1-4b0e-a19d-17db69f61f92","Type":"ContainerDied","Data":"23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818"} Jul 02 16:44:38.136478 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.136031 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fbb7cd8-v7mvc" Jul 02 16:44:38.136478 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.136057 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fbb7cd8-v7mvc" event={"ID":"4c58e770-b0b1-4b0e-a19d-17db69f61f92","Type":"ContainerDied","Data":"d3bbfe2e14de82ca2128323b454ff402288dbfd9323fb6972725e441c3c5534e"} Jul 02 16:44:38.136478 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.136076 2560 scope.go:117] "RemoveContainer" containerID="23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818" Jul 02 16:44:38.144498 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.144478 2560 scope.go:117] "RemoveContainer" containerID="23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818" Jul 02 16:44:38.144787 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:44:38.144767 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818\": container with ID starting with 23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818 not found: ID does not exist" containerID="23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818" Jul 02 16:44:38.144845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.144796 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818"} err="failed to get container status \"23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818\": rpc error: code = NotFound desc = could not find container \"23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818\": container with ID starting with 23b949eea8062c73a82dd4b123c491d03bb3024dbcea8f966d2403b2d388b818 not found: ID does not exist" Jul 02 16:44:38.156561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.156534 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688fbb7cd8-v7mvc"] Jul 02 16:44:38.159996 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.159975 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688fbb7cd8-v7mvc"] Jul 02 16:44:38.791749 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:44:38.791712 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c58e770-b0b1-4b0e-a19d-17db69f61f92" path="/var/lib/kubelet/pods/4c58e770-b0b1-4b0e-a19d-17db69f61f92/volumes" Jul 02 16:45:03.421752 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:03.421707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:03.518110 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:03.518073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:30.019527 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:30.019422 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:30.827899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:30.827850 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:31.971640 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.971607 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc"] Jul 02 16:45:31.972110 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.972020 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c58e770-b0b1-4b0e-a19d-17db69f61f92" containerName="console" Jul 02 16:45:31.972110 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.972037 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c58e770-b0b1-4b0e-a19d-17db69f61f92" containerName="console" Jul 02 16:45:31.972110 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.972058 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" containerName="console" Jul 02 16:45:31.972110 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.972065 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" containerName="console" Jul 02 16:45:31.972303 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.972132 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="abdf3919-b6bf-4589-9b62-cceb2f204a4f" containerName="console" Jul 02 16:45:31.972303 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.972147 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c58e770-b0b1-4b0e-a19d-17db69f61f92" containerName="console" Jul 02 16:45:31.974944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.974926 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:31.977997 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.977971 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7dkm9\"" Jul 02 16:45:31.978109 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.978000 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:45:31.978324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.978309 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 16:45:31.989583 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:31.989560 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc"] Jul 02 16:45:32.064264 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.064231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d134173d-d25c-463c-a3fc-9056162dd743-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m9dsc\" (UID: \"d134173d-d25c-463c-a3fc-9056162dd743\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.064264 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.064266 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxtj\" (UniqueName: \"kubernetes.io/projected/d134173d-d25c-463c-a3fc-9056162dd743-kube-api-access-fzxtj\") pod \"cert-manager-operator-controller-manager-55c444bf86-m9dsc\" (UID: \"d134173d-d25c-463c-a3fc-9056162dd743\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.164753 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.164721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d134173d-d25c-463c-a3fc-9056162dd743-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m9dsc\" (UID: \"d134173d-d25c-463c-a3fc-9056162dd743\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.164876 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.164760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxtj\" (UniqueName: \"kubernetes.io/projected/d134173d-d25c-463c-a3fc-9056162dd743-kube-api-access-fzxtj\") pod \"cert-manager-operator-controller-manager-55c444bf86-m9dsc\" (UID: \"d134173d-d25c-463c-a3fc-9056162dd743\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.165101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.165080 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d134173d-d25c-463c-a3fc-9056162dd743-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m9dsc\" (UID: \"d134173d-d25c-463c-a3fc-9056162dd743\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.176313 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.176283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxtj\" (UniqueName: \"kubernetes.io/projected/d134173d-d25c-463c-a3fc-9056162dd743-kube-api-access-fzxtj\") pod \"cert-manager-operator-controller-manager-55c444bf86-m9dsc\" (UID: \"d134173d-d25c-463c-a3fc-9056162dd743\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.284104 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.284069 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" Jul 02 16:45:32.416082 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.416043 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc"] Jul 02 16:45:32.419273 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:45:32.419243 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd134173d_d25c_463c_a3fc_9056162dd743.slice/crio-fd3ec7ea1cec9d30661089c3db5cfe81e1d8751e823e3e9bae7675a8fd4de62d WatchSource:0}: Error finding container fd3ec7ea1cec9d30661089c3db5cfe81e1d8751e823e3e9bae7675a8fd4de62d: Status 404 returned error can't find the container with id fd3ec7ea1cec9d30661089c3db5cfe81e1d8751e823e3e9bae7675a8fd4de62d Jul 02 16:45:32.421879 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:32.421862 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:45:33.339571 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:33.339536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" event={"ID":"d134173d-d25c-463c-a3fc-9056162dd743","Type":"ContainerStarted","Data":"fd3ec7ea1cec9d30661089c3db5cfe81e1d8751e823e3e9bae7675a8fd4de62d"} Jul 02 16:45:33.627723 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:33.627611 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:33.721853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:33.721811 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:36.357164 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.357121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" event={"ID":"d134173d-d25c-463c-a3fc-9056162dd743","Type":"ContainerStarted","Data":"d3a2166478eb047dce647bac3c1f0540099277d640afef58cf59cad6aee4d054"} Jul 02 16:45:36.378346 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.378295 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m9dsc" podStartSLOduration=1.7915393480000001 podStartE2EDuration="5.378279896s" totalImagesPullingTime="3.586740548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:45:36.376145571 +0000 UTC m=+456.012068774" watchObservedRunningTime="2026-07-02 16:45:36.378279896 +0000 UTC m=+456.014203095" Jul 02 16:45:36.776680 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.776645 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:36.887295 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.887261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:36.948965 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.948931 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr"] Jul 02 16:45:36.952303 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.952288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:36.955121 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.955103 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 16:45:36.955220 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.955148 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 16:45:36.955220 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.955165 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vs8s7\"" Jul 02 16:45:36.966083 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:36.966059 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr"] Jul 02 16:45:37.044755 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.041635 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hjs76"] Jul 02 16:45:37.047146 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.047122 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.049849 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.049821 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 16:45:37.049984 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.049875 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5dz2w\"" Jul 02 16:45:37.049984 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.049899 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 16:45:37.054509 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.054490 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hjs76"] Jul 02 16:45:37.108913 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.108870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.109077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.108928 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.109077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.108958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr6l8\" (UniqueName: \"kubernetes.io/projected/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-kube-api-access-rr6l8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.109077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.109007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce36df29-3927-41f0-bd4a-5d80b71badd3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hjs76\" (UID: \"ce36df29-3927-41f0-bd4a-5d80b71badd3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.109077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.109029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgnjg\" (UniqueName: \"kubernetes.io/projected/ce36df29-3927-41f0-bd4a-5d80b71badd3-kube-api-access-jgnjg\") pod \"cert-manager-webhook-6486ffd997-hjs76\" (UID: \"ce36df29-3927-41f0-bd4a-5d80b71badd3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.209440 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce36df29-3927-41f0-bd4a-5d80b71badd3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hjs76\" (UID: \"ce36df29-3927-41f0-bd4a-5d80b71badd3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.209440 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgnjg\" (UniqueName: \"kubernetes.io/projected/ce36df29-3927-41f0-bd4a-5d80b71badd3-kube-api-access-jgnjg\") pod \"cert-manager-webhook-6486ffd997-hjs76\" (UID: \"ce36df29-3927-41f0-bd4a-5d80b71badd3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.209629 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209475 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.209629 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.209629 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr6l8\" (UniqueName: \"kubernetes.io/projected/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-kube-api-access-rr6l8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.209977 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209958 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.209977 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.209971 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.218232 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.218199 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce36df29-3927-41f0-bd4a-5d80b71badd3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hjs76\" (UID: \"ce36df29-3927-41f0-bd4a-5d80b71badd3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.218232 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.218199 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr6l8\" (UniqueName: \"kubernetes.io/projected/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-kube-api-access-rr6l8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.218385 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.218341 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgnjg\" (UniqueName: \"kubernetes.io/projected/ce36df29-3927-41f0-bd4a-5d80b71badd3-kube-api-access-jgnjg\") pod \"cert-manager-webhook-6486ffd997-hjs76\" (UID: \"ce36df29-3927-41f0-bd4a-5d80b71badd3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.261356 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.261315 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:37.356082 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.356051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:37.393657 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.393628 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr"] Jul 02 16:45:37.396613 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:45:37.396586 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acb5e54_7bbf_4520_a6bb_df8a4f6714c8.slice/crio-04f56a2b6af0dc6446b54d11e3481199cae13b934b21ca41bf3cf6b8e9137960 WatchSource:0}: Error finding container 04f56a2b6af0dc6446b54d11e3481199cae13b934b21ca41bf3cf6b8e9137960: Status 404 returned error can't find the container with id 04f56a2b6af0dc6446b54d11e3481199cae13b934b21ca41bf3cf6b8e9137960 Jul 02 16:45:37.494643 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:37.494614 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hjs76"] Jul 02 16:45:37.497029 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:45:37.497004 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce36df29_3927_41f0_bd4a_5d80b71badd3.slice/crio-6b6805d35f9f70dceded1e8219c45afdcedb62de8d09f27a6db15e8f237a89e4 WatchSource:0}: Error finding container 6b6805d35f9f70dceded1e8219c45afdcedb62de8d09f27a6db15e8f237a89e4: Status 404 returned error can't find the container with id 6b6805d35f9f70dceded1e8219c45afdcedb62de8d09f27a6db15e8f237a89e4 Jul 02 16:45:38.371106 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:38.371066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" event={"ID":"ce36df29-3927-41f0-bd4a-5d80b71badd3","Type":"ContainerStarted","Data":"6b6805d35f9f70dceded1e8219c45afdcedb62de8d09f27a6db15e8f237a89e4"} Jul 02 16:45:38.373060 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:38.373027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" event={"ID":"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8","Type":"ContainerStarted","Data":"04f56a2b6af0dc6446b54d11e3481199cae13b934b21ca41bf3cf6b8e9137960"} Jul 02 16:45:39.165165 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.165117 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:39.541422 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.541367 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9"] Jul 02 16:45:39.545081 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.545053 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.547650 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.547627 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wz7ls\"" Jul 02 16:45:39.556681 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.556534 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9"] Jul 02 16:45:39.571493 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.571416 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:39.630617 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.630510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6b8m\" (UniqueName: \"kubernetes.io/projected/0f12237b-db68-4dd6-93c3-489a77fccbb7-kube-api-access-r6b8m\") pod \"cert-manager-cainjector-559cdd8c87-2xnx9\" (UID: \"0f12237b-db68-4dd6-93c3-489a77fccbb7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.630617 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.630596 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f12237b-db68-4dd6-93c3-489a77fccbb7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2xnx9\" (UID: \"0f12237b-db68-4dd6-93c3-489a77fccbb7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.731101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.731061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6b8m\" (UniqueName: \"kubernetes.io/projected/0f12237b-db68-4dd6-93c3-489a77fccbb7-kube-api-access-r6b8m\") pod \"cert-manager-cainjector-559cdd8c87-2xnx9\" (UID: \"0f12237b-db68-4dd6-93c3-489a77fccbb7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.731272 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.731156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f12237b-db68-4dd6-93c3-489a77fccbb7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2xnx9\" (UID: \"0f12237b-db68-4dd6-93c3-489a77fccbb7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.740115 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.740057 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6b8m\" (UniqueName: \"kubernetes.io/projected/0f12237b-db68-4dd6-93c3-489a77fccbb7-kube-api-access-r6b8m\") pod \"cert-manager-cainjector-559cdd8c87-2xnx9\" (UID: \"0f12237b-db68-4dd6-93c3-489a77fccbb7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.740453 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.740419 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f12237b-db68-4dd6-93c3-489a77fccbb7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2xnx9\" (UID: \"0f12237b-db68-4dd6-93c3-489a77fccbb7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:39.858396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:39.858311 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" Jul 02 16:45:40.222321 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:40.222172 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:40.322982 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:40.322911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:40.415728 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:40.415565 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9"] Jul 02 16:45:40.418284 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:45:40.418260 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f12237b_db68_4dd6_93c3_489a77fccbb7.slice/crio-2bd07302dd022095b71c251be67f90d5d5ee291661bd6cf639ffacfd2e4990ba WatchSource:0}: Error finding container 2bd07302dd022095b71c251be67f90d5d5ee291661bd6cf639ffacfd2e4990ba: Status 404 returned error can't find the container with id 2bd07302dd022095b71c251be67f90d5d5ee291661bd6cf639ffacfd2e4990ba Jul 02 16:45:41.387533 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:41.387456 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" event={"ID":"0f12237b-db68-4dd6-93c3-489a77fccbb7","Type":"ContainerStarted","Data":"b1b66fecaf2f83c2f41aa9084f08c017cd6cb52af42b83d43c11975fac70861b"} Jul 02 16:45:41.387533 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:41.387504 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" event={"ID":"0f12237b-db68-4dd6-93c3-489a77fccbb7","Type":"ContainerStarted","Data":"2bd07302dd022095b71c251be67f90d5d5ee291661bd6cf639ffacfd2e4990ba"} Jul 02 16:45:41.389105 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:41.389074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" event={"ID":"ce36df29-3927-41f0-bd4a-5d80b71badd3","Type":"ContainerStarted","Data":"49c5cccb8c73df7194c6974e6aa443c144f0b4310fd0133051fa5c3c701b2bbb"} Jul 02 16:45:41.389219 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:41.389199 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:41.420262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:41.420191 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2xnx9" podStartSLOduration=2.420166132 podStartE2EDuration="2.420166132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:45:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:45:41.419556638 +0000 UTC m=+461.055479844" watchObservedRunningTime="2026-07-02 16:45:41.420166132 +0000 UTC m=+461.056089334" Jul 02 16:45:41.444217 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:41.444150 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" podStartSLOduration=1.599723679 podStartE2EDuration="4.444128594s" totalImagesPullingTime="2.844404915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:45:41.442345081 +0000 UTC m=+461.078268287" watchObservedRunningTime="2026-07-02 16:45:41.444128594 +0000 UTC m=+461.080051799" Jul 02 16:45:45.409727 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:45.409670 2560 generic.go:356] "Generic (PLEG): container finished" podID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerID="6640f3dc57f612570ff5760ca5cd283117fa64398ca013af1ec57fa2544b4bc7" exitCode=0 Jul 02 16:45:45.410099 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:45.409735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" event={"ID":"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8","Type":"ContainerDied","Data":"6640f3dc57f612570ff5760ca5cd283117fa64398ca013af1ec57fa2544b4bc7"} Jul 02 16:45:46.357348 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:46.357313 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:45:47.395172 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:47.395141 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hjs76" Jul 02 16:45:47.420993 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:47.420955 2560 generic.go:356] "Generic (PLEG): container finished" podID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerID="96f22c6c1f6938fb475505a9ed113b49569cf6270c5812800cf515a4ca623483" exitCode=0 Jul 02 16:45:47.421176 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:47.421042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" event={"ID":"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8","Type":"ContainerDied","Data":"96f22c6c1f6938fb475505a9ed113b49569cf6270c5812800cf515a4ca623483"} Jul 02 16:45:56.464049 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:56.464012 2560 generic.go:356] "Generic (PLEG): container finished" podID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerID="7da90d4c131246cdf393aafff4940599f27f131d0b3ae08e8c9fe6fb9d03239d" exitCode=0 Jul 02 16:45:56.464395 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:56.464071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" event={"ID":"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8","Type":"ContainerDied","Data":"7da90d4c131246cdf393aafff4940599f27f131d0b3ae08e8c9fe6fb9d03239d"} Jul 02 16:45:57.599675 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.599645 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:57.789444 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.789408 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-bundle\") pod \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " Jul 02 16:45:57.789617 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.789465 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr6l8\" (UniqueName: \"kubernetes.io/projected/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-kube-api-access-rr6l8\") pod \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " Jul 02 16:45:57.789617 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.789498 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-util\") pod \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\" (UID: \"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8\") " Jul 02 16:45:57.789834 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.789808 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-bundle" (OuterVolumeSpecName: "bundle") pod "0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" (UID: "0acb5e54-7bbf-4520-a6bb-df8a4f6714c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:45:57.791891 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.791866 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-kube-api-access-rr6l8" (OuterVolumeSpecName: "kube-api-access-rr6l8") pod "0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" (UID: "0acb5e54-7bbf-4520-a6bb-df8a4f6714c8"). InnerVolumeSpecName "kube-api-access-rr6l8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:45:57.794758 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.794734 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-util" (OuterVolumeSpecName: "util") pod "0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" (UID: "0acb5e54-7bbf-4520-a6bb-df8a4f6714c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:45:57.890394 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.890359 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:45:57.890394 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.890388 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr6l8\" (UniqueName: \"kubernetes.io/projected/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-kube-api-access-rr6l8\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:45:57.890394 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:57.890399 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0acb5e54-7bbf-4520-a6bb-df8a4f6714c8-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:45:58.474461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:58.474420 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" event={"ID":"0acb5e54-7bbf-4520-a6bb-df8a4f6714c8","Type":"ContainerDied","Data":"04f56a2b6af0dc6446b54d11e3481199cae13b934b21ca41bf3cf6b8e9137960"} Jul 02 16:45:58.474461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:58.474453 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdfbwr" Jul 02 16:45:58.474461 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:58.474467 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04f56a2b6af0dc6446b54d11e3481199cae13b934b21ca41bf3cf6b8e9137960" Jul 02 16:45:59.011470 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:45:59.011437 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:03.633755 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:03.633723 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:03.736297 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:03.736262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:08.839616 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:08.839576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:08.888599 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:08.888564 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:10.822667 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:10.822612 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:10.923787 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:10.923743 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:12.862160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:12.862124 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:19.032699 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:19.032647 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:22.960885 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:22.960831 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:25.624916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:25.624887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:25.727441 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:25.727406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:26.240086 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.240047 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:26.429429 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.429397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:26.536761 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.536727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:26.573467 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573440 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt"] Jul 02 16:46:26.573754 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573742 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="pull" Jul 02 16:46:26.573837 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573756 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="pull" Jul 02 16:46:26.573837 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573766 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="util" Jul 02 16:46:26.573837 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573771 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="util" Jul 02 16:46:26.573837 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573786 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="extract" Jul 02 16:46:26.573837 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573791 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="extract" Jul 02 16:46:26.573837 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.573835 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0acb5e54-7bbf-4520-a6bb-df8a4f6714c8" containerName="extract" Jul 02 16:46:26.597944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.597916 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.598109 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.598030 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt"] Jul 02 16:46:26.605284 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.605258 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 16:46:26.605436 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.605419 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 16:46:26.605535 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.605460 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 16:46:26.605535 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.605470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 16:46:26.606666 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.606647 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7pkb\"" Jul 02 16:46:26.700788 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.700747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kclkq\" (UniqueName: \"kubernetes.io/projected/9fbad091-1936-43d9-89b0-812b0a60932e-kube-api-access-kclkq\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.701213 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.700806 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fbad091-1936-43d9-89b0-812b0a60932e-tmp\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.701213 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.700902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9fbad091-1936-43d9-89b0-812b0a60932e-manifests\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.701213 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.700944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fbad091-1936-43d9-89b0-812b0a60932e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.701213 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.700969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9fbad091-1936-43d9-89b0-812b0a60932e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.724911 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.724865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:26.801649 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.801573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9fbad091-1936-43d9-89b0-812b0a60932e-manifests\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.801649 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.801612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fbad091-1936-43d9-89b0-812b0a60932e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.801649 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.801633 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9fbad091-1936-43d9-89b0-812b0a60932e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.801942 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.801656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kclkq\" (UniqueName: \"kubernetes.io/projected/9fbad091-1936-43d9-89b0-812b0a60932e-kube-api-access-kclkq\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.801942 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.801678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fbad091-1936-43d9-89b0-812b0a60932e-tmp\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.802064 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.802045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9fbad091-1936-43d9-89b0-812b0a60932e-manifests\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.803999 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.803977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fbad091-1936-43d9-89b0-812b0a60932e-tmp\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.804250 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.804232 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fbad091-1936-43d9-89b0-812b0a60932e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.804324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.804302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9fbad091-1936-43d9-89b0-812b0a60932e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.813869 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.813845 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kclkq\" (UniqueName: \"kubernetes.io/projected/9fbad091-1936-43d9-89b0-812b0a60932e-kube-api-access-kclkq\") pod \"opendatahub-operator-controller-manager-6486c9fccb-gh6pt\" (UID: \"9fbad091-1936-43d9-89b0-812b0a60932e\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.824557 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.824500 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:26.908656 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.908620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:26.929064 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:26.929023 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:27.006301 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:27.006256 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:27.079734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:27.079677 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt"] Jul 02 16:46:27.082756 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:46:27.082723 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbad091_1936_43d9_89b0_812b0a60932e.slice/crio-2f24e6ca9fb514b49afb0a872cb2826a49b9fc6d96d63e6c20c64a60d402b28c WatchSource:0}: Error finding container 2f24e6ca9fb514b49afb0a872cb2826a49b9fc6d96d63e6c20c64a60d402b28c: Status 404 returned error can't find the container with id 2f24e6ca9fb514b49afb0a872cb2826a49b9fc6d96d63e6c20c64a60d402b28c Jul 02 16:46:27.091284 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:27.091256 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:27.208310 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:27.208274 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:27.598455 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:27.598420 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" event={"ID":"9fbad091-1936-43d9-89b0-812b0a60932e","Type":"ContainerStarted","Data":"2f24e6ca9fb514b49afb0a872cb2826a49b9fc6d96d63e6c20c64a60d402b28c"} Jul 02 16:46:30.617799 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:30.617761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" event={"ID":"9fbad091-1936-43d9-89b0-812b0a60932e","Type":"ContainerStarted","Data":"84f504ebe9506c0ac60b94f7576af5b0539833b514e0addc024e5df32d202f35"} Jul 02 16:46:31.623641 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:31.623608 2560 generic.go:356] "Generic (PLEG): container finished" podID="9fbad091-1936-43d9-89b0-812b0a60932e" containerID="84f504ebe9506c0ac60b94f7576af5b0539833b514e0addc024e5df32d202f35" exitCode=0 Jul 02 16:46:31.624101 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:31.623674 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" event={"ID":"9fbad091-1936-43d9-89b0-812b0a60932e","Type":"ContainerDied","Data":"84f504ebe9506c0ac60b94f7576af5b0539833b514e0addc024e5df32d202f35"} Jul 02 16:46:32.629571 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:32.629537 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" event={"ID":"9fbad091-1936-43d9-89b0-812b0a60932e","Type":"ContainerStarted","Data":"5694f69a0d85d4d67b66d58053ecf0ec23d2e01fb05aef543d00804b2ddd63e4"} Jul 02 16:46:32.630015 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:32.629674 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:32.652205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:32.652155 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" podStartSLOduration=2.307872691 podStartE2EDuration="6.652139107s" totalImagesPullingTime="3.336870939s" totalInitContainerRuntime="1.007395477s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:32.649592298 +0000 UTC m=+512.285515500" watchObservedRunningTime="2026-07-02 16:46:32.652139107 +0000 UTC m=+512.288062309" Jul 02 16:46:37.862523 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:37.862475 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:37.962024 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:37.961987 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:43.636321 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:43.636283 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-gh6pt" Jul 02 16:46:45.355245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:45.355211 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:45.529547 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:45.529505 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:48.468730 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.468661 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:48.534933 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.534898 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cc966699b-rxj55"] Jul 02 16:46:48.543797 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.543774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.546784 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.546762 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 16:46:48.546784 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.546775 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 16:46:48.547069 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.547053 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-clsw2\"" Jul 02 16:46:48.548155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.548076 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc966699b-rxj55"] Jul 02 16:46:48.690170 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.690133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45f7eec3-0fc6-4697-80e9-0eaec554c187-tls-certs\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.690364 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.690191 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9csr\" (UniqueName: \"kubernetes.io/projected/45f7eec3-0fc6-4697-80e9-0eaec554c187-kube-api-access-z9csr\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.690364 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.690226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45f7eec3-0fc6-4697-80e9-0eaec554c187-tmp\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.754850 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.754752 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:48.791160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.791133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45f7eec3-0fc6-4697-80e9-0eaec554c187-tmp\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.791335 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.791174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45f7eec3-0fc6-4697-80e9-0eaec554c187-tls-certs\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.791335 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.791213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9csr\" (UniqueName: \"kubernetes.io/projected/45f7eec3-0fc6-4697-80e9-0eaec554c187-kube-api-access-z9csr\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.793639 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.793611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45f7eec3-0fc6-4697-80e9-0eaec554c187-tmp\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.793759 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.793664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45f7eec3-0fc6-4697-80e9-0eaec554c187-tls-certs\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.801017 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.800981 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9csr\" (UniqueName: \"kubernetes.io/projected/45f7eec3-0fc6-4697-80e9-0eaec554c187-kube-api-access-z9csr\") pod \"kube-auth-proxy-cc966699b-rxj55\" (UID: \"45f7eec3-0fc6-4697-80e9-0eaec554c187\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.855297 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.855264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" Jul 02 16:46:48.861069 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.861028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:48.956669 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.956624 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:48.985018 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:48.984918 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc966699b-rxj55"] Jul 02 16:46:48.987619 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:46:48.987594 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f7eec3_0fc6_4697_80e9_0eaec554c187.slice/crio-ca5bd0b02ad7bb1dde0519daf5251d435e9ef1aa705c519f55c338ad3294c7e9 WatchSource:0}: Error finding container ca5bd0b02ad7bb1dde0519daf5251d435e9ef1aa705c519f55c338ad3294c7e9: Status 404 returned error can't find the container with id ca5bd0b02ad7bb1dde0519daf5251d435e9ef1aa705c519f55c338ad3294c7e9 Jul 02 16:46:49.104184 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.104147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:49.466134 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.466047 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:49.545450 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.545415 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gvtw2"] Jul 02 16:46:49.549872 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.549854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.553421 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.553397 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jj4jh\"" Jul 02 16:46:49.553603 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.553578 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 16:46:49.565087 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.565062 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gvtw2"] Jul 02 16:46:49.663313 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.663274 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:49.699496 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.699462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2pw8\" (UniqueName: \"kubernetes.io/projected/7506303a-781b-4f94-a5c8-455b49da85b6-kube-api-access-l2pw8\") pod \"model-serving-api-54d89bd5fc-gvtw2\" (UID: \"7506303a-781b-4f94-a5c8-455b49da85b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.699670 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.699505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7506303a-781b-4f94-a5c8-455b49da85b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gvtw2\" (UID: \"7506303a-781b-4f94-a5c8-455b49da85b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.709364 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.709333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" event={"ID":"45f7eec3-0fc6-4697-80e9-0eaec554c187","Type":"ContainerStarted","Data":"ca5bd0b02ad7bb1dde0519daf5251d435e9ef1aa705c519f55c338ad3294c7e9"} Jul 02 16:46:49.790303 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.790266 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:49.800587 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.800560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2pw8\" (UniqueName: \"kubernetes.io/projected/7506303a-781b-4f94-a5c8-455b49da85b6-kube-api-access-l2pw8\") pod \"model-serving-api-54d89bd5fc-gvtw2\" (UID: \"7506303a-781b-4f94-a5c8-455b49da85b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.800740 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.800608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7506303a-781b-4f94-a5c8-455b49da85b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gvtw2\" (UID: \"7506303a-781b-4f94-a5c8-455b49da85b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.803081 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.803061 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7506303a-781b-4f94-a5c8-455b49da85b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gvtw2\" (UID: \"7506303a-781b-4f94-a5c8-455b49da85b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.819060 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.819039 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2pw8\" (UniqueName: \"kubernetes.io/projected/7506303a-781b-4f94-a5c8-455b49da85b6-kube-api-access-l2pw8\") pod \"model-serving-api-54d89bd5fc-gvtw2\" (UID: \"7506303a-781b-4f94-a5c8-455b49da85b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:49.855311 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.855278 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:49.860129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:49.860104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:50.017252 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:50.017214 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gvtw2"] Jul 02 16:46:50.020950 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:46:50.020918 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7506303a_781b_4f94_a5c8_455b49da85b6.slice/crio-9946a4286d186e40382d962c668c5ba548a7bbcb97d68c29f6254f701307fe49 WatchSource:0}: Error finding container 9946a4286d186e40382d962c668c5ba548a7bbcb97d68c29f6254f701307fe49: Status 404 returned error can't find the container with id 9946a4286d186e40382d962c668c5ba548a7bbcb97d68c29f6254f701307fe49 Jul 02 16:46:50.715294 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:50.715253 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" event={"ID":"7506303a-781b-4f94-a5c8-455b49da85b6","Type":"ContainerStarted","Data":"9946a4286d186e40382d962c668c5ba548a7bbcb97d68c29f6254f701307fe49"} Jul 02 16:46:50.795324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:50.795288 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:51.753918 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:51.753812 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:51.808673 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:51.808638 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:52.726512 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:52.726407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" event={"ID":"45f7eec3-0fc6-4697-80e9-0eaec554c187","Type":"ContainerStarted","Data":"7aac2afa88245195c766a72c7e812ca69eaf82cb6462e240587bea0223cb41fa"} Jul 02 16:46:52.727900 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:52.727867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" event={"ID":"7506303a-781b-4f94-a5c8-455b49da85b6","Type":"ContainerStarted","Data":"15f6cc9384a9b6e0bcca8e59a5f16abb870bf987ba7bc482436c8da3bfd38c2b"} Jul 02 16:46:52.728038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:52.727993 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:46:52.743253 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:52.743205 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cc966699b-rxj55" podStartSLOduration=1.248612423 podStartE2EDuration="4.743190555s" totalImagesPullingTime="3.494578132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:52.742208758 +0000 UTC m=+532.378131959" watchObservedRunningTime="2026-07-02 16:46:52.743190555 +0000 UTC m=+532.379113756" Jul 02 16:46:52.758308 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:52.758260 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" podStartSLOduration=1.307095002 podStartE2EDuration="3.758246412s" totalImagesPullingTime="2.45115141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:52.757492832 +0000 UTC m=+532.393416034" watchObservedRunningTime="2026-07-02 16:46:52.758246412 +0000 UTC m=+532.394169625" Jul 02 16:46:55.004815 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.004762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:55.112084 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.112049 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:55.574595 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.574565 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x"] Jul 02 16:46:55.578155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.578132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.580878 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.580847 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bl4rd\"" Jul 02 16:46:55.580878 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.580876 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 16:46:55.581073 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.580945 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 16:46:55.581073 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.580879 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 16:46:55.581073 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.581020 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 16:46:55.590418 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.590381 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x"] Jul 02 16:46:55.692993 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.692959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:55.755551 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.755771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.755771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755576 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtchw\" (UniqueName: \"kubernetes.io/projected/44c773d3-044c-4ecd-8e8b-4402a2d630cd-kube-api-access-wtchw\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.755771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c773d3-044c-4ecd-8e8b-4402a2d630cd-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.755771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.755916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.755916 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.755831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856542 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856542 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtchw\" (UniqueName: \"kubernetes.io/projected/44c773d3-044c-4ecd-8e8b-4402a2d630cd-kube-api-access-wtchw\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856804 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c773d3-044c-4ecd-8e8b-4402a2d630cd-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856804 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856804 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856939 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.856939 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.856920 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.857609 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.857537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.859295 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.859266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.859402 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.859338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.859521 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.859502 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c773d3-044c-4ecd-8e8b-4402a2d630cd-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.859645 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.859628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.878773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.878737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c773d3-044c-4ecd-8e8b-4402a2d630cd-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.878904 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.878838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtchw\" (UniqueName: \"kubernetes.io/projected/44c773d3-044c-4ecd-8e8b-4402a2d630cd-kube-api-access-wtchw\") pod \"istiod-openshift-gateway-94bb8fbfd-spw8x\" (UID: \"44c773d3-044c-4ecd-8e8b-4402a2d630cd\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.887764 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.887740 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:55.984770 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:55.984734 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:56.043041 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:56.043016 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x"] Jul 02 16:46:56.077329 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:56.077296 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:56.747347 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:56.747308 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" event={"ID":"44c773d3-044c-4ecd-8e8b-4402a2d630cd","Type":"ContainerStarted","Data":"83931c99a90709e782119810f58a2c0fc0738ee74ae51bf2692e544036331d20"} Jul 02 16:46:58.253159 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.253100 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:58.335472 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.335424 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:58.451320 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.451284 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 16:46:58.451427 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.451352 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 16:46:58.748142 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.748077 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:58.759824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.759730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" event={"ID":"44c773d3-044c-4ecd-8e8b-4402a2d630cd","Type":"ContainerStarted","Data":"0967ea99c451732d23872462ab36d149a29deaa5ea77ce7c6604dc5c535af178"} Jul 02 16:46:58.759959 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.759853 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:58.785557 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:58.785506 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" podStartSLOduration=1.383841668 podStartE2EDuration="3.785491214s" totalImagesPullingTime="2.401649546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:58.784039271 +0000 UTC m=+538.419962497" watchObservedRunningTime="2026-07-02 16:46:58.785491214 +0000 UTC m=+538.421414415" Jul 02 16:46:59.236295 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:59.236251 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:59.543235 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:59.543200 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:59.656143 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:59.656104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:46:59.765968 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:59.765937 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-spw8x" Jul 02 16:46:59.792664 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:46:59.792629 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:47:01.489984 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:01.489942 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:47:03.736363 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:03.736336 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gvtw2" Jul 02 16:47:34.956134 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:34.956104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:47:35.056168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:35.056128 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:47:47.605445 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.605405 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:47:47.730447 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.730413 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4p9d"] Jul 02 16:47:47.736061 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.736038 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:47.738903 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.738876 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rcvjj\"" Jul 02 16:47:47.738903 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.738897 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 16:47:47.739086 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.738898 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 16:47:47.750825 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.747296 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4p9d"] Jul 02 16:47:47.857785 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.857677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz6vk\" (UniqueName: \"kubernetes.io/projected/c2b32bee-5e94-48fd-8dd2-2adeaa569b93-kube-api-access-gz6vk\") pod \"kuadrant-operator-catalog-d4p9d\" (UID: \"c2b32bee-5e94-48fd-8dd2-2adeaa569b93\") " pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:47.959152 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.959109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz6vk\" (UniqueName: \"kubernetes.io/projected/c2b32bee-5e94-48fd-8dd2-2adeaa569b93-kube-api-access-gz6vk\") pod \"kuadrant-operator-catalog-d4p9d\" (UID: \"c2b32bee-5e94-48fd-8dd2-2adeaa569b93\") " pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:47.968225 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:47.968199 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz6vk\" (UniqueName: \"kubernetes.io/projected/c2b32bee-5e94-48fd-8dd2-2adeaa569b93-kube-api-access-gz6vk\") pod \"kuadrant-operator-catalog-d4p9d\" (UID: \"c2b32bee-5e94-48fd-8dd2-2adeaa569b93\") " pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:48.053908 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.053864 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:48.095944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.095906 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4p9d"] Jul 02 16:47:48.192678 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.192655 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4p9d"] Jul 02 16:47:48.194964 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:47:48.194939 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b32bee_5e94_48fd_8dd2_2adeaa569b93.slice/crio-2ea81f4717ebe185a541fb74acc706db7730429ece5c58f388c6a999724b2e4a WatchSource:0}: Error finding container 2ea81f4717ebe185a541fb74acc706db7730429ece5c58f388c6a999724b2e4a: Status 404 returned error can't find the container with id 2ea81f4717ebe185a541fb74acc706db7730429ece5c58f388c6a999724b2e4a Jul 02 16:47:48.305334 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.305294 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4w4qh"] Jul 02 16:47:48.308732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.308714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:48.317275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.317250 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4w4qh"] Jul 02 16:47:48.362750 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.362712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z7sb\" (UniqueName: \"kubernetes.io/projected/dd9a16ca-e77e-4aec-8798-a46f3fb40040-kube-api-access-8z7sb\") pod \"kuadrant-operator-catalog-4w4qh\" (UID: \"dd9a16ca-e77e-4aec-8798-a46f3fb40040\") " pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:48.463390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.463297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z7sb\" (UniqueName: \"kubernetes.io/projected/dd9a16ca-e77e-4aec-8798-a46f3fb40040-kube-api-access-8z7sb\") pod \"kuadrant-operator-catalog-4w4qh\" (UID: \"dd9a16ca-e77e-4aec-8798-a46f3fb40040\") " pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:48.475116 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.475091 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z7sb\" (UniqueName: \"kubernetes.io/projected/dd9a16ca-e77e-4aec-8798-a46f3fb40040-kube-api-access-8z7sb\") pod \"kuadrant-operator-catalog-4w4qh\" (UID: \"dd9a16ca-e77e-4aec-8798-a46f3fb40040\") " pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:48.619059 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.619028 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:48.765368 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.765342 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4w4qh"] Jul 02 16:47:48.793447 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:47:48.793405 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9a16ca_e77e_4aec_8798_a46f3fb40040.slice/crio-82e3b1108177d76f2f593da856e62717ab547e1e389a63eac689666e59c5a473 WatchSource:0}: Error finding container 82e3b1108177d76f2f593da856e62717ab547e1e389a63eac689666e59c5a473: Status 404 returned error can't find the container with id 82e3b1108177d76f2f593da856e62717ab547e1e389a63eac689666e59c5a473 Jul 02 16:47:48.829589 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.829561 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:47:48.986713 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.986658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" event={"ID":"dd9a16ca-e77e-4aec-8798-a46f3fb40040","Type":"ContainerStarted","Data":"82e3b1108177d76f2f593da856e62717ab547e1e389a63eac689666e59c5a473"} Jul 02 16:47:48.987962 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:48.987931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" event={"ID":"c2b32bee-5e94-48fd-8dd2-2adeaa569b93","Type":"ContainerStarted","Data":"2ea81f4717ebe185a541fb74acc706db7730429ece5c58f388c6a999724b2e4a"} Jul 02 16:47:51.005144 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.005099 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" event={"ID":"c2b32bee-5e94-48fd-8dd2-2adeaa569b93","Type":"ContainerStarted","Data":"b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728"} Jul 02 16:47:51.005593 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.005179 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" podUID="c2b32bee-5e94-48fd-8dd2-2adeaa569b93" containerName="registry-server" containerID="cri-o://b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728" gracePeriod=2 Jul 02 16:47:51.026895 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.026845 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" podStartSLOduration=1.7502436540000001 podStartE2EDuration="4.026829165s" totalImagesPullingTime="2.276585511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:47:51.02623592 +0000 UTC m=+590.662159120" watchObservedRunningTime="2026-07-02 16:47:51.026829165 +0000 UTC m=+590.662752367" Jul 02 16:47:51.261108 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.261034 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:51.388385 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.388347 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz6vk\" (UniqueName: \"kubernetes.io/projected/c2b32bee-5e94-48fd-8dd2-2adeaa569b93-kube-api-access-gz6vk\") pod \"c2b32bee-5e94-48fd-8dd2-2adeaa569b93\" (UID: \"c2b32bee-5e94-48fd-8dd2-2adeaa569b93\") " Jul 02 16:47:51.390765 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.390736 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b32bee-5e94-48fd-8dd2-2adeaa569b93-kube-api-access-gz6vk" (OuterVolumeSpecName: "kube-api-access-gz6vk") pod "c2b32bee-5e94-48fd-8dd2-2adeaa569b93" (UID: "c2b32bee-5e94-48fd-8dd2-2adeaa569b93"). InnerVolumeSpecName "kube-api-access-gz6vk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:47:51.489408 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:51.489358 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz6vk\" (UniqueName: \"kubernetes.io/projected/c2b32bee-5e94-48fd-8dd2-2adeaa569b93-kube-api-access-gz6vk\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:47:52.010634 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.010597 2560 generic.go:356] "Generic (PLEG): container finished" podID="c2b32bee-5e94-48fd-8dd2-2adeaa569b93" containerID="b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728" exitCode=0 Jul 02 16:47:52.011128 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.010642 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" Jul 02 16:47:52.011128 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.010662 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" event={"ID":"c2b32bee-5e94-48fd-8dd2-2adeaa569b93","Type":"ContainerDied","Data":"b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728"} Jul 02 16:47:52.011128 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.010722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4p9d" event={"ID":"c2b32bee-5e94-48fd-8dd2-2adeaa569b93","Type":"ContainerDied","Data":"2ea81f4717ebe185a541fb74acc706db7730429ece5c58f388c6a999724b2e4a"} Jul 02 16:47:52.011128 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.010741 2560 scope.go:117] "RemoveContainer" containerID="b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728" Jul 02 16:47:52.019828 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.019809 2560 scope.go:117] "RemoveContainer" containerID="b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728" Jul 02 16:47:52.020136 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:47:52.020119 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728\": container with ID starting with b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728 not found: ID does not exist" containerID="b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728" Jul 02 16:47:52.020184 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.020146 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728"} err="failed to get container status \"b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728\": rpc error: code = NotFound desc = could not find container \"b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728\": container with ID starting with b25684fed70fcb7073aa38c4c6810f000fab989be03fce8624e0f29cf0b38728 not found: ID does not exist" Jul 02 16:47:52.031001 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.030973 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4p9d"] Jul 02 16:47:52.034892 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.034868 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4p9d"] Jul 02 16:47:52.791518 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:52.791490 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b32bee-5e94-48fd-8dd2-2adeaa569b93" path="/var/lib/kubelet/pods/c2b32bee-5e94-48fd-8dd2-2adeaa569b93/volumes" Jul 02 16:47:53.016072 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:53.016034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" event={"ID":"dd9a16ca-e77e-4aec-8798-a46f3fb40040","Type":"ContainerStarted","Data":"df453880b70f3619812d4cae2060dff9adf08547f4907fcb37027541c3374b7c"} Jul 02 16:47:53.032385 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:53.032329 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" podStartSLOduration=1.490351885 podStartE2EDuration="5.032314212s" totalImagesPullingTime="3.541962327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:47:53.031295357 +0000 UTC m=+592.667218554" watchObservedRunningTime="2026-07-02 16:47:53.032314212 +0000 UTC m=+592.668237413" Jul 02 16:47:58.620194 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:58.620147 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:58.620609 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:58.620218 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:58.643554 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:58.643525 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:47:59.065802 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:47:59.065773 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4w4qh" Jul 02 16:48:00.766506 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:00.766473 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:48:00.768738 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:00.768720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:48:03.136604 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.136569 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7"] Jul 02 16:48:03.138773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.136895 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b32bee-5e94-48fd-8dd2-2adeaa569b93" containerName="registry-server" Jul 02 16:48:03.138773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.136906 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b32bee-5e94-48fd-8dd2-2adeaa569b93" containerName="registry-server" Jul 02 16:48:03.138773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.136960 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b32bee-5e94-48fd-8dd2-2adeaa569b93" containerName="registry-server" Jul 02 16:48:03.139794 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.139778 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.142433 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.142413 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bktd\"" Jul 02 16:48:03.148579 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.148554 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7"] Jul 02 16:48:03.291130 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.291088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.291326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.291206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.291326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.291234 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5pl\" (UniqueName: \"kubernetes.io/projected/24f0d9b1-77fc-404b-bbd7-27c04306a27a-kube-api-access-wx5pl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.392390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.392306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.392390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.392346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5pl\" (UniqueName: \"kubernetes.io/projected/24f0d9b1-77fc-404b-bbd7-27c04306a27a-kube-api-access-wx5pl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.392390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.392374 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.392732 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.392682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.392801 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.392748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.400951 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.400934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5pl\" (UniqueName: \"kubernetes.io/projected/24f0d9b1-77fc-404b-bbd7-27c04306a27a-kube-api-access-wx5pl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.449937 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.449903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:03.579417 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.579392 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7"] Jul 02 16:48:03.581788 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:03.581756 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f0d9b1_77fc_404b_bbd7_27c04306a27a.slice/crio-e675b333722410558614c2801e989a12a615e36ef7c4d544de7000454c2dd0d3 WatchSource:0}: Error finding container e675b333722410558614c2801e989a12a615e36ef7c4d544de7000454c2dd0d3: Status 404 returned error can't find the container with id e675b333722410558614c2801e989a12a615e36ef7c4d544de7000454c2dd0d3 Jul 02 16:48:03.736455 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.736425 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth"] Jul 02 16:48:03.739859 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.739835 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.749891 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.749864 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth"] Jul 02 16:48:03.897563 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.897529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.897753 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.897578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.897753 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.897682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg7ff\" (UniqueName: \"kubernetes.io/projected/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-kube-api-access-jg7ff\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.999000 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.998909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.999000 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.998961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.999000 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.998996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg7ff\" (UniqueName: \"kubernetes.io/projected/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-kube-api-access-jg7ff\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.999328 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.999301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:03.999371 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:03.999326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:04.006950 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.006924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg7ff\" (UniqueName: \"kubernetes.io/projected/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-kube-api-access-jg7ff\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:04.049508 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.049474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:04.068583 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.068542 2560 generic.go:356] "Generic (PLEG): container finished" podID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerID="f6f1b1d045cf586e8d3f9850bb9f27a72d18df99ccaccf9cb284c1b431838bd7" exitCode=0 Jul 02 16:48:04.068740 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.068599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" event={"ID":"24f0d9b1-77fc-404b-bbd7-27c04306a27a","Type":"ContainerDied","Data":"f6f1b1d045cf586e8d3f9850bb9f27a72d18df99ccaccf9cb284c1b431838bd7"} Jul 02 16:48:04.068740 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.068637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" event={"ID":"24f0d9b1-77fc-404b-bbd7-27c04306a27a","Type":"ContainerStarted","Data":"e675b333722410558614c2801e989a12a615e36ef7c4d544de7000454c2dd0d3"} Jul 02 16:48:04.147344 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.147307 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm"] Jul 02 16:48:04.151840 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.151817 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.158223 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.158189 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm"] Jul 02 16:48:04.193480 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.193451 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth"] Jul 02 16:48:04.195182 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:04.195157 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b68a89_4dd5_47ea_a52c_9483f3fbb57e.slice/crio-4d8c4c5fdb785858399b39986c4931bacdd8e44be26a9870100968ea4406d413 WatchSource:0}: Error finding container 4d8c4c5fdb785858399b39986c4931bacdd8e44be26a9870100968ea4406d413: Status 404 returned error can't find the container with id 4d8c4c5fdb785858399b39986c4931bacdd8e44be26a9870100968ea4406d413 Jul 02 16:48:04.301561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.301533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.301700 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.301600 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjlh\" (UniqueName: \"kubernetes.io/projected/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-kube-api-access-rwjlh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.301700 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.301638 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.402914 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.402872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.403100 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.402948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.403100 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.403008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjlh\" (UniqueName: \"kubernetes.io/projected/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-kube-api-access-rwjlh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.403389 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.403368 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.403454 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.403367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.411331 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.411299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjlh\" (UniqueName: \"kubernetes.io/projected/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-kube-api-access-rwjlh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.466882 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.466829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:04.536277 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.536241 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c"] Jul 02 16:48:04.543360 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.543335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.548168 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.548145 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c"] Jul 02 16:48:04.607997 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.607973 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm"] Jul 02 16:48:04.610056 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:04.610026 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b1bf4f_aeb3_40e1_bc9a_8beeb24842c1.slice/crio-f01971a70489d568506fe283b5da74e806376834f16f2e81bbc1f310479ca59f WatchSource:0}: Error finding container f01971a70489d568506fe283b5da74e806376834f16f2e81bbc1f310479ca59f: Status 404 returned error can't find the container with id f01971a70489d568506fe283b5da74e806376834f16f2e81bbc1f310479ca59f Jul 02 16:48:04.706396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.706361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.706396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.706415 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.706638 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.706493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stl6l\" (UniqueName: \"kubernetes.io/projected/e5b29873-066f-46b4-be9a-9384ce22d2fe-kube-api-access-stl6l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.807582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.807547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.807824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.807593 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.807824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.807622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stl6l\" (UniqueName: \"kubernetes.io/projected/e5b29873-066f-46b4-be9a-9384ce22d2fe-kube-api-access-stl6l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.808044 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.808020 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.808104 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.808043 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.815993 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.815970 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stl6l\" (UniqueName: \"kubernetes.io/projected/e5b29873-066f-46b4-be9a-9384ce22d2fe-kube-api-access-stl6l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.853902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.853871 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:04.985400 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:04.985374 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c"] Jul 02 16:48:05.027372 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:05.027338 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b29873_066f_46b4_be9a_9384ce22d2fe.slice/crio-55ee43245a6ac799597050aab3140560843f1b610780875a24fed78ff1962c7f WatchSource:0}: Error finding container 55ee43245a6ac799597050aab3140560843f1b610780875a24fed78ff1962c7f: Status 404 returned error can't find the container with id 55ee43245a6ac799597050aab3140560843f1b610780875a24fed78ff1962c7f Jul 02 16:48:05.077122 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.077088 2560 generic.go:356] "Generic (PLEG): container finished" podID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerID="5074601fdb57efa3ae5ebdd1417f07c28cf68b8a8422cc5997c484e694d1eb49" exitCode=0 Jul 02 16:48:05.077240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.077204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" event={"ID":"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1","Type":"ContainerDied","Data":"5074601fdb57efa3ae5ebdd1417f07c28cf68b8a8422cc5997c484e694d1eb49"} Jul 02 16:48:05.077321 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.077274 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" event={"ID":"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1","Type":"ContainerStarted","Data":"f01971a70489d568506fe283b5da74e806376834f16f2e81bbc1f310479ca59f"} Jul 02 16:48:05.078748 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.078723 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" event={"ID":"e5b29873-066f-46b4-be9a-9384ce22d2fe","Type":"ContainerStarted","Data":"55ee43245a6ac799597050aab3140560843f1b610780875a24fed78ff1962c7f"} Jul 02 16:48:05.080415 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.080392 2560 generic.go:356] "Generic (PLEG): container finished" podID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerID="6924a0d68c3f25a7df1a2b6bd80d428524bf595df55562c4a2c5f0848d6d5cfa" exitCode=0 Jul 02 16:48:05.080502 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.080431 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" event={"ID":"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e","Type":"ContainerDied","Data":"6924a0d68c3f25a7df1a2b6bd80d428524bf595df55562c4a2c5f0848d6d5cfa"} Jul 02 16:48:05.080502 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:05.080483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" event={"ID":"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e","Type":"ContainerStarted","Data":"4d8c4c5fdb785858399b39986c4931bacdd8e44be26a9870100968ea4406d413"} Jul 02 16:48:06.087388 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:06.087355 2560 generic.go:356] "Generic (PLEG): container finished" podID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerID="56a29263e4c25d82793ecd60e2ecdfb35efb3bd3254ca1a04b13a2d9dbc0fea2" exitCode=0 Jul 02 16:48:06.087884 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:06.087440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" event={"ID":"24f0d9b1-77fc-404b-bbd7-27c04306a27a","Type":"ContainerDied","Data":"56a29263e4c25d82793ecd60e2ecdfb35efb3bd3254ca1a04b13a2d9dbc0fea2"} Jul 02 16:48:06.089768 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:06.089742 2560 generic.go:356] "Generic (PLEG): container finished" podID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerID="dc447c46fd24aa0114b5511330e7fef953d6863d123e0117fe7d0710a54f9c12" exitCode=0 Jul 02 16:48:06.089871 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:06.089817 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" event={"ID":"e5b29873-066f-46b4-be9a-9384ce22d2fe","Type":"ContainerDied","Data":"dc447c46fd24aa0114b5511330e7fef953d6863d123e0117fe7d0710a54f9c12"} Jul 02 16:48:06.091920 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:06.091900 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" event={"ID":"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e","Type":"ContainerStarted","Data":"788d0c308a5765b30f48dcde2d5b2c06a7cac609017da3452535e8707b21b149"} Jul 02 16:48:07.099375 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.099339 2560 generic.go:356] "Generic (PLEG): container finished" podID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerID="4efcad578a1f1cdbf579e5f67cdce8e11eb5a3272f85a21b4697f477ff997fc8" exitCode=0 Jul 02 16:48:07.099825 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.099401 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" event={"ID":"24f0d9b1-77fc-404b-bbd7-27c04306a27a","Type":"ContainerDied","Data":"4efcad578a1f1cdbf579e5f67cdce8e11eb5a3272f85a21b4697f477ff997fc8"} Jul 02 16:48:07.101214 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.101191 2560 generic.go:356] "Generic (PLEG): container finished" podID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerID="6d1083e8185b28ad174ffca2d2a15574e2db33e15b92b2165795ea6f0edfe671" exitCode=0 Jul 02 16:48:07.101339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.101277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" event={"ID":"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1","Type":"ContainerDied","Data":"6d1083e8185b28ad174ffca2d2a15574e2db33e15b92b2165795ea6f0edfe671"} Jul 02 16:48:07.103131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.103106 2560 generic.go:356] "Generic (PLEG): container finished" podID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerID="8e36ecce65e99dfe9f876b585c49c93f851593b4ba736fcd2d353bf9dd8c4fc3" exitCode=0 Jul 02 16:48:07.103225 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.103143 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" event={"ID":"e5b29873-066f-46b4-be9a-9384ce22d2fe","Type":"ContainerDied","Data":"8e36ecce65e99dfe9f876b585c49c93f851593b4ba736fcd2d353bf9dd8c4fc3"} Jul 02 16:48:07.105065 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.105048 2560 generic.go:356] "Generic (PLEG): container finished" podID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerID="788d0c308a5765b30f48dcde2d5b2c06a7cac609017da3452535e8707b21b149" exitCode=0 Jul 02 16:48:07.105221 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:07.105096 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" event={"ID":"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e","Type":"ContainerDied","Data":"788d0c308a5765b30f48dcde2d5b2c06a7cac609017da3452535e8707b21b149"} Jul 02 16:48:08.112037 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.112000 2560 generic.go:356] "Generic (PLEG): container finished" podID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerID="4aa189c8cda4da954ce4c27bbbe2e028dd956c5d14c7738af40d13dd85d1105f" exitCode=0 Jul 02 16:48:08.112464 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.112086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" event={"ID":"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1","Type":"ContainerDied","Data":"4aa189c8cda4da954ce4c27bbbe2e028dd956c5d14c7738af40d13dd85d1105f"} Jul 02 16:48:08.114224 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.114202 2560 generic.go:356] "Generic (PLEG): container finished" podID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerID="2a0cd8c937c446a9c837082247d09d5e3132553ba65df2a27d1294a9e61926b0" exitCode=0 Jul 02 16:48:08.114330 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.114278 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" event={"ID":"e5b29873-066f-46b4-be9a-9384ce22d2fe","Type":"ContainerDied","Data":"2a0cd8c937c446a9c837082247d09d5e3132553ba65df2a27d1294a9e61926b0"} Jul 02 16:48:08.116282 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.116264 2560 generic.go:356] "Generic (PLEG): container finished" podID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerID="77af76b8071643fe006805b86a071ffed02e1a939475fb59e3515ded88e4e9c5" exitCode=0 Jul 02 16:48:08.116364 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.116343 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" event={"ID":"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e","Type":"ContainerDied","Data":"77af76b8071643fe006805b86a071ffed02e1a939475fb59e3515ded88e4e9c5"} Jul 02 16:48:08.254947 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.254920 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:08.339257 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.339220 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-bundle\") pod \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " Jul 02 16:48:08.339403 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.339317 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-util\") pod \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " Jul 02 16:48:08.339403 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.339384 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx5pl\" (UniqueName: \"kubernetes.io/projected/24f0d9b1-77fc-404b-bbd7-27c04306a27a-kube-api-access-wx5pl\") pod \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\" (UID: \"24f0d9b1-77fc-404b-bbd7-27c04306a27a\") " Jul 02 16:48:08.339918 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.339886 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-bundle" (OuterVolumeSpecName: "bundle") pod "24f0d9b1-77fc-404b-bbd7-27c04306a27a" (UID: "24f0d9b1-77fc-404b-bbd7-27c04306a27a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:08.341567 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.341532 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f0d9b1-77fc-404b-bbd7-27c04306a27a-kube-api-access-wx5pl" (OuterVolumeSpecName: "kube-api-access-wx5pl") pod "24f0d9b1-77fc-404b-bbd7-27c04306a27a" (UID: "24f0d9b1-77fc-404b-bbd7-27c04306a27a"). InnerVolumeSpecName "kube-api-access-wx5pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:48:08.344894 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.344872 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-util" (OuterVolumeSpecName: "util") pod "24f0d9b1-77fc-404b-bbd7-27c04306a27a" (UID: "24f0d9b1-77fc-404b-bbd7-27c04306a27a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:08.440276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.440190 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx5pl\" (UniqueName: \"kubernetes.io/projected/24f0d9b1-77fc-404b-bbd7-27c04306a27a-kube-api-access-wx5pl\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:08.440276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.440222 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:08.440276 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:08.440233 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f0d9b1-77fc-404b-bbd7-27c04306a27a-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.123286 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.123153 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" event={"ID":"24f0d9b1-77fc-404b-bbd7-27c04306a27a","Type":"ContainerDied","Data":"e675b333722410558614c2801e989a12a615e36ef7c4d544de7000454c2dd0d3"} Jul 02 16:48:09.123286 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.123257 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e675b333722410558614c2801e989a12a615e36ef7c4d544de7000454c2dd0d3" Jul 02 16:48:09.123286 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.123184 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7" Jul 02 16:48:09.279040 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.279013 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:09.313478 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.313439 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:09.316081 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.316057 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:09.449625 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449539 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwjlh\" (UniqueName: \"kubernetes.io/projected/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-kube-api-access-rwjlh\") pod \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " Jul 02 16:48:09.449625 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449598 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-bundle\") pod \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " Jul 02 16:48:09.449625 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449619 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-util\") pod \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\" (UID: \"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1\") " Jul 02 16:48:09.449866 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449814 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stl6l\" (UniqueName: \"kubernetes.io/projected/e5b29873-066f-46b4-be9a-9384ce22d2fe-kube-api-access-stl6l\") pod \"e5b29873-066f-46b4-be9a-9384ce22d2fe\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " Jul 02 16:48:09.449902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449864 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-util\") pod \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " Jul 02 16:48:09.449942 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449918 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg7ff\" (UniqueName: \"kubernetes.io/projected/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-kube-api-access-jg7ff\") pod \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " Jul 02 16:48:09.449997 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.449952 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-util\") pod \"e5b29873-066f-46b4-be9a-9384ce22d2fe\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " Jul 02 16:48:09.450050 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.450007 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-bundle\") pod \"e5b29873-066f-46b4-be9a-9384ce22d2fe\" (UID: \"e5b29873-066f-46b4-be9a-9384ce22d2fe\") " Jul 02 16:48:09.450050 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.450040 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-bundle\") pod \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\" (UID: \"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e\") " Jul 02 16:48:09.450814 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.450562 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-bundle" (OuterVolumeSpecName: "bundle") pod "e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" (UID: "e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:09.450814 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.450769 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-bundle" (OuterVolumeSpecName: "bundle") pod "e5b29873-066f-46b4-be9a-9384ce22d2fe" (UID: "e5b29873-066f-46b4-be9a-9384ce22d2fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:09.451005 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.450983 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-bundle" (OuterVolumeSpecName: "bundle") pod "b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" (UID: "b1b68a89-4dd5-47ea-a52c-9483f3fbb57e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:09.452051 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.452025 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-kube-api-access-rwjlh" (OuterVolumeSpecName: "kube-api-access-rwjlh") pod "e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" (UID: "e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1"). InnerVolumeSpecName "kube-api-access-rwjlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:48:09.452400 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.452381 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b29873-066f-46b4-be9a-9384ce22d2fe-kube-api-access-stl6l" (OuterVolumeSpecName: "kube-api-access-stl6l") pod "e5b29873-066f-46b4-be9a-9384ce22d2fe" (UID: "e5b29873-066f-46b4-be9a-9384ce22d2fe"). InnerVolumeSpecName "kube-api-access-stl6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:48:09.452734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.452705 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-kube-api-access-jg7ff" (OuterVolumeSpecName: "kube-api-access-jg7ff") pod "b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" (UID: "b1b68a89-4dd5-47ea-a52c-9483f3fbb57e"). InnerVolumeSpecName "kube-api-access-jg7ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:48:09.456386 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.456365 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-util" (OuterVolumeSpecName: "util") pod "e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" (UID: "e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:09.456528 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.456506 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-util" (OuterVolumeSpecName: "util") pod "e5b29873-066f-46b4-be9a-9384ce22d2fe" (UID: "e5b29873-066f-46b4-be9a-9384ce22d2fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:09.456887 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.456862 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-util" (OuterVolumeSpecName: "util") pod "b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" (UID: "b1b68a89-4dd5-47ea-a52c-9483f3fbb57e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:09.551330 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551283 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg7ff\" (UniqueName: \"kubernetes.io/projected/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-kube-api-access-jg7ff\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551330 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551322 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551330 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551335 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5b29873-066f-46b4-be9a-9384ce22d2fe-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551330 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551342 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551644 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551351 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwjlh\" (UniqueName: \"kubernetes.io/projected/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-kube-api-access-rwjlh\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551644 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551360 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551644 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551367 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551644 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551375 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stl6l\" (UniqueName: \"kubernetes.io/projected/e5b29873-066f-46b4-be9a-9384ce22d2fe-kube-api-access-stl6l\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:09.551644 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:09.551382 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b68a89-4dd5-47ea-a52c-9483f3fbb57e-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:10.129559 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.129530 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" Jul 02 16:48:10.130030 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.129520 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c" event={"ID":"e5b29873-066f-46b4-be9a-9384ce22d2fe","Type":"ContainerDied","Data":"55ee43245a6ac799597050aab3140560843f1b610780875a24fed78ff1962c7f"} Jul 02 16:48:10.130030 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.129672 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55ee43245a6ac799597050aab3140560843f1b610780875a24fed78ff1962c7f" Jul 02 16:48:10.131782 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.131762 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" Jul 02 16:48:10.131902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.131786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth" event={"ID":"b1b68a89-4dd5-47ea-a52c-9483f3fbb57e","Type":"ContainerDied","Data":"4d8c4c5fdb785858399b39986c4931bacdd8e44be26a9870100968ea4406d413"} Jul 02 16:48:10.131902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.131831 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d8c4c5fdb785858399b39986c4931bacdd8e44be26a9870100968ea4406d413" Jul 02 16:48:10.133809 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.133787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" event={"ID":"e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1","Type":"ContainerDied","Data":"f01971a70489d568506fe283b5da74e806376834f16f2e81bbc1f310479ca59f"} Jul 02 16:48:10.133897 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.133823 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm" Jul 02 16:48:10.133897 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:10.133828 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f01971a70489d568506fe283b5da74e806376834f16f2e81bbc1f310479ca59f" Jul 02 16:48:15.952489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:15.952438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:16.545951 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:16.545906 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:20.024422 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024389 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b"] Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024726 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="pull" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024742 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="pull" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024756 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="pull" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024765 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="pull" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024777 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="util" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024786 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="util" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024797 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="util" Jul 02 16:48:20.024807 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024805 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="util" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024821 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024829 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024838 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024845 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024855 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="pull" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024863 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="pull" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024872 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024879 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024885 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="pull" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024892 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="pull" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024906 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="util" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024915 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="util" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024927 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="util" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024935 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="util" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024945 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.024954 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.025048 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1" containerName="extract" Jul 02 16:48:20.025057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.025060 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b29873-066f-46b4-be9a-9384ce22d2fe" containerName="extract" Jul 02 16:48:20.025607 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.025072 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b68a89-4dd5-47ea-a52c-9483f3fbb57e" containerName="extract" Jul 02 16:48:20.025607 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.025082 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f0d9b1-77fc-404b-bbd7-27c04306a27a" containerName="extract" Jul 02 16:48:20.029938 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.029909 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:20.032921 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.032896 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z4q4k\"" Jul 02 16:48:20.039502 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.039477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwxt5\" (UniqueName: \"kubernetes.io/projected/5f3407df-d29e-4407-89c6-9e7c857f7a9b-kube-api-access-cwxt5\") pod \"authorino-operator-75cc8d5cb7-gxw8b\" (UID: \"5f3407df-d29e-4407-89c6-9e7c857f7a9b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:20.042918 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.042895 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b"] Jul 02 16:48:20.140222 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.140181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwxt5\" (UniqueName: \"kubernetes.io/projected/5f3407df-d29e-4407-89c6-9e7c857f7a9b-kube-api-access-cwxt5\") pod \"authorino-operator-75cc8d5cb7-gxw8b\" (UID: \"5f3407df-d29e-4407-89c6-9e7c857f7a9b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:20.153549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.153525 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwxt5\" (UniqueName: \"kubernetes.io/projected/5f3407df-d29e-4407-89c6-9e7c857f7a9b-kube-api-access-cwxt5\") pod \"authorino-operator-75cc8d5cb7-gxw8b\" (UID: \"5f3407df-d29e-4407-89c6-9e7c857f7a9b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:20.340296 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.340252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:20.494261 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:20.494237 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b"] Jul 02 16:48:20.496195 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:20.496170 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3407df_d29e_4407_89c6_9e7c857f7a9b.slice/crio-5d87b608688c358de1871734490fe8fb94de91c25fdbf2206e3da4deadeb73d8 WatchSource:0}: Error finding container 5d87b608688c358de1871734490fe8fb94de91c25fdbf2206e3da4deadeb73d8: Status 404 returned error can't find the container with id 5d87b608688c358de1871734490fe8fb94de91c25fdbf2206e3da4deadeb73d8 Jul 02 16:48:21.190004 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:21.189907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" event={"ID":"5f3407df-d29e-4407-89c6-9e7c857f7a9b","Type":"ContainerStarted","Data":"5d87b608688c358de1871734490fe8fb94de91c25fdbf2206e3da4deadeb73d8"} Jul 02 16:48:21.367780 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:21.367737 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:23.205289 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.205195 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" event={"ID":"5f3407df-d29e-4407-89c6-9e7c857f7a9b","Type":"ContainerStarted","Data":"addd33c4ba662edaea8b9f2aa6b01d92b7230ab4de656d99b86cd4f7df1390e7"} Jul 02 16:48:23.205650 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.205323 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:23.227796 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.227741 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" podStartSLOduration=0.870760223 podStartE2EDuration="3.227681906s" totalImagesPullingTime="2.356921683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:48:23.226590244 +0000 UTC m=+622.862513448" watchObservedRunningTime="2026-07-02 16:48:23.227681906 +0000 UTC m=+622.863605108" Jul 02 16:48:23.259976 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.259941 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk"] Jul 02 16:48:23.263138 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.263105 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:23.265841 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.265817 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 16:48:23.265975 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.265880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6bs6s\"" Jul 02 16:48:23.276311 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.276280 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk"] Jul 02 16:48:23.364262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.364217 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9qp\" (UniqueName: \"kubernetes.io/projected/9304a8e0-d75d-4b5a-8b5a-784dad44badf-kube-api-access-fv9qp\") pod \"dns-operator-controller-manager-864dd78c4c-c8tqk\" (UID: \"9304a8e0-d75d-4b5a-8b5a-784dad44badf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:23.401899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.401864 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:23.464974 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.464896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9qp\" (UniqueName: \"kubernetes.io/projected/9304a8e0-d75d-4b5a-8b5a-784dad44badf-kube-api-access-fv9qp\") pod \"dns-operator-controller-manager-864dd78c4c-c8tqk\" (UID: \"9304a8e0-d75d-4b5a-8b5a-784dad44badf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:23.479928 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.479893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9qp\" (UniqueName: \"kubernetes.io/projected/9304a8e0-d75d-4b5a-8b5a-784dad44badf-kube-api-access-fv9qp\") pod \"dns-operator-controller-manager-864dd78c4c-c8tqk\" (UID: \"9304a8e0-d75d-4b5a-8b5a-784dad44badf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:23.574127 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.574090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:23.716228 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:23.716204 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk"] Jul 02 16:48:23.718266 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:23.718236 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9304a8e0_d75d_4b5a_8b5a_784dad44badf.slice/crio-95416add635c0660d07af1cb4650632d7a40af47ae4d6e93a4c34281a4894a47 WatchSource:0}: Error finding container 95416add635c0660d07af1cb4650632d7a40af47ae4d6e93a4c34281a4894a47: Status 404 returned error can't find the container with id 95416add635c0660d07af1cb4650632d7a40af47ae4d6e93a4c34281a4894a47 Jul 02 16:48:24.210999 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:24.210956 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" event={"ID":"9304a8e0-d75d-4b5a-8b5a-784dad44badf","Type":"ContainerStarted","Data":"95416add635c0660d07af1cb4650632d7a40af47ae4d6e93a4c34281a4894a47"} Jul 02 16:48:24.375129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:24.375091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:25.186476 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:25.186434 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:26.224960 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:26.224866 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" event={"ID":"9304a8e0-d75d-4b5a-8b5a-784dad44badf","Type":"ContainerStarted","Data":"3b218b668bfdb55bf7b5a75554df13116217439d73ca50b1cd42444b63fb2081"} Jul 02 16:48:26.225338 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:26.224959 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:26.244420 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:26.244356 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" podStartSLOduration=1.060823907 podStartE2EDuration="3.244339905s" totalImagesPullingTime="2.183515998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:48:26.242648609 +0000 UTC m=+625.878571814" watchObservedRunningTime="2026-07-02 16:48:26.244339905 +0000 UTC m=+625.880263106" Jul 02 16:48:27.365549 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:27.365514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:27.818436 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:27.818397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:31.007141 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.007103 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:31.641018 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.640974 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk"] Jul 02 16:48:31.644512 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.644489 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.647331 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.647309 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qfj5s\"" Jul 02 16:48:31.657459 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.657432 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk"] Jul 02 16:48:31.735114 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.735072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv6sm\" (UniqueName: \"kubernetes.io/projected/299ea8a0-112e-4449-8d8f-625843244c98-kube-api-access-bv6sm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.735287 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.735204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/299ea8a0-112e-4449-8d8f-625843244c98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.836486 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.836425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv6sm\" (UniqueName: \"kubernetes.io/projected/299ea8a0-112e-4449-8d8f-625843244c98-kube-api-access-bv6sm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.836734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.836528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/299ea8a0-112e-4449-8d8f-625843244c98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.836904 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.836885 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/299ea8a0-112e-4449-8d8f-625843244c98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.850260 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.850227 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv6sm\" (UniqueName: \"kubernetes.io/projected/299ea8a0-112e-4449-8d8f-625843244c98-kube-api-access-bv6sm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:31.955556 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:31.955474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:32.097393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:32.097368 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk"] Jul 02 16:48:32.099457 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:32.099427 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299ea8a0_112e_4449_8d8f_625843244c98.slice/crio-37c95eb5d2f5e8a42108a8fdcafcfa2de08c3cb1da0b042a44993b051bb0e09f WatchSource:0}: Error finding container 37c95eb5d2f5e8a42108a8fdcafcfa2de08c3cb1da0b042a44993b051bb0e09f: Status 404 returned error can't find the container with id 37c95eb5d2f5e8a42108a8fdcafcfa2de08c3cb1da0b042a44993b051bb0e09f Jul 02 16:48:32.254355 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:32.254271 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" event={"ID":"299ea8a0-112e-4449-8d8f-625843244c98","Type":"ContainerStarted","Data":"37c95eb5d2f5e8a42108a8fdcafcfa2de08c3cb1da0b042a44993b051bb0e09f"} Jul 02 16:48:32.963734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:32.963701 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:33.063728 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:33.063678 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:33.357441 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:33.357399 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:33.458950 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:33.458905 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:34.213868 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:34.213833 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gxw8b" Jul 02 16:48:36.563059 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:36.563026 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:36.663494 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:36.663462 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:37.232597 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:37.232568 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8tqk" Jul 02 16:48:40.165682 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:40.165646 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:40.268284 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:40.268247 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:40.296378 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:40.296346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" event={"ID":"299ea8a0-112e-4449-8d8f-625843244c98","Type":"ContainerStarted","Data":"05141d1430a3e0df5a4f63f016fbb4e610c6e7d4aec0b3d9ec91af233e6d2fd1"} Jul 02 16:48:40.296537 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:40.296402 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:40.317950 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:40.317893 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" podStartSLOduration=1.66029831 podStartE2EDuration="9.317876892s" totalImagesPullingTime="7.657578582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:48:40.315640271 +0000 UTC m=+639.951563469" watchObservedRunningTime="2026-07-02 16:48:40.317876892 +0000 UTC m=+639.953800094" Jul 02 16:48:42.714490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:42.714453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:42.822076 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:42.822037 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:43.449421 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:43.449378 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:43.551007 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:43.550970 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:51.283603 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:51.283560 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:51.303462 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:51.303437 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:51.383267 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:51.383231 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:51.938439 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:51.938403 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:52.055636 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.055596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:52.650943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.650900 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2"] Jul 02 16:48:52.654620 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.654597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.666247 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.666219 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2"] Jul 02 16:48:52.721762 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.721721 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklwn\" (UniqueName: \"kubernetes.io/projected/d112699b-260c-4ea5-ab6a-df3085b3d353-kube-api-access-mklwn\") pod \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.721956 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.721826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d112699b-260c-4ea5-ab6a-df3085b3d353-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.823020 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.822984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklwn\" (UniqueName: \"kubernetes.io/projected/d112699b-260c-4ea5-ab6a-df3085b3d353-kube-api-access-mklwn\") pod \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.823192 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.823038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d112699b-260c-4ea5-ab6a-df3085b3d353-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.823362 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.823345 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d112699b-260c-4ea5-ab6a-df3085b3d353-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.834311 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.834285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklwn\" (UniqueName: \"kubernetes.io/projected/d112699b-260c-4ea5-ab6a-df3085b3d353-kube-api-access-mklwn\") pod \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:52.965536 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:52.965441 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.093944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.093907 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2"] Jul 02 16:48:53.098436 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.098401 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2"] Jul 02 16:48:53.117324 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.117290 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b"] Jul 02 16:48:53.122135 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.122105 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.123731 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.123681 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk"] Jul 02 16:48:53.123932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.123900 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" podUID="299ea8a0-112e-4449-8d8f-625843244c98" containerName="manager" containerID="cri-o://05141d1430a3e0df5a4f63f016fbb4e610c6e7d4aec0b3d9ec91af233e6d2fd1" gracePeriod=2 Jul 02 16:48:53.137751 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.137625 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b"] Jul 02 16:48:53.143207 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.142766 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk"] Jul 02 16:48:53.160417 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.160368 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:53.227151 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.227064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70a53d5d-0f06-4611-84c3-45f6792b0697-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-c8m8b\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.227151 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.227105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsds4\" (UniqueName: \"kubernetes.io/projected/70a53d5d-0f06-4611-84c3-45f6792b0697-kube-api-access-bsds4\") pod \"kuadrant-operator-controller-manager-55467d9f7-c8m8b\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.239409 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.239361 2560 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 02 16:48:53.239409 ip-10-0-138-22 kubenswrapper[2560]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-cqxt2_kuadrant-system_d112699b-260c-4ea5-ab6a-df3085b3d353_0(9d5933742dd8173ec2000a190c80552cc6b11d6000e03c59ed9b2a12120bec6c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-cqxt2 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"9d5933742dd8173ec2000a190c80552cc6b11d6000e03c59ed9b2a12120bec6c" Netns:"/var/run/netns/db6185b1-2610-4e81-96d2-58182916e3e0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-cqxt2;K8S_POD_INFRA_CONTAINER_ID=9d5933742dd8173ec2000a190c80552cc6b11d6000e03c59ed9b2a12120bec6c;K8S_POD_UID=d112699b-260c-4ea5-ab6a-df3085b3d353" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2/d112699b-260c-4ea5-ab6a-df3085b3d353]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-cqxt2 in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-cqxt2 in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2: pods "kuadrant-operator-controller-manager-55467d9f7-cqxt2" not found Jul 02 16:48:53.239409 ip-10-0-138-22 kubenswrapper[2560]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 02 16:48:53.239409 ip-10-0-138-22 kubenswrapper[2560]: > Jul 02 16:48:53.239579 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.239436 2560 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 02 16:48:53.239579 ip-10-0-138-22 kubenswrapper[2560]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-cqxt2_kuadrant-system_d112699b-260c-4ea5-ab6a-df3085b3d353_0(9d5933742dd8173ec2000a190c80552cc6b11d6000e03c59ed9b2a12120bec6c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-cqxt2 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"9d5933742dd8173ec2000a190c80552cc6b11d6000e03c59ed9b2a12120bec6c" Netns:"/var/run/netns/db6185b1-2610-4e81-96d2-58182916e3e0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-cqxt2;K8S_POD_INFRA_CONTAINER_ID=9d5933742dd8173ec2000a190c80552cc6b11d6000e03c59ed9b2a12120bec6c;K8S_POD_UID=d112699b-260c-4ea5-ab6a-df3085b3d353" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2/d112699b-260c-4ea5-ab6a-df3085b3d353]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-cqxt2 in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-cqxt2 in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2: pods "kuadrant-operator-controller-manager-55467d9f7-cqxt2" not found Jul 02 16:48:53.239579 ip-10-0-138-22 kubenswrapper[2560]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 02 16:48:53.239579 ip-10-0-138-22 kubenswrapper[2560]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.327935 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.327901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70a53d5d-0f06-4611-84c3-45f6792b0697-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-c8m8b\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.328124 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.327955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsds4\" (UniqueName: \"kubernetes.io/projected/70a53d5d-0f06-4611-84c3-45f6792b0697-kube-api-access-bsds4\") pod \"kuadrant-operator-controller-manager-55467d9f7-c8m8b\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.328302 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.328279 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70a53d5d-0f06-4611-84c3-45f6792b0697-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-c8m8b\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.336782 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.336758 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsds4\" (UniqueName: \"kubernetes.io/projected/70a53d5d-0f06-4611-84c3-45f6792b0697-kube-api-access-bsds4\") pod \"kuadrant-operator-controller-manager-55467d9f7-c8m8b\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.360879 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.360853 2560 generic.go:356] "Generic (PLEG): container finished" podID="299ea8a0-112e-4449-8d8f-625843244c98" containerID="05141d1430a3e0df5a4f63f016fbb4e610c6e7d4aec0b3d9ec91af233e6d2fd1" exitCode=0 Jul 02 16:48:53.360990 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.360972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.363377 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.363350 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:53.365321 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.365298 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.365970 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.365956 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:53.367839 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.367824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.368079 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.368058 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.370046 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.370029 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:53.371917 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.371899 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:53.373770 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:53.373751 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:53.428850 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.428811 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d112699b-260c-4ea5-ab6a-df3085b3d353-extensions-socket-volume\") pod \"d112699b-260c-4ea5-ab6a-df3085b3d353\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " Jul 02 16:48:53.428850 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.428852 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv6sm\" (UniqueName: \"kubernetes.io/projected/299ea8a0-112e-4449-8d8f-625843244c98-kube-api-access-bv6sm\") pod \"299ea8a0-112e-4449-8d8f-625843244c98\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " Jul 02 16:48:53.429062 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.428890 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/299ea8a0-112e-4449-8d8f-625843244c98-extensions-socket-volume\") pod \"299ea8a0-112e-4449-8d8f-625843244c98\" (UID: \"299ea8a0-112e-4449-8d8f-625843244c98\") " Jul 02 16:48:53.429062 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.428942 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mklwn\" (UniqueName: \"kubernetes.io/projected/d112699b-260c-4ea5-ab6a-df3085b3d353-kube-api-access-mklwn\") pod \"d112699b-260c-4ea5-ab6a-df3085b3d353\" (UID: \"d112699b-260c-4ea5-ab6a-df3085b3d353\") " Jul 02 16:48:53.429399 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.429097 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d112699b-260c-4ea5-ab6a-df3085b3d353-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d112699b-260c-4ea5-ab6a-df3085b3d353" (UID: "d112699b-260c-4ea5-ab6a-df3085b3d353"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:53.429399 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.429356 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299ea8a0-112e-4449-8d8f-625843244c98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "299ea8a0-112e-4449-8d8f-625843244c98" (UID: "299ea8a0-112e-4449-8d8f-625843244c98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:48:53.431164 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.431139 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299ea8a0-112e-4449-8d8f-625843244c98-kube-api-access-bv6sm" (OuterVolumeSpecName: "kube-api-access-bv6sm") pod "299ea8a0-112e-4449-8d8f-625843244c98" (UID: "299ea8a0-112e-4449-8d8f-625843244c98"). InnerVolumeSpecName "kube-api-access-bv6sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:48:53.431253 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.431221 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d112699b-260c-4ea5-ab6a-df3085b3d353-kube-api-access-mklwn" (OuterVolumeSpecName: "kube-api-access-mklwn") pod "d112699b-260c-4ea5-ab6a-df3085b3d353" (UID: "d112699b-260c-4ea5-ab6a-df3085b3d353"). InnerVolumeSpecName "kube-api-access-mklwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:48:53.438387 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.438361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:53.530410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.530361 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d112699b-260c-4ea5-ab6a-df3085b3d353-extensions-socket-volume\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:53.530410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.530399 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv6sm\" (UniqueName: \"kubernetes.io/projected/299ea8a0-112e-4449-8d8f-625843244c98-kube-api-access-bv6sm\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:53.530410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.530417 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/299ea8a0-112e-4449-8d8f-625843244c98-extensions-socket-volume\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:53.530716 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.530431 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mklwn\" (UniqueName: \"kubernetes.io/projected/d112699b-260c-4ea5-ab6a-df3085b3d353-kube-api-access-mklwn\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:48:53.579784 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:53.579757 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b"] Jul 02 16:48:53.581777 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:48:53.581743 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a53d5d_0f06_4611_84c3_45f6792b0697.slice/crio-a4a83ce5bbda27bf96954a83fb7b72076df0028cff78af6dbc3c107bbd8965e4 WatchSource:0}: Error finding container a4a83ce5bbda27bf96954a83fb7b72076df0028cff78af6dbc3c107bbd8965e4: Status 404 returned error can't find the container with id a4a83ce5bbda27bf96954a83fb7b72076df0028cff78af6dbc3c107bbd8965e4 Jul 02 16:48:54.298652 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.298617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:54.367290 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.367266 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:54.367493 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.367324 2560 scope.go:117] "RemoveContainer" containerID="05141d1430a3e0df5a4f63f016fbb4e610c6e7d4aec0b3d9ec91af233e6d2fd1" Jul 02 16:48:54.369142 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.369119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:54.369275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.369163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" event={"ID":"70a53d5d-0f06-4611-84c3-45f6792b0697","Type":"ContainerStarted","Data":"f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb"} Jul 02 16:48:54.369275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.369224 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" event={"ID":"70a53d5d-0f06-4611-84c3-45f6792b0697","Type":"ContainerStarted","Data":"a4a83ce5bbda27bf96954a83fb7b72076df0028cff78af6dbc3c107bbd8965e4"} Jul 02 16:48:54.369384 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.369372 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:48:54.369867 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:54.369846 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:54.371962 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:54.371942 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:54.373849 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:54.373822 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:54.375777 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:54.375751 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:54.397829 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:54.397786 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cqxt2\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cqxt2" Jul 02 16:48:54.398790 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.398750 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" podStartSLOduration=1.398735352 podStartE2EDuration="1.398735352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:48:54.395715819 +0000 UTC m=+654.031639063" watchObservedRunningTime="2026-07-02 16:48:54.398735352 +0000 UTC m=+654.034658553" Jul 02 16:48:54.399886 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:48:54.399861 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pzmkk\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" podUID="299ea8a0-112e-4449-8d8f-625843244c98" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pzmkk" Jul 02 16:48:54.400292 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.400260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:54.792298 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.792265 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299ea8a0-112e-4449-8d8f-625843244c98" path="/var/lib/kubelet/pods/299ea8a0-112e-4449-8d8f-625843244c98/volumes" Jul 02 16:48:54.792611 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:54.792600 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d112699b-260c-4ea5-ab6a-df3085b3d353" path="/var/lib/kubelet/pods/d112699b-260c-4ea5-ab6a-df3085b3d353/volumes" Jul 02 16:48:59.487301 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:59.487270 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:48:59.587987 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:48:59.587948 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:02.028056 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:02.028020 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:02.130240 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:02.130198 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:04.024345 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.024312 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb555cbbb-k6xv8"] Jul 02 16:49:04.024729 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.024665 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299ea8a0-112e-4449-8d8f-625843244c98" containerName="manager" Jul 02 16:49:04.024729 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.024678 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="299ea8a0-112e-4449-8d8f-625843244c98" containerName="manager" Jul 02 16:49:04.024824 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.024756 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="299ea8a0-112e-4449-8d8f-625843244c98" containerName="manager" Jul 02 16:49:04.030746 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.030726 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.039772 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.039746 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb555cbbb-k6xv8"] Jul 02 16:49:04.084659 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.084628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:04.119877 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.119837 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-oauth-config\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.119877 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.119879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-serving-cert\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.120131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.119986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-trusted-ca-bundle\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.120131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.120036 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-service-ca\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.120131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.120079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b585v\" (UniqueName: \"kubernetes.io/projected/b5c463c9-2dac-40e7-8684-5928ffb438d7-kube-api-access-b585v\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.120131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.120107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-config\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.120263 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.120172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-oauth-serving-cert\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.186766 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.186733 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:04.220637 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-oauth-serving-cert\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.220829 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-oauth-config\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.220829 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-serving-cert\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.220829 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-trusted-ca-bundle\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.220829 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220806 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-service-ca\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.221039 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b585v\" (UniqueName: \"kubernetes.io/projected/b5c463c9-2dac-40e7-8684-5928ffb438d7-kube-api-access-b585v\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.221039 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.220883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-config\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.221595 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.221570 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-config\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.221771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.221630 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-trusted-ca-bundle\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.221823 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.221770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-oauth-serving-cert\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.221823 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.221807 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c463c9-2dac-40e7-8684-5928ffb438d7-service-ca\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.223321 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.223294 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-oauth-config\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.223429 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.223412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5c463c9-2dac-40e7-8684-5928ffb438d7-console-serving-cert\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.229352 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.229322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b585v\" (UniqueName: \"kubernetes.io/projected/b5c463c9-2dac-40e7-8684-5928ffb438d7-kube-api-access-b585v\") pod \"console-6bb555cbbb-k6xv8\" (UID: \"b5c463c9-2dac-40e7-8684-5928ffb438d7\") " pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.286480 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.286450 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:04.341326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.341293 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:04.479794 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.479769 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb555cbbb-k6xv8"] Jul 02 16:49:04.481022 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:49:04.480993 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c463c9_2dac_40e7_8684_5928ffb438d7.slice/crio-47ae31bf805e704aecb1afbe4b8eacb2e52b759460ed6fd4af310b676d8000a5 WatchSource:0}: Error finding container 47ae31bf805e704aecb1afbe4b8eacb2e52b759460ed6fd4af310b676d8000a5: Status 404 returned error can't find the container with id 47ae31bf805e704aecb1afbe4b8eacb2e52b759460ed6fd4af310b676d8000a5 Jul 02 16:49:04.823433 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.823339 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:04.896073 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:04.896042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:05.092579 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.092493 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:05.377872 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.377797 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:49:05.428462 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.428424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb555cbbb-k6xv8" event={"ID":"b5c463c9-2dac-40e7-8684-5928ffb438d7","Type":"ContainerStarted","Data":"e7a601020977760da3f78f44902cead5a5af8554855d16e9c5caab0dc91e5b6b"} Jul 02 16:49:05.428647 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.428486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb555cbbb-k6xv8" event={"ID":"b5c463c9-2dac-40e7-8684-5928ffb438d7","Type":"ContainerStarted","Data":"47ae31bf805e704aecb1afbe4b8eacb2e52b759460ed6fd4af310b676d8000a5"} Jul 02 16:49:05.452666 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.452605 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bb555cbbb-k6xv8" podStartSLOduration=1.452588887 podStartE2EDuration="1.452588887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:05.451150046 +0000 UTC m=+665.087073251" watchObservedRunningTime="2026-07-02 16:49:05.452588887 +0000 UTC m=+665.088512153" Jul 02 16:49:05.660541 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.660503 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk"] Jul 02 16:49:05.663001 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.662982 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.679455 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.679425 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk"] Jul 02 16:49:05.833975 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.833934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg762\" (UniqueName: \"kubernetes.io/projected/aef93de8-a8da-4a2b-a922-34b1625b005d-kube-api-access-zg762\") pod \"kuadrant-operator-controller-manager-86878c769f-rdwsk\" (UID: \"aef93de8-a8da-4a2b-a922-34b1625b005d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.833975 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.833980 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef93de8-a8da-4a2b-a922-34b1625b005d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rdwsk\" (UID: \"aef93de8-a8da-4a2b-a922-34b1625b005d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.935505 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.935414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg762\" (UniqueName: \"kubernetes.io/projected/aef93de8-a8da-4a2b-a922-34b1625b005d-kube-api-access-zg762\") pod \"kuadrant-operator-controller-manager-86878c769f-rdwsk\" (UID: \"aef93de8-a8da-4a2b-a922-34b1625b005d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.935505 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.935459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef93de8-a8da-4a2b-a922-34b1625b005d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rdwsk\" (UID: \"aef93de8-a8da-4a2b-a922-34b1625b005d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.935942 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.935911 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef93de8-a8da-4a2b-a922-34b1625b005d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rdwsk\" (UID: \"aef93de8-a8da-4a2b-a922-34b1625b005d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.944071 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.944046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg762\" (UniqueName: \"kubernetes.io/projected/aef93de8-a8da-4a2b-a922-34b1625b005d-kube-api-access-zg762\") pod \"kuadrant-operator-controller-manager-86878c769f-rdwsk\" (UID: \"aef93de8-a8da-4a2b-a922-34b1625b005d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:05.974010 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:05.973965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:06.116208 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:06.116181 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk"] Jul 02 16:49:06.118850 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:49:06.118815 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef93de8_a8da_4a2b_a922_34b1625b005d.slice/crio-55cb44ef77d98cc038f0fed2bfadb290dfde928371581b9aa8caa5bd46e27345 WatchSource:0}: Error finding container 55cb44ef77d98cc038f0fed2bfadb290dfde928371581b9aa8caa5bd46e27345: Status 404 returned error can't find the container with id 55cb44ef77d98cc038f0fed2bfadb290dfde928371581b9aa8caa5bd46e27345 Jul 02 16:49:06.436238 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:06.436197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" event={"ID":"aef93de8-a8da-4a2b-a922-34b1625b005d","Type":"ContainerStarted","Data":"e7435539c38e3c1477573af40719c353e30354b45dc21eaac50db2191593a303"} Jul 02 16:49:06.436424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:06.436295 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:06.436424 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:06.436320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" event={"ID":"aef93de8-a8da-4a2b-a922-34b1625b005d","Type":"ContainerStarted","Data":"55cb44ef77d98cc038f0fed2bfadb290dfde928371581b9aa8caa5bd46e27345"} Jul 02 16:49:06.465993 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:06.465930 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" podStartSLOduration=1.465906757 podStartE2EDuration="1.465906757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:06.464911591 +0000 UTC m=+666.100834794" watchObservedRunningTime="2026-07-02 16:49:06.465906757 +0000 UTC m=+666.101829961" Jul 02 16:49:14.341963 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.341925 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:14.342436 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.342002 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:14.346795 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.346774 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:14.481340 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.481309 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bb555cbbb-k6xv8" Jul 02 16:49:14.530130 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.530088 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8f86667-55h6h"] Jul 02 16:49:14.634630 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.634539 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:14.735177 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.735137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:14.793094 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:14.793062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:17.443509 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.443475 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rdwsk" Jul 02 16:49:17.495122 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.495095 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b"] Jul 02 16:49:17.495326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.495278 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" podUID="70a53d5d-0f06-4611-84c3-45f6792b0697" containerName="manager" containerID="cri-o://f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb" gracePeriod=10 Jul 02 16:49:17.743438 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.743414 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:49:17.832127 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.832091 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70a53d5d-0f06-4611-84c3-45f6792b0697-extensions-socket-volume\") pod \"70a53d5d-0f06-4611-84c3-45f6792b0697\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " Jul 02 16:49:17.832307 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.832141 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsds4\" (UniqueName: \"kubernetes.io/projected/70a53d5d-0f06-4611-84c3-45f6792b0697-kube-api-access-bsds4\") pod \"70a53d5d-0f06-4611-84c3-45f6792b0697\" (UID: \"70a53d5d-0f06-4611-84c3-45f6792b0697\") " Jul 02 16:49:17.832496 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.832474 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a53d5d-0f06-4611-84c3-45f6792b0697-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "70a53d5d-0f06-4611-84c3-45f6792b0697" (UID: "70a53d5d-0f06-4611-84c3-45f6792b0697"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:49:17.834477 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.834442 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a53d5d-0f06-4611-84c3-45f6792b0697-kube-api-access-bsds4" (OuterVolumeSpecName: "kube-api-access-bsds4") pod "70a53d5d-0f06-4611-84c3-45f6792b0697" (UID: "70a53d5d-0f06-4611-84c3-45f6792b0697"). InnerVolumeSpecName "kube-api-access-bsds4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:49:17.932678 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.932634 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70a53d5d-0f06-4611-84c3-45f6792b0697-extensions-socket-volume\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:17.932678 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:17.932673 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsds4\" (UniqueName: \"kubernetes.io/projected/70a53d5d-0f06-4611-84c3-45f6792b0697-kube-api-access-bsds4\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:18.500501 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.500462 2560 generic.go:356] "Generic (PLEG): container finished" podID="70a53d5d-0f06-4611-84c3-45f6792b0697" containerID="f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb" exitCode=0 Jul 02 16:49:18.500943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.500511 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" Jul 02 16:49:18.500943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.500555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" event={"ID":"70a53d5d-0f06-4611-84c3-45f6792b0697","Type":"ContainerDied","Data":"f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb"} Jul 02 16:49:18.500943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.500604 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b" event={"ID":"70a53d5d-0f06-4611-84c3-45f6792b0697","Type":"ContainerDied","Data":"a4a83ce5bbda27bf96954a83fb7b72076df0028cff78af6dbc3c107bbd8965e4"} Jul 02 16:49:18.500943 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.500626 2560 scope.go:117] "RemoveContainer" containerID="f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb" Jul 02 16:49:18.510389 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.510366 2560 scope.go:117] "RemoveContainer" containerID="f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb" Jul 02 16:49:18.510659 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:49:18.510640 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb\": container with ID starting with f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb not found: ID does not exist" containerID="f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb" Jul 02 16:49:18.510735 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.510667 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb"} err="failed to get container status \"f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb\": rpc error: code = NotFound desc = could not find container \"f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb\": container with ID starting with f583f7b5404ef575166f7ebe4f199242a83adf0b54bc2f9fc2bfa6552488aefb not found: ID does not exist" Jul 02 16:49:18.527253 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.527226 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b"] Jul 02 16:49:18.533755 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.533730 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c8m8b"] Jul 02 16:49:18.793939 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:18.793908 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70a53d5d-0f06-4611-84c3-45f6792b0697" path="/var/lib/kubelet/pods/70a53d5d-0f06-4611-84c3-45f6792b0697/volumes" Jul 02 16:49:21.942913 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:21.942877 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:22.150110 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:22.150072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:22.291881 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:22.291844 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:37.844845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.844808 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:37.848806 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.848782 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:37.849116 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.849105 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a53d5d-0f06-4611-84c3-45f6792b0697" containerName="manager" Jul 02 16:49:37.849162 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.849118 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a53d5d-0f06-4611-84c3-45f6792b0697" containerName="manager" Jul 02 16:49:37.849205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.849186 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a53d5d-0f06-4611-84c3-45f6792b0697" containerName="manager" Jul 02 16:49:37.852501 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.852487 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:37.855076 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.855057 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 16:49:37.855076 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.855064 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bktd\"" Jul 02 16:49:37.865581 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.865554 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:37.903985 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.903941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbnts\" (UniqueName: \"kubernetes.io/projected/0f41a893-76c4-4058-a3cc-7b9bc45542e2-kube-api-access-vbnts\") pod \"limitador-limitador-64c94fd64f-pkqzh\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:37.904149 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.904090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f41a893-76c4-4058-a3cc-7b9bc45542e2-config-file\") pod \"limitador-limitador-64c94fd64f-pkqzh\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:37.941979 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.941947 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:37.944248 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:37.944216 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:38.000559 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.000519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:38.004627 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.004605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbnts\" (UniqueName: \"kubernetes.io/projected/0f41a893-76c4-4058-a3cc-7b9bc45542e2-kube-api-access-vbnts\") pod \"limitador-limitador-64c94fd64f-pkqzh\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:38.004720 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.004665 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f41a893-76c4-4058-a3cc-7b9bc45542e2-config-file\") pod \"limitador-limitador-64c94fd64f-pkqzh\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:38.005264 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.005241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f41a893-76c4-4058-a3cc-7b9bc45542e2-config-file\") pod \"limitador-limitador-64c94fd64f-pkqzh\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:38.012526 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.012505 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbnts\" (UniqueName: \"kubernetes.io/projected/0f41a893-76c4-4058-a3cc-7b9bc45542e2-kube-api-access-vbnts\") pod \"limitador-limitador-64c94fd64f-pkqzh\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:38.170176 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.170097 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:38.312475 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.312447 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:38.314895 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:49:38.314873 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f41a893_76c4_4058_a3cc_7b9bc45542e2.slice/crio-641e3c8aef7aba66b27248dd071bda2505360aa37f815432268fbfbe76b43a1b WatchSource:0}: Error finding container 641e3c8aef7aba66b27248dd071bda2505360aa37f815432268fbfbe76b43a1b: Status 404 returned error can't find the container with id 641e3c8aef7aba66b27248dd071bda2505360aa37f815432268fbfbe76b43a1b Jul 02 16:49:38.605265 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.605230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" event={"ID":"0f41a893-76c4-4058-a3cc-7b9bc45542e2","Type":"ContainerStarted","Data":"641e3c8aef7aba66b27248dd071bda2505360aa37f815432268fbfbe76b43a1b"} Jul 02 16:49:38.650292 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.650250 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:38.723311 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:38.723275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:49:39.557724 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:39.557661 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b8f86667-55h6h" podUID="452df36c-7962-4632-b535-f1290440db9e" containerName="console" containerID="cri-o://ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5" gracePeriod=15 Jul 02 16:49:40.572743 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.572713 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:49:40.618731 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.618664 2560 generic.go:356] "Generic (PLEG): container finished" podID="452df36c-7962-4632-b535-f1290440db9e" containerID="ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5" exitCode=0 Jul 02 16:49:40.618731 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.618731 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8f86667-55h6h" Jul 02 16:49:40.618991 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.618732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8f86667-55h6h" event={"ID":"452df36c-7962-4632-b535-f1290440db9e","Type":"ContainerDied","Data":"ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5"} Jul 02 16:49:40.618991 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.618812 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8f86667-55h6h" event={"ID":"452df36c-7962-4632-b535-f1290440db9e","Type":"ContainerDied","Data":"ff9033358da9bd978736375f2dbbf77d540b52d6559f6dffe770b967d076362e"} Jul 02 16:49:40.618991 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.618844 2560 scope.go:117] "RemoveContainer" containerID="ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5" Jul 02 16:49:40.631451 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631428 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-trusted-ca-bundle\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631581 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631469 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-oauth-config\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631581 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631522 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-serving-cert\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631581 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631556 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7xxl\" (UniqueName: \"kubernetes.io/projected/452df36c-7962-4632-b535-f1290440db9e-kube-api-access-f7xxl\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631748 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631607 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-service-ca\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631748 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631641 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-console-config\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631748 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631671 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-oauth-serving-cert\") pod \"452df36c-7962-4632-b535-f1290440db9e\" (UID: \"452df36c-7962-4632-b535-f1290440db9e\") " Jul 02 16:49:40.631902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631853 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:49:40.632069 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.631969 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-trusted-ca-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.632163 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.632129 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:49:40.632224 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.632155 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-service-ca" (OuterVolumeSpecName: "service-ca") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:49:40.632279 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.632247 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-console-config" (OuterVolumeSpecName: "console-config") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:49:40.634042 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.634020 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452df36c-7962-4632-b535-f1290440db9e-kube-api-access-f7xxl" (OuterVolumeSpecName: "kube-api-access-f7xxl") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "kube-api-access-f7xxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:49:40.634228 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.634212 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:49:40.634293 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.634236 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "452df36c-7962-4632-b535-f1290440db9e" (UID: "452df36c-7962-4632-b535-f1290440db9e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:49:40.733026 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.732988 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.733026 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.733028 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7xxl\" (UniqueName: \"kubernetes.io/projected/452df36c-7962-4632-b535-f1290440db9e-kube-api-access-f7xxl\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.733262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.733045 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-service-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.733262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.733055 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-console-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.733262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.733063 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452df36c-7962-4632-b535-f1290440db9e-oauth-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.733262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.733071 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452df36c-7962-4632-b535-f1290440db9e-console-oauth-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:40.937739 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.937703 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8f86667-55h6h"] Jul 02 16:49:40.942886 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:40.942861 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8f86667-55h6h"] Jul 02 16:49:41.047361 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:41.047340 2560 scope.go:117] "RemoveContainer" containerID="ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5" Jul 02 16:49:41.047672 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:49:41.047652 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5\": container with ID starting with ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5 not found: ID does not exist" containerID="ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5" Jul 02 16:49:41.047775 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:41.047680 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5"} err="failed to get container status \"ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5\": rpc error: code = NotFound desc = could not find container \"ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5\": container with ID starting with ed471add92d6fb7473da91b9105d02a156da68463398d0a38a5e7f43fa481fc5 not found: ID does not exist" Jul 02 16:49:41.625002 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:41.624968 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" event={"ID":"0f41a893-76c4-4058-a3cc-7b9bc45542e2","Type":"ContainerStarted","Data":"ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e"} Jul 02 16:49:41.625464 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:41.625156 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:41.641490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:41.641448 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" podStartSLOduration=1.860595792 podStartE2EDuration="4.641433144s" totalImagesPullingTime="2.780837352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:41.641186689 +0000 UTC m=+701.277109894" watchObservedRunningTime="2026-07-02 16:49:41.641433144 +0000 UTC m=+701.277356345" Jul 02 16:49:42.792609 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:42.792569 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452df36c-7962-4632-b535-f1290440db9e" path="/var/lib/kubelet/pods/452df36c-7962-4632-b535-f1290440db9e/volumes" Jul 02 16:49:52.637724 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:52.637617 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:55.328094 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:55.328055 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:55.328487 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:55.328282 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" podUID="0f41a893-76c4-4058-a3cc-7b9bc45542e2" containerName="limitador" containerID="cri-o://ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e" gracePeriod=30 Jul 02 16:49:55.895386 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:55.895310 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:56.075711 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.075644 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbnts\" (UniqueName: \"kubernetes.io/projected/0f41a893-76c4-4058-a3cc-7b9bc45542e2-kube-api-access-vbnts\") pod \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " Jul 02 16:49:56.075890 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.075764 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f41a893-76c4-4058-a3cc-7b9bc45542e2-config-file\") pod \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\" (UID: \"0f41a893-76c4-4058-a3cc-7b9bc45542e2\") " Jul 02 16:49:56.076159 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.076133 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f41a893-76c4-4058-a3cc-7b9bc45542e2-config-file" (OuterVolumeSpecName: "config-file") pod "0f41a893-76c4-4058-a3cc-7b9bc45542e2" (UID: "0f41a893-76c4-4058-a3cc-7b9bc45542e2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:49:56.077944 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.077914 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f41a893-76c4-4058-a3cc-7b9bc45542e2-kube-api-access-vbnts" (OuterVolumeSpecName: "kube-api-access-vbnts") pod "0f41a893-76c4-4058-a3cc-7b9bc45542e2" (UID: "0f41a893-76c4-4058-a3cc-7b9bc45542e2"). InnerVolumeSpecName "kube-api-access-vbnts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:49:56.176898 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.176796 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbnts\" (UniqueName: \"kubernetes.io/projected/0f41a893-76c4-4058-a3cc-7b9bc45542e2-kube-api-access-vbnts\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:56.176898 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.176839 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f41a893-76c4-4058-a3cc-7b9bc45542e2-config-file\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:49:56.708391 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.708353 2560 generic.go:356] "Generic (PLEG): container finished" podID="0f41a893-76c4-4058-a3cc-7b9bc45542e2" containerID="ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e" exitCode=0 Jul 02 16:49:56.708808 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.708397 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" Jul 02 16:49:56.708808 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.708409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" event={"ID":"0f41a893-76c4-4058-a3cc-7b9bc45542e2","Type":"ContainerDied","Data":"ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e"} Jul 02 16:49:56.708808 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.708464 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pkqzh" event={"ID":"0f41a893-76c4-4058-a3cc-7b9bc45542e2","Type":"ContainerDied","Data":"641e3c8aef7aba66b27248dd071bda2505360aa37f815432268fbfbe76b43a1b"} Jul 02 16:49:56.708808 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.708493 2560 scope.go:117] "RemoveContainer" containerID="ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e" Jul 02 16:49:56.721144 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.721126 2560 scope.go:117] "RemoveContainer" containerID="ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e" Jul 02 16:49:56.721500 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:49:56.721475 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e\": container with ID starting with ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e not found: ID does not exist" containerID="ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e" Jul 02 16:49:56.721579 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.721511 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e"} err="failed to get container status \"ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e\": rpc error: code = NotFound desc = could not find container \"ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e\": container with ID starting with ac276a1f452c676f40f58edf4e16f4ab2b5b71e8d63634c15f5909456a49c30e not found: ID does not exist" Jul 02 16:49:56.731920 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.731895 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:56.735806 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.735785 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pkqzh"] Jul 02 16:49:56.792781 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:49:56.792741 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f41a893-76c4-4058-a3cc-7b9bc45542e2" path="/var/lib/kubelet/pods/0f41a893-76c4-4058-a3cc-7b9bc45542e2/volumes" Jul 02 16:50:01.847428 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.847392 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-2ckrt"] Jul 02 16:50:01.847928 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.847899 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452df36c-7962-4632-b535-f1290440db9e" containerName="console" Jul 02 16:50:01.847928 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.847916 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="452df36c-7962-4632-b535-f1290440db9e" containerName="console" Jul 02 16:50:01.847928 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.847928 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f41a893-76c4-4058-a3cc-7b9bc45542e2" containerName="limitador" Jul 02 16:50:01.848118 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.847934 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f41a893-76c4-4058-a3cc-7b9bc45542e2" containerName="limitador" Jul 02 16:50:01.848118 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.848016 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="452df36c-7962-4632-b535-f1290440db9e" containerName="console" Jul 02 16:50:01.848118 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.848025 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f41a893-76c4-4058-a3cc-7b9bc45542e2" containerName="limitador" Jul 02 16:50:01.852364 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.852342 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:01.855140 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.855115 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xd544\"" Jul 02 16:50:01.855868 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.855847 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 16:50:01.857314 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.857288 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2ckrt"] Jul 02 16:50:01.888428 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.888399 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:50:01.922478 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.922435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmg6x\" (UniqueName: \"kubernetes.io/projected/bc230f8e-5dd7-4955-acc4-5518eadb6994-kube-api-access-fmg6x\") pod \"postgres-69fb4594cf-2ckrt\" (UID: \"bc230f8e-5dd7-4955-acc4-5518eadb6994\") " pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:01.922625 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:01.922486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc230f8e-5dd7-4955-acc4-5518eadb6994-data\") pod \"postgres-69fb4594cf-2ckrt\" (UID: \"bc230f8e-5dd7-4955-acc4-5518eadb6994\") " pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:02.023702 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.023660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmg6x\" (UniqueName: \"kubernetes.io/projected/bc230f8e-5dd7-4955-acc4-5518eadb6994-kube-api-access-fmg6x\") pod \"postgres-69fb4594cf-2ckrt\" (UID: \"bc230f8e-5dd7-4955-acc4-5518eadb6994\") " pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:02.023889 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.023743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc230f8e-5dd7-4955-acc4-5518eadb6994-data\") pod \"postgres-69fb4594cf-2ckrt\" (UID: \"bc230f8e-5dd7-4955-acc4-5518eadb6994\") " pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:02.024116 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.024098 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc230f8e-5dd7-4955-acc4-5518eadb6994-data\") pod \"postgres-69fb4594cf-2ckrt\" (UID: \"bc230f8e-5dd7-4955-acc4-5518eadb6994\") " pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:02.035812 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.035786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmg6x\" (UniqueName: \"kubernetes.io/projected/bc230f8e-5dd7-4955-acc4-5518eadb6994-kube-api-access-fmg6x\") pod \"postgres-69fb4594cf-2ckrt\" (UID: \"bc230f8e-5dd7-4955-acc4-5518eadb6994\") " pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:02.165245 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.165140 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:02.306336 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.306310 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2ckrt"] Jul 02 16:50:02.308035 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:50:02.308014 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc230f8e_5dd7_4955_acc4_5518eadb6994.slice/crio-ac01e304be53706bb6b5c70d31f015181e7cbe55a7bd8cf8a334e579c6603476 WatchSource:0}: Error finding container ac01e304be53706bb6b5c70d31f015181e7cbe55a7bd8cf8a334e579c6603476: Status 404 returned error can't find the container with id ac01e304be53706bb6b5c70d31f015181e7cbe55a7bd8cf8a334e579c6603476 Jul 02 16:50:02.741952 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:02.741920 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2ckrt" event={"ID":"bc230f8e-5dd7-4955-acc4-5518eadb6994","Type":"ContainerStarted","Data":"ac01e304be53706bb6b5c70d31f015181e7cbe55a7bd8cf8a334e579c6603476"} Jul 02 16:50:07.775668 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:07.775638 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2ckrt" event={"ID":"bc230f8e-5dd7-4955-acc4-5518eadb6994","Type":"ContainerStarted","Data":"bca28ae34a2825bb4620470dee1dbb7f230a6ced24e3dbd69624500ca4d11693"} Jul 02 16:50:07.776123 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:07.775830 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:07.793360 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:07.793298 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-2ckrt" podStartSLOduration=1.7683392580000001 podStartE2EDuration="6.793276421s" totalImagesPullingTime="5.024937163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:50:07.79050154 +0000 UTC m=+727.426424741" watchObservedRunningTime="2026-07-02 16:50:07.793276421 +0000 UTC m=+727.429199624" Jul 02 16:50:13.811899 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:13.811861 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-2ckrt" Jul 02 16:50:14.116124 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:14.116032 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:50:14.216205 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:14.216166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:50:14.402135 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:14.402037 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:50:15.316280 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.316252 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2"] Jul 02 16:50:15.399534 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.399497 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2"] Jul 02 16:50:15.399721 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.399624 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.402737 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.402704 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 16:50:15.402868 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.402748 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 16:50:15.403940 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.403924 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vs8s7\"" Jul 02 16:50:15.449454 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.449422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.449605 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.449473 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.449605 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.449492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxfg\" (UniqueName: \"kubernetes.io/projected/0743de39-d6bc-4f19-95f8-11645252c770-kube-api-access-jzxfg\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.550466 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.550428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.550626 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.550482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.550626 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.550501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxfg\" (UniqueName: \"kubernetes.io/projected/0743de39-d6bc-4f19-95f8-11645252c770-kube-api-access-jzxfg\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.550892 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.550870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.550936 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.550879 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.561077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.561051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxfg\" (UniqueName: \"kubernetes.io/projected/0743de39-d6bc-4f19-95f8-11645252c770-kube-api-access-jzxfg\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.709270 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.709189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:15.913889 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:15.913857 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2"] Jul 02 16:50:15.915670 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:50:15.915646 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0743de39_d6bc_4f19_95f8_11645252c770.slice/crio-c6bc795ab1e1464973e520f16f8882e6b0fba215bfcda5e87f3b56fa421ebed6 WatchSource:0}: Error finding container c6bc795ab1e1464973e520f16f8882e6b0fba215bfcda5e87f3b56fa421ebed6: Status 404 returned error can't find the container with id c6bc795ab1e1464973e520f16f8882e6b0fba215bfcda5e87f3b56fa421ebed6 Jul 02 16:50:16.823038 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:16.822959 2560 generic.go:356] "Generic (PLEG): container finished" podID="0743de39-d6bc-4f19-95f8-11645252c770" containerID="0e86787872482cb02e6f934ebb78b86f07c9597aacd1e35aff3a269650cbf18c" exitCode=0 Jul 02 16:50:16.823414 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:16.823040 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" event={"ID":"0743de39-d6bc-4f19-95f8-11645252c770","Type":"ContainerDied","Data":"0e86787872482cb02e6f934ebb78b86f07c9597aacd1e35aff3a269650cbf18c"} Jul 02 16:50:16.823414 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:16.823086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" event={"ID":"0743de39-d6bc-4f19-95f8-11645252c770","Type":"ContainerStarted","Data":"c6bc795ab1e1464973e520f16f8882e6b0fba215bfcda5e87f3b56fa421ebed6"} Jul 02 16:50:18.834702 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:18.834653 2560 generic.go:356] "Generic (PLEG): container finished" podID="0743de39-d6bc-4f19-95f8-11645252c770" containerID="33e6f29f070417def909e43d8fd298318f92e276c996a805816e53e0eb1ed259" exitCode=0 Jul 02 16:50:18.835136 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:18.834720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" event={"ID":"0743de39-d6bc-4f19-95f8-11645252c770","Type":"ContainerDied","Data":"33e6f29f070417def909e43d8fd298318f92e276c996a805816e53e0eb1ed259"} Jul 02 16:50:19.842024 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:19.841991 2560 generic.go:356] "Generic (PLEG): container finished" podID="0743de39-d6bc-4f19-95f8-11645252c770" containerID="842c97bc54beb6ce9a69431c34a12f910961a270dc15f7d69d6f7c086fe200b8" exitCode=0 Jul 02 16:50:19.842509 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:19.842034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" event={"ID":"0743de39-d6bc-4f19-95f8-11645252c770","Type":"ContainerDied","Data":"842c97bc54beb6ce9a69431c34a12f910961a270dc15f7d69d6f7c086fe200b8"} Jul 02 16:50:20.983615 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:20.983583 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:21.095489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.095455 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-bundle\") pod \"0743de39-d6bc-4f19-95f8-11645252c770\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " Jul 02 16:50:21.095489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.095492 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzxfg\" (UniqueName: \"kubernetes.io/projected/0743de39-d6bc-4f19-95f8-11645252c770-kube-api-access-jzxfg\") pod \"0743de39-d6bc-4f19-95f8-11645252c770\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " Jul 02 16:50:21.095749 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.095521 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-util\") pod \"0743de39-d6bc-4f19-95f8-11645252c770\" (UID: \"0743de39-d6bc-4f19-95f8-11645252c770\") " Jul 02 16:50:21.096035 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.096011 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-bundle" (OuterVolumeSpecName: "bundle") pod "0743de39-d6bc-4f19-95f8-11645252c770" (UID: "0743de39-d6bc-4f19-95f8-11645252c770"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:50:21.097781 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.097754 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0743de39-d6bc-4f19-95f8-11645252c770-kube-api-access-jzxfg" (OuterVolumeSpecName: "kube-api-access-jzxfg") pod "0743de39-d6bc-4f19-95f8-11645252c770" (UID: "0743de39-d6bc-4f19-95f8-11645252c770"). InnerVolumeSpecName "kube-api-access-jzxfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:50:21.101267 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.101244 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-util" (OuterVolumeSpecName: "util") pod "0743de39-d6bc-4f19-95f8-11645252c770" (UID: "0743de39-d6bc-4f19-95f8-11645252c770"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:50:21.197083 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.197048 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:50:21.197083 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.197078 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzxfg\" (UniqueName: \"kubernetes.io/projected/0743de39-d6bc-4f19-95f8-11645252c770-kube-api-access-jzxfg\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:50:21.197083 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.197089 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0743de39-d6bc-4f19-95f8-11645252c770-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:50:21.854358 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.854321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" event={"ID":"0743de39-d6bc-4f19-95f8-11645252c770","Type":"ContainerDied","Data":"c6bc795ab1e1464973e520f16f8882e6b0fba215bfcda5e87f3b56fa421ebed6"} Jul 02 16:50:21.854358 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.854344 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8pt9d2" Jul 02 16:50:21.854574 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:21.854374 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6bc795ab1e1464973e520f16f8882e6b0fba215bfcda5e87f3b56fa421ebed6" Jul 02 16:50:43.526498 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.526455 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:50:43.627365 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.627332 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:50:43.929651 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929568 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:50:43.929949 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929935 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="pull" Jul 02 16:50:43.929995 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929952 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="pull" Jul 02 16:50:43.929995 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929960 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="util" Jul 02 16:50:43.929995 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929965 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="util" Jul 02 16:50:43.929995 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929977 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="extract" Jul 02 16:50:43.929995 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.929984 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="extract" Jul 02 16:50:43.930160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.930037 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0743de39-d6bc-4f19-95f8-11645252c770" containerName="extract" Jul 02 16:50:43.933134 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.933118 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:43.935809 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.935778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-r59qb\"" Jul 02 16:50:43.935809 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.935794 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 16:50:43.936013 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.935778 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 16:50:43.936670 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.936654 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 16:50:43.944460 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:43.944435 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:50:44.094728 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.094658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqlt8\" (UniqueName: \"kubernetes.io/projected/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20-kube-api-access-rqlt8\") pod \"maas-keycloak-0\" (UID: \"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:44.195302 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.195203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqlt8\" (UniqueName: \"kubernetes.io/projected/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20-kube-api-access-rqlt8\") pod \"maas-keycloak-0\" (UID: \"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:44.203488 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.203465 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqlt8\" (UniqueName: \"kubernetes.io/projected/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20-kube-api-access-rqlt8\") pod \"maas-keycloak-0\" (UID: \"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:44.243876 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.243831 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:44.385178 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.385140 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:50:44.387203 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:50:44.387176 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3226ba1_d4b5_4f3b_b73e_2a0ba0248f20.slice/crio-cbe1a40da201276321624895c7ce24f938022a4d300457878a098a16bd81cf2a WatchSource:0}: Error finding container cbe1a40da201276321624895c7ce24f938022a4d300457878a098a16bd81cf2a: Status 404 returned error can't find the container with id cbe1a40da201276321624895c7ce24f938022a4d300457878a098a16bd81cf2a Jul 02 16:50:44.388573 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.388557 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:50:44.978120 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:44.978083 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20","Type":"ContainerStarted","Data":"cbe1a40da201276321624895c7ce24f938022a4d300457878a098a16bd81cf2a"} Jul 02 16:50:50.012660 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:50.012555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20","Type":"ContainerStarted","Data":"55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6"} Jul 02 16:50:50.032258 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:50.032196 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.87920072 podStartE2EDuration="7.032172572s" totalImagesPullingTime="5.152971852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:50:50.029438028 +0000 UTC m=+769.665361242" watchObservedRunningTime="2026-07-02 16:50:50.032172572 +0000 UTC m=+769.668095775" Jul 02 16:50:50.245027 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:50.244984 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:50.246479 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:50.246445 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:51.244924 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:51.244869 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:52.245309 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:52.245255 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:53.245437 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:53.245380 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:54.244640 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:54.244602 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 16:50:54.245004 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:54.244964 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:55.245057 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:55.244992 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:56.244903 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:56.244852 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:57.245156 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:57.245100 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:58.244367 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:58.244316 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:50:59.244617 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:50:59.244565 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:51:00.244390 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:00.244339 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:51:01.245048 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:01.245006 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:51:02.244521 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:02.244467 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jul 02 16:51:03.381828 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:03.381775 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 16:51:03.400653 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:03.400601 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:51:13.389153 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:13.389114 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 16:51:14.085080 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:14.085042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:14.237257 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:14.237215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:21.352366 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.352275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:21.447599 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.447564 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:21.501851 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.501796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:21.560048 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.560010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:21.576163 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.576133 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86d56c6c64-x6249"] Jul 02 16:51:21.583414 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.583386 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.587385 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.587334 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 16:51:21.587552 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.587337 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-49v5p\"" Jul 02 16:51:21.587661 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.587646 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 16:51:21.590295 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.590270 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86d56c6c64-x6249"] Jul 02 16:51:21.649796 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.649710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ba7b04-3f85-4d65-9172-3057a0b2e6b5-webhook-cert\") pod \"maas-controller-86d56c6c64-x6249\" (UID: \"14ba7b04-3f85-4d65-9172-3057a0b2e6b5\") " pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.649796 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.649767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzkk\" (UniqueName: \"kubernetes.io/projected/14ba7b04-3f85-4d65-9172-3057a0b2e6b5-kube-api-access-tmzkk\") pod \"maas-controller-86d56c6c64-x6249\" (UID: \"14ba7b04-3f85-4d65-9172-3057a0b2e6b5\") " pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.750278 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.750219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ba7b04-3f85-4d65-9172-3057a0b2e6b5-webhook-cert\") pod \"maas-controller-86d56c6c64-x6249\" (UID: \"14ba7b04-3f85-4d65-9172-3057a0b2e6b5\") " pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.750278 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.750284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzkk\" (UniqueName: \"kubernetes.io/projected/14ba7b04-3f85-4d65-9172-3057a0b2e6b5-kube-api-access-tmzkk\") pod \"maas-controller-86d56c6c64-x6249\" (UID: \"14ba7b04-3f85-4d65-9172-3057a0b2e6b5\") " pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.752794 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.752769 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ba7b04-3f85-4d65-9172-3057a0b2e6b5-webhook-cert\") pod \"maas-controller-86d56c6c64-x6249\" (UID: \"14ba7b04-3f85-4d65-9172-3057a0b2e6b5\") " pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.758761 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.758732 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzkk\" (UniqueName: \"kubernetes.io/projected/14ba7b04-3f85-4d65-9172-3057a0b2e6b5-kube-api-access-tmzkk\") pod \"maas-controller-86d56c6c64-x6249\" (UID: \"14ba7b04-3f85-4d65-9172-3057a0b2e6b5\") " pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:21.896068 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:21.896018 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:22.036207 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:22.036181 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86d56c6c64-x6249"] Jul 02 16:51:22.037750 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:51:22.037723 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ba7b04_3f85_4d65_9172_3057a0b2e6b5.slice/crio-ec654fafdff34dba5125540ef7abfb5e4c07119f8aa796f6e63dbf27de20c3cc WatchSource:0}: Error finding container ec654fafdff34dba5125540ef7abfb5e4c07119f8aa796f6e63dbf27de20c3cc: Status 404 returned error can't find the container with id ec654fafdff34dba5125540ef7abfb5e4c07119f8aa796f6e63dbf27de20c3cc Jul 02 16:51:22.227715 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:22.227609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86d56c6c64-x6249" event={"ID":"14ba7b04-3f85-4d65-9172-3057a0b2e6b5","Type":"ContainerStarted","Data":"ec654fafdff34dba5125540ef7abfb5e4c07119f8aa796f6e63dbf27de20c3cc"} Jul 02 16:51:23.871918 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:23.871865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:23.959507 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:23.959473 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:24.241077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:24.241041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86d56c6c64-x6249" event={"ID":"14ba7b04-3f85-4d65-9172-3057a0b2e6b5","Type":"ContainerStarted","Data":"03451b35a421fd8ec3253993efdd6fc874a42c381de61f2ea2b39deac1b98484"} Jul 02 16:51:24.241265 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:24.241133 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:24.258794 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:24.258743 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86d56c6c64-x6249" podStartSLOduration=1.5827050790000001 podStartE2EDuration="3.258728434s" totalImagesPullingTime="1.676023355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:51:24.257251385 +0000 UTC m=+803.893174587" watchObservedRunningTime="2026-07-02 16:51:24.258728434 +0000 UTC m=+803.894651632" Jul 02 16:51:35.251281 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:35.251249 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86d56c6c64-x6249" Jul 02 16:51:41.032896 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:41.032855 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:51.222532 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:51.222491 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:57.078728 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.078671 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:57.482841 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.482739 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:57.531515 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.531477 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6c6fff57bd-5wph2"] Jul 02 16:51:57.535044 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.535022 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.537841 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.537819 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 16:51:57.537996 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.537871 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5gzfz\"" Jul 02 16:51:57.548755 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.548722 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c6fff57bd-5wph2"] Jul 02 16:51:57.649517 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.649482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-openshift-service-ca\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.649517 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.649519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9v6k\" (UniqueName: \"kubernetes.io/projected/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-kube-api-access-c9v6k\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.649771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.649545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-maas-api-tls\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.750331 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.750256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-maas-api-tls\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.750490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.750341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-openshift-service-ca\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.750490 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.750366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9v6k\" (UniqueName: \"kubernetes.io/projected/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-kube-api-access-c9v6k\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.750490 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:51:57.750426 2560 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 02 16:51:57.750713 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:51:57.750504 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-maas-api-tls podName:ecce4ee8-1631-4525-a3dd-3919fbcbef0d nodeName:}" failed. No retries permitted until 2026-07-02 16:51:58.250482168 +0000 UTC m=+837.886405353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-maas-api-tls") pod "maas-api-6c6fff57bd-5wph2" (UID: "ecce4ee8-1631-4525-a3dd-3919fbcbef0d") : secret "maas-api-serving-cert" not found Jul 02 16:51:57.751027 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.751009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-openshift-service-ca\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.759169 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.759144 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9v6k\" (UniqueName: \"kubernetes.io/projected/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-kube-api-access-c9v6k\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:57.892435 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.892403 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:57.987978 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.987942 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:57.989211 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.989187 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4"] Jul 02 16:51:57.995257 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.995228 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:57.997805 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.997786 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 16:51:57.997931 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:57.997852 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2zhhb\"" Jul 02 16:51:58.005663 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.005638 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4"] Jul 02 16:51:58.054088 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.054052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7gzv\" (UniqueName: \"kubernetes.io/projected/5ce56b64-f923-43f8-8b36-b67847cc3d68-kube-api-access-k7gzv\") pod \"payload-pre-processing-59f49fd4f6-npzp4\" (UID: \"5ce56b64-f923-43f8-8b36-b67847cc3d68\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.054275 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.054162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce56b64-f923-43f8-8b36-b67847cc3d68-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-npzp4\" (UID: \"5ce56b64-f923-43f8-8b36-b67847cc3d68\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.122358 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.122324 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:51:58.155651 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.155605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce56b64-f923-43f8-8b36-b67847cc3d68-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-npzp4\" (UID: \"5ce56b64-f923-43f8-8b36-b67847cc3d68\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.155849 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.155661 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7gzv\" (UniqueName: \"kubernetes.io/projected/5ce56b64-f923-43f8-8b36-b67847cc3d68-kube-api-access-k7gzv\") pod \"payload-pre-processing-59f49fd4f6-npzp4\" (UID: \"5ce56b64-f923-43f8-8b36-b67847cc3d68\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.156366 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.156343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce56b64-f923-43f8-8b36-b67847cc3d68-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-npzp4\" (UID: \"5ce56b64-f923-43f8-8b36-b67847cc3d68\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.164263 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.164230 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7gzv\" (UniqueName: \"kubernetes.io/projected/5ce56b64-f923-43f8-8b36-b67847cc3d68-kube-api-access-k7gzv\") pod \"payload-pre-processing-59f49fd4f6-npzp4\" (UID: \"5ce56b64-f923-43f8-8b36-b67847cc3d68\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.256595 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.256491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-maas-api-tls\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:58.259271 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.259240 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecce4ee8-1631-4525-a3dd-3919fbcbef0d-maas-api-tls\") pod \"maas-api-6c6fff57bd-5wph2\" (UID: \"ecce4ee8-1631-4525-a3dd-3919fbcbef0d\") " pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:58.308309 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.308272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:51:58.447158 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.447125 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:51:58.452503 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.452481 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4"] Jul 02 16:51:58.453551 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:51:58.453522 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce56b64_f923_43f8_8b36_b67847cc3d68.slice/crio-462ed464df2a01eb04741081cea84e79421047f17454a357264ffb18f1cd5749 WatchSource:0}: Error finding container 462ed464df2a01eb04741081cea84e79421047f17454a357264ffb18f1cd5749: Status 404 returned error can't find the container with id 462ed464df2a01eb04741081cea84e79421047f17454a357264ffb18f1cd5749 Jul 02 16:51:58.587050 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:58.587027 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c6fff57bd-5wph2"] Jul 02 16:51:58.588884 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:51:58.588860 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecce4ee8_1631_4525_a3dd_3919fbcbef0d.slice/crio-3abf45fa3964819478fd1d3d9f8e1b4ac5e687e06ef9f22ee4f3fb3009868467 WatchSource:0}: Error finding container 3abf45fa3964819478fd1d3d9f8e1b4ac5e687e06ef9f22ee4f3fb3009868467: Status 404 returned error can't find the container with id 3abf45fa3964819478fd1d3d9f8e1b4ac5e687e06ef9f22ee4f3fb3009868467 Jul 02 16:51:59.435772 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:59.435733 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c6fff57bd-5wph2" event={"ID":"ecce4ee8-1631-4525-a3dd-3919fbcbef0d","Type":"ContainerStarted","Data":"3abf45fa3964819478fd1d3d9f8e1b4ac5e687e06ef9f22ee4f3fb3009868467"} Jul 02 16:51:59.437816 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:51:59.437785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" event={"ID":"5ce56b64-f923-43f8-8b36-b67847cc3d68","Type":"ContainerStarted","Data":"462ed464df2a01eb04741081cea84e79421047f17454a357264ffb18f1cd5749"} Jul 02 16:52:01.450991 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:01.450890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c6fff57bd-5wph2" event={"ID":"ecce4ee8-1631-4525-a3dd-3919fbcbef0d","Type":"ContainerStarted","Data":"3c0000db065715c3ed79b778a8dc8d00697351732814a662c42ebfb711e38053"} Jul 02 16:52:01.451423 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:01.450992 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:52:01.452492 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:01.452470 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" event={"ID":"5ce56b64-f923-43f8-8b36-b67847cc3d68","Type":"ContainerStarted","Data":"20dd546a189c8af5669b1d72d7ddd7d58b06cfdfca871c8b821bd9de14e730ac"} Jul 02 16:52:01.452573 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:01.452529 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:52:01.471371 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:01.471317 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6c6fff57bd-5wph2" podStartSLOduration=1.949075089 podStartE2EDuration="4.471301305s" totalImagesPullingTime="2.522226216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:52:01.469900495 +0000 UTC m=+841.105823699" watchObservedRunningTime="2026-07-02 16:52:01.471301305 +0000 UTC m=+841.107224507" Jul 02 16:52:01.485921 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:01.485878 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" podStartSLOduration=1.774823852 podStartE2EDuration="4.485863336s" totalImagesPullingTime="2.711039484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:52:01.48482112 +0000 UTC m=+841.120744322" watchObservedRunningTime="2026-07-02 16:52:01.485863336 +0000 UTC m=+841.121786537" Jul 02 16:52:07.463484 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:07.463451 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6c6fff57bd-5wph2" Jul 02 16:52:09.115174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:09.115141 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:52:09.115542 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:09.115350 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" containerID="cri-o://55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6" gracePeriod=30 Jul 02 16:52:11.167175 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.167152 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.271135 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.271097 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqlt8\" (UniqueName: \"kubernetes.io/projected/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20-kube-api-access-rqlt8\") pod \"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20\" (UID: \"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20\") " Jul 02 16:52:11.273407 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.273377 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20-kube-api-access-rqlt8" (OuterVolumeSpecName: "kube-api-access-rqlt8") pod "f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" (UID: "f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20"). InnerVolumeSpecName "kube-api-access-rqlt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:52:11.372155 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.372060 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqlt8\" (UniqueName: \"kubernetes.io/projected/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20-kube-api-access-rqlt8\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jul 02 16:52:11.505985 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.505948 2560 generic.go:356] "Generic (PLEG): container finished" podID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerID="55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6" exitCode=143 Jul 02 16:52:11.506138 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.505991 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.506138 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.506016 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20","Type":"ContainerDied","Data":"55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6"} Jul 02 16:52:11.506138 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.506056 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20","Type":"ContainerDied","Data":"cbe1a40da201276321624895c7ce24f938022a4d300457878a098a16bd81cf2a"} Jul 02 16:52:11.506138 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.506075 2560 scope.go:117] "RemoveContainer" containerID="55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6" Jul 02 16:52:11.516178 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.516157 2560 scope.go:117] "RemoveContainer" containerID="55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6" Jul 02 16:52:11.516429 ip-10-0-138-22 kubenswrapper[2560]: E0702 16:52:11.516413 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6\": container with ID starting with 55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6 not found: ID does not exist" containerID="55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6" Jul 02 16:52:11.516481 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.516437 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6"} err="failed to get container status \"55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6\": rpc error: code = NotFound desc = could not find container \"55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6\": container with ID starting with 55d41d9fb3713fa68d49af8b7d1ebf7b6cc6ed1501a2ef7bcec74660ca0ea2b6 not found: ID does not exist" Jul 02 16:52:11.528630 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.528598 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:52:11.532586 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.532564 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:52:11.558794 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.558760 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:52:11.559174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.559160 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" Jul 02 16:52:11.559230 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.559180 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" Jul 02 16:52:11.559262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.559236 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" containerName="keycloak" Jul 02 16:52:11.563581 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.563564 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.566399 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.566380 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-r59qb\"" Jul 02 16:52:11.566399 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.566396 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 16:52:11.566593 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.566380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 16:52:11.566593 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.566380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 16:52:11.566593 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.566452 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 02 16:52:11.574731 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.574710 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:52:11.675379 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.675282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1c33d8ad-d083-4086-a552-29d44c348e59-test-realms\") pod \"maas-keycloak-0\" (UID: \"1c33d8ad-d083-4086-a552-29d44c348e59\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.675379 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.675367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdd6w\" (UniqueName: \"kubernetes.io/projected/1c33d8ad-d083-4086-a552-29d44c348e59-kube-api-access-fdd6w\") pod \"maas-keycloak-0\" (UID: \"1c33d8ad-d083-4086-a552-29d44c348e59\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.776337 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.776279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1c33d8ad-d083-4086-a552-29d44c348e59-test-realms\") pod \"maas-keycloak-0\" (UID: \"1c33d8ad-d083-4086-a552-29d44c348e59\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.776527 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.776356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdd6w\" (UniqueName: \"kubernetes.io/projected/1c33d8ad-d083-4086-a552-29d44c348e59-kube-api-access-fdd6w\") pod \"maas-keycloak-0\" (UID: \"1c33d8ad-d083-4086-a552-29d44c348e59\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.777059 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.777037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1c33d8ad-d083-4086-a552-29d44c348e59-test-realms\") pod \"maas-keycloak-0\" (UID: \"1c33d8ad-d083-4086-a552-29d44c348e59\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.784915 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.784878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdd6w\" (UniqueName: \"kubernetes.io/projected/1c33d8ad-d083-4086-a552-29d44c348e59-kube-api-access-fdd6w\") pod \"maas-keycloak-0\" (UID: \"1c33d8ad-d083-4086-a552-29d44c348e59\") " pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:11.873970 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:11.873925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:12.022981 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.017868 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 16:52:12.459793 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.459769 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-npzp4" Jul 02 16:52:12.514160 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.514122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c33d8ad-d083-4086-a552-29d44c348e59","Type":"ContainerStarted","Data":"9c1f445a9bf67b274255278908debbd7129fd19b063d7c42348331d1febc337d"} Jul 02 16:52:12.514302 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.514178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c33d8ad-d083-4086-a552-29d44c348e59","Type":"ContainerStarted","Data":"be290577b4ba10044e28e8a04c5464ab4e90a52605713c7edae6e2dd4356d35e"} Jul 02 16:52:12.533381 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.533318 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.1463143869999999 podStartE2EDuration="1.533302557s" totalImagesPullingTime="386.98817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:52:12.532725926 +0000 UTC m=+852.168649128" watchObservedRunningTime="2026-07-02 16:52:12.533302557 +0000 UTC m=+852.169225759" Jul 02 16:52:12.796055 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.796017 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20" path="/var/lib/kubelet/pods/f3226ba1-d4b5-4f3b-b73e-2a0ba0248f20/volumes" Jul 02 16:52:12.874829 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.874787 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:12.876744 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:12.876707 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:13.874969 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:13.874926 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:14.874773 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:14.874719 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:15.874629 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:15.874577 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:16.874768 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:16.874720 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:17.875221 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:17.875163 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:18.875219 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:18.875162 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:19.874821 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:19.874770 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:20.875127 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:20.875080 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:21.109744 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:21.109653 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:52:21.163079 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:21.162984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:52:21.874587 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:21.874536 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:21.874893 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:21.874851 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:22.874622 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:22.874572 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:23.874745 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:23.874700 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:24.875252 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:24.875194 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jul 02 16:52:25.969941 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:25.969898 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:25.986129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:25.986045 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1c33d8ad-d083-4086-a552-29d44c348e59" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:52:35.975973 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:35.975937 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 16:52:48.817475 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:48.817391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:52:50.191387 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:50.191352 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:52:58.666065 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.665977 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4"] Jul 02 16:52:58.668703 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.668668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.671842 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.671819 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sq5dl\"" Jul 02 16:52:58.673033 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.673017 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 16:52:58.673131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.673043 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 16:52:58.673131 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.673047 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 16:52:58.687452 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.687429 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4"] Jul 02 16:52:58.694349 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.694327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.694456 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.694369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab78344-db55-4a9f-954b-d590a6a6559d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.694456 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.694410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.694456 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.694437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.694623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.694491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wgjq\" (UniqueName: \"kubernetes.io/projected/9ab78344-db55-4a9f-954b-d590a6a6559d-kube-api-access-8wgjq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.694623 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.694524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.705532 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.705501 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:52:58.795012 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.794981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795012 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab78344-db55-4a9f-954b-d590a6a6559d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wgjq\" (UniqueName: \"kubernetes.io/projected/9ab78344-db55-4a9f-954b-d590a6a6559d-kube-api-access-8wgjq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795255 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795413 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.795561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.795492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.797386 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.797366 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab78344-db55-4a9f-954b-d590a6a6559d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.797734 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.797717 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab78344-db55-4a9f-954b-d590a6a6559d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.803805 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.803772 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wgjq\" (UniqueName: \"kubernetes.io/projected/9ab78344-db55-4a9f-954b-d590a6a6559d-kube-api-access-8wgjq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4\" (UID: \"9ab78344-db55-4a9f-954b-d590a6a6559d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:58.999601 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:58.999506 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:52:59.137339 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:59.137223 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4"] Jul 02 16:52:59.138426 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:52:59.138388 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab78344_db55_4a9f_954b_d590a6a6559d.slice/crio-9804021eb54b0c29070b228b5fbf5ad502b2f8bf14242665de22b67625a33c14 WatchSource:0}: Error finding container 9804021eb54b0c29070b228b5fbf5ad502b2f8bf14242665de22b67625a33c14: Status 404 returned error can't find the container with id 9804021eb54b0c29070b228b5fbf5ad502b2f8bf14242665de22b67625a33c14 Jul 02 16:52:59.826459 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:52:59.826425 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" event={"ID":"9ab78344-db55-4a9f-954b-d590a6a6559d","Type":"ContainerStarted","Data":"9804021eb54b0c29070b228b5fbf5ad502b2f8bf14242665de22b67625a33c14"} Jul 02 16:53:00.804950 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:00.804920 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:53:00.805124 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:00.805080 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvt2w_7539d518-bc18-431d-998d-4c03ab1327de/ovn-acl-logging/0.log" Jul 02 16:53:00.834025 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:00.833990 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" event={"ID":"9ab78344-db55-4a9f-954b-d590a6a6559d","Type":"ContainerStarted","Data":"c1a00bb26eee1835e69b8e069bcc71dadfe642793b29a5f9992c947f9454ca83"} Jul 02 16:53:00.850932 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:00.850885 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" podStartSLOduration=1.72452743 podStartE2EDuration="2.850869191s" totalImagesPullingTime="1.126341761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:53:00.849844588 +0000 UTC m=+900.485767808" watchObservedRunningTime="2026-07-02 16:53:00.850869191 +0000 UTC m=+900.486792395" Jul 02 16:53:02.044113 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:02.044034 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:53:08.999754 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:08.999712 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:53:09.002030 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:08.999801 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:53:09.013196 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:09.013172 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:53:09.896436 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:09.896409 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4" Jul 02 16:53:24.365270 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:24.365229 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:53:47.279189 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:47.279157 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:53:49.533486 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.533446 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4"] Jul 02 16:53:49.537052 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.537035 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.539845 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.539821 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 16:53:49.545658 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.545635 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4"] Jul 02 16:53:49.623940 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.623899 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:53:49.637225 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.637179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.637225 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.637228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9pd\" (UniqueName: \"kubernetes.io/projected/89b4aa6c-2ad7-4620-aaf9-3584961448a7-kube-api-access-7q9pd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.637428 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.637326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b4aa6c-2ad7-4620-aaf9-3584961448a7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.637428 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.637353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.637517 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.637431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.637517 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.637460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.737946 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.737911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.737946 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.737949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9pd\" (UniqueName: \"kubernetes.io/projected/89b4aa6c-2ad7-4620-aaf9-3584961448a7-kube-api-access-7q9pd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b4aa6c-2ad7-4620-aaf9-3584961448a7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738193 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738396 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738364 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738457 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.738457 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.738448 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.740473 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.740451 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89b4aa6c-2ad7-4620-aaf9-3584961448a7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.740771 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.740741 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b4aa6c-2ad7-4620-aaf9-3584961448a7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.746137 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.746116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9pd\" (UniqueName: \"kubernetes.io/projected/89b4aa6c-2ad7-4620-aaf9-3584961448a7-kube-api-access-7q9pd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sqnh4\" (UID: \"89b4aa6c-2ad7-4620-aaf9-3584961448a7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.848077 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.847985 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:49.986830 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:49.986800 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4"] Jul 02 16:53:49.988444 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:53:49.988413 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b4aa6c_2ad7_4620_aaf9_3584961448a7.slice/crio-c94a06f311e752b3a391393924749a9bdf7fdeb40bb8cb654504883a863c325a WatchSource:0}: Error finding container c94a06f311e752b3a391393924749a9bdf7fdeb40bb8cb654504883a863c325a: Status 404 returned error can't find the container with id c94a06f311e752b3a391393924749a9bdf7fdeb40bb8cb654504883a863c325a Jul 02 16:53:50.113393 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:50.113302 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" event={"ID":"89b4aa6c-2ad7-4620-aaf9-3584961448a7","Type":"ContainerStarted","Data":"c94a06f311e752b3a391393924749a9bdf7fdeb40bb8cb654504883a863c325a"} Jul 02 16:53:51.120317 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:51.120275 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" event={"ID":"89b4aa6c-2ad7-4620-aaf9-3584961448a7","Type":"ContainerStarted","Data":"65a7029ed7a070e4b40c29e84be3d432cfe3c1f13ba5bf5c31fec73fad0048d6"} Jul 02 16:53:51.137112 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:51.137055 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" podStartSLOduration=1.9216464659999999 podStartE2EDuration="2.137039479s" totalImagesPullingTime="215.393013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:53:51.136007843 +0000 UTC m=+950.771931037" watchObservedRunningTime="2026-07-02 16:53:51.137039479 +0000 UTC m=+950.772962681" Jul 02 16:53:53.822402 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.822365 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7"] Jul 02 16:53:53.826142 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.826117 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.828673 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.828654 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 16:53:53.835495 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.835004 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7"] Jul 02 16:53:53.853102 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.853075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:53:53.876329 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.876300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.876440 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.876332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnpbp\" (UniqueName: \"kubernetes.io/projected/09900583-5566-4fff-866c-47572b07a9fb-kube-api-access-fnpbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.876440 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.876359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.876526 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.876468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09900583-5566-4fff-866c-47572b07a9fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.876526 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.876493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.876603 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.876580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977181 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977372 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977372 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnpbp\" (UniqueName: \"kubernetes.io/projected/09900583-5566-4fff-866c-47572b07a9fb-kube-api-access-fnpbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977372 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977372 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09900583-5566-4fff-866c-47572b07a9fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977372 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977667 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977644 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977768 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977666 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.977768 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.977674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.979706 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.979670 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09900583-5566-4fff-866c-47572b07a9fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.980083 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.980061 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09900583-5566-4fff-866c-47572b07a9fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:53.985676 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:53.985655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnpbp\" (UniqueName: \"kubernetes.io/projected/09900583-5566-4fff-866c-47572b07a9fb-kube-api-access-fnpbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7\" (UID: \"09900583-5566-4fff-866c-47572b07a9fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:54.140477 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:54.140387 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:53:54.283061 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:54.283027 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7"] Jul 02 16:53:54.283886 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:53:54.283859 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09900583_5566_4fff_866c_47572b07a9fb.slice/crio-d2bb0f84f2210eda340789064f5f190f10b8f9947ff61265c721d347a4b4bc92 WatchSource:0}: Error finding container d2bb0f84f2210eda340789064f5f190f10b8f9947ff61265c721d347a4b4bc92: Status 404 returned error can't find the container with id d2bb0f84f2210eda340789064f5f190f10b8f9947ff61265c721d347a4b4bc92 Jul 02 16:53:55.144094 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:55.144049 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" event={"ID":"09900583-5566-4fff-866c-47572b07a9fb","Type":"ContainerStarted","Data":"8462ce94b97f244c6776eecfee87b5b9cdc26f73e80354f01aaabbb05b89dbde"} Jul 02 16:53:55.144491 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:55.144111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" event={"ID":"09900583-5566-4fff-866c-47572b07a9fb","Type":"ContainerStarted","Data":"d2bb0f84f2210eda340789064f5f190f10b8f9947ff61265c721d347a4b4bc92"} Jul 02 16:53:55.161981 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:55.161930 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" podStartSLOduration=1.927469625 podStartE2EDuration="2.161914293s" totalImagesPullingTime="234.444668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:53:55.160072879 +0000 UTC m=+954.795996082" watchObservedRunningTime="2026-07-02 16:53:55.161914293 +0000 UTC m=+954.797837523" Jul 02 16:53:59.848467 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:59.848426 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:59.848903 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:59.848491 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:53:59.860940 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:53:59.860911 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:54:00.183287 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:00.183198 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sqnh4" Jul 02 16:54:04.140879 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:04.140841 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:54:04.141310 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:04.140912 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:54:04.153574 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:04.153549 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:54:04.204386 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:04.204356 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7" Jul 02 16:54:10.429315 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:10.429271 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:54:29.340761 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:54:29.340650 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:55:48.633957 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:55:48.633926 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:55:55.736915 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:55:55.736806 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:55:55.830096 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:55:55.830045 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:55:57.151828 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:55:57.151797 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:55:57.265975 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:55:57.265934 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:56:46.498565 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:46.498523 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c6fff57bd-5wph2_ecce4ee8-1631-4525-a3dd-3919fbcbef0d/maas-api/0.log" Jul 02 16:56:46.630327 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:46.630295 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86d56c6c64-x6249_14ba7b04-3f85-4d65-9172-3057a0b2e6b5/manager/0.log" Jul 02 16:56:46.784132 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:46.784101 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gvtw2_7506303a-781b-4f94-a5c8-455b49da85b6/server/0.log" Jul 02 16:56:47.080159 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:47.080078 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-gh6pt_9fbad091-1936-43d9-89b0-812b0a60932e/copy-manifests/0.log" Jul 02 16:56:47.092122 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:47.092094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-gh6pt_9fbad091-1936-43d9-89b0-812b0a60932e/manager/0.log" Jul 02 16:56:47.570981 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:47.570954 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2ckrt_bc230f8e-5dd7-4955-acc4-5518eadb6994/postgres/0.log" Jul 02 16:56:48.513728 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.513699 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth_b1b68a89-4dd5-47ea-a52c-9483f3fbb57e/pull/0.log" Jul 02 16:56:48.521913 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.521887 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth_b1b68a89-4dd5-47ea-a52c-9483f3fbb57e/extract/0.log" Jul 02 16:56:48.532326 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.532298 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth_b1b68a89-4dd5-47ea-a52c-9483f3fbb57e/util/0.log" Jul 02 16:56:48.680562 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.680530 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c_e5b29873-066f-46b4-be9a-9384ce22d2fe/util/0.log" Jul 02 16:56:48.687563 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.687537 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c_e5b29873-066f-46b4-be9a-9384ce22d2fe/pull/0.log" Jul 02 16:56:48.694566 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.694547 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c_e5b29873-066f-46b4-be9a-9384ce22d2fe/extract/0.log" Jul 02 16:56:48.814867 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.814838 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7_24f0d9b1-77fc-404b-bbd7-27c04306a27a/util/0.log" Jul 02 16:56:48.822504 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.822475 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7_24f0d9b1-77fc-404b-bbd7-27c04306a27a/pull/0.log" Jul 02 16:56:48.829897 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.829863 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7_24f0d9b1-77fc-404b-bbd7-27c04306a27a/extract/0.log" Jul 02 16:56:48.953463 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.953434 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm_e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1/util/0.log" Jul 02 16:56:48.963991 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.963964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm_e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1/pull/0.log" Jul 02 16:56:48.971319 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:48.971285 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm_e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1/extract/0.log" Jul 02 16:56:49.230209 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:49.230120 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gxw8b_5f3407df-d29e-4407-89c6-9e7c857f7a9b/manager/0.log" Jul 02 16:56:49.364595 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:49.364561 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c8tqk_9304a8e0-d75d-4b5a-8b5a-784dad44badf/manager/0.log" Jul 02 16:56:49.655582 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:49.655548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4w4qh_dd9a16ca-e77e-4aec-8798-a46f3fb40040/registry-server/0.log" Jul 02 16:56:49.791154 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:49.791124 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rdwsk_aef93de8-a8da-4a2b-a922-34b1625b005d/manager/0.log" Jul 02 16:56:50.620647 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:50.620613 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-spw8x_44c773d3-044c-4ecd-8e8b-4402a2d630cd/discovery/0.log" Jul 02 16:56:50.881174 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:50.881073 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-rxj55_45f7eec3-0fc6-4697-80e9-0eaec554c187/kube-auth-proxy/0.log" Jul 02 16:56:51.130405 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:51.130378 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-npzp4_5ce56b64-f923-43f8-8b36-b67847cc3d68/payload-pre-processing/0.log" Jul 02 16:56:51.387568 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:51.387539 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7756654f9c-m96zj_297bc4ac-108f-4ecd-a48f-85c78933e417/router/0.log" Jul 02 16:56:51.774601 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:51.774509 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-f2lf4_9ab78344-db55-4a9f-954b-d590a6a6559d/main/0.log" Jul 02 16:56:52.044365 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:52.044336 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sqnh4_89b4aa6c-2ad7-4620-aaf9-3584961448a7/main/0.log" Jul 02 16:56:52.184711 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:52.184645 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblkqr7_09900583-5566-4fff-866c-47572b07a9fb/main/0.log" Jul 02 16:56:57.126130 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:57.126081 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:56:57.221165 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:57.221114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:56:59.974537 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:56:59.974504 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ntprq_659cce3e-5ee6-4d9f-8257-43ade29569d3/global-pull-secret-syncer/0.log" Jul 02 16:57:00.070307 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:00.070273 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" Jul 02 16:57:00.209332 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:00.209296 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-22.ec2.internal_d6ff253717128a1119568842cc848cc0/haproxy/0.log" Jul 02 16:57:05.043509 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.043475 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth_b1b68a89-4dd5-47ea-a52c-9483f3fbb57e/extract/0.log" Jul 02 16:57:05.081945 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.081916 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth_b1b68a89-4dd5-47ea-a52c-9483f3fbb57e/util/0.log" Jul 02 16:57:05.108358 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.108333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w6tth_b1b68a89-4dd5-47ea-a52c-9483f3fbb57e/pull/0.log" Jul 02 16:57:05.139613 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.139583 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c_e5b29873-066f-46b4-be9a-9384ce22d2fe/extract/0.log" Jul 02 16:57:05.161540 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.161511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c_e5b29873-066f-46b4-be9a-9384ce22d2fe/util/0.log" Jul 02 16:57:05.184293 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.184262 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2z2c_e5b29873-066f-46b4-be9a-9384ce22d2fe/pull/0.log" Jul 02 16:57:05.224389 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.224354 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7_24f0d9b1-77fc-404b-bbd7-27c04306a27a/extract/0.log" Jul 02 16:57:05.253850 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.253813 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7_24f0d9b1-77fc-404b-bbd7-27c04306a27a/util/0.log" Jul 02 16:57:05.295536 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.295453 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqsl7_24f0d9b1-77fc-404b-bbd7-27c04306a27a/pull/0.log" Jul 02 16:57:05.339750 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.339720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm_e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1/extract/0.log" Jul 02 16:57:05.364851 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.364821 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm_e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1/util/0.log" Jul 02 16:57:05.391197 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.391171 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c58mm_e1b1bf4f-aeb3-40e1-bc9a-8beeb24842c1/pull/0.log" Jul 02 16:57:05.476286 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.476258 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gxw8b_5f3407df-d29e-4407-89c6-9e7c857f7a9b/manager/0.log" Jul 02 16:57:05.497788 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.497759 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c8tqk_9304a8e0-d75d-4b5a-8b5a-784dad44badf/manager/0.log" Jul 02 16:57:05.566028 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.565948 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4w4qh_dd9a16ca-e77e-4aec-8798-a46f3fb40040/registry-server/0.log" Jul 02 16:57:05.611355 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:05.611325 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rdwsk_aef93de8-a8da-4a2b-a922-34b1625b005d/manager/0.log" Jul 02 16:57:07.581780 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:07.581747 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-qht62_70d865ab-e514-46a8-873d-cce6c047b5e7/cluster-monitoring-operator/0.log" Jul 02 16:57:07.737882 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:07.737854 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-2pxq6_9b37bd49-fd9a-4ea8-ad7c-6aa716861e02/monitoring-plugin/0.log" Jul 02 16:57:07.923867 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:07.923777 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zg6nd_f0745687-d075-44d2-8667-d3b7da5a7bac/node-exporter/0.log" Jul 02 16:57:07.946158 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:07.946131 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zg6nd_f0745687-d075-44d2-8667-d3b7da5a7bac/kube-rbac-proxy/0.log" Jul 02 16:57:07.967789 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:07.967762 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zg6nd_f0745687-d075-44d2-8667-d3b7da5a7bac/init-textfile/0.log" Jul 02 16:57:07.998486 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:07.998455 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-lhjxl_873051f4-5086-4815-a827-bb3d07936331/kube-rbac-proxy-main/0.log" Jul 02 16:57:08.026616 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:08.026589 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-lhjxl_873051f4-5086-4815-a827-bb3d07936331/kube-rbac-proxy-self/0.log" Jul 02 16:57:08.047673 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:08.047644 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-lhjxl_873051f4-5086-4815-a827-bb3d07936331/openshift-state-metrics/0.log" Jul 02 16:57:08.254262 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:08.254177 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-g7zl6_3fb53613-b4e8-45c9-bf46-26f61a70019e/prometheus-operator/0.log" Jul 02 16:57:08.271113 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:08.271078 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-g7zl6_3fb53613-b4e8-45c9-bf46-26f61a70019e/kube-rbac-proxy/0.log" Jul 02 16:57:08.292561 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:08.292524 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-v28pc_49355d03-b436-4926-a9c6-63184f179285/prometheus-operator-admission-webhook/0.log" Jul 02 16:57:10.497980 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.497946 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p"] Jul 02 16:57:10.501826 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.501803 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.504781 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.504764 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfdg7\"/\"kube-root-ca.crt\"" Jul 02 16:57:10.504908 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.504893 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bfdg7\"/\"default-dockercfg-6qg7z\"" Jul 02 16:57:10.505976 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.505962 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfdg7\"/\"openshift-service-ca.crt\"" Jul 02 16:57:10.514514 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.514395 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p"] Jul 02 16:57:10.579885 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.579833 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-proc\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.580090 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.579911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhs5v\" (UniqueName: \"kubernetes.io/projected/2c3ef905-c4c2-4222-b618-a8f83ff6f262-kube-api-access-nhs5v\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.580090 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.579986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-lib-modules\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.580090 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.580025 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-sys\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.580090 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.580079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-podres\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681532 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-sys\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681532 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-podres\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-proc\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-sys\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhs5v\" (UniqueName: \"kubernetes.io/projected/2c3ef905-c4c2-4222-b618-a8f83ff6f262-kube-api-access-nhs5v\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681659 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-podres\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-proc\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.681853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-lib-modules\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.682070 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.681868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c3ef905-c4c2-4222-b618-a8f83ff6f262-lib-modules\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.690001 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.689979 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhs5v\" (UniqueName: \"kubernetes.io/projected/2c3ef905-c4c2-4222-b618-a8f83ff6f262-kube-api-access-nhs5v\") pod \"perf-node-gather-daemonset-7fm5p\" (UID: \"2c3ef905-c4c2-4222-b618-a8f83ff6f262\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.811759 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.811725 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:10.944029 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.944004 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p"] Jul 02 16:57:10.945658 ip-10-0-138-22 kubenswrapper[2560]: W0702 16:57:10.945619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2c3ef905_c4c2_4222_b618_a8f83ff6f262.slice/crio-9457413abd1d53e7b5b26e58c680e15cb9a5f630c1a9d3bbc761814f3db9a2e6 WatchSource:0}: Error finding container 9457413abd1d53e7b5b26e58c680e15cb9a5f630c1a9d3bbc761814f3db9a2e6: Status 404 returned error can't find the container with id 9457413abd1d53e7b5b26e58c680e15cb9a5f630c1a9d3bbc761814f3db9a2e6 Jul 02 16:57:10.998593 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:10.998572 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bb555cbbb-k6xv8_b5c463c9-2dac-40e7-8684-5928ffb438d7/console/0.log" Jul 02 16:57:11.219648 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:11.219554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" event={"ID":"2c3ef905-c4c2-4222-b618-a8f83ff6f262","Type":"ContainerStarted","Data":"555ae5ae4bdcfae90010985d9a9db6c05dcdfb6f15a1d7a8e9839722d1c2ede7"} Jul 02 16:57:11.219648 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:11.219611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" event={"ID":"2c3ef905-c4c2-4222-b618-a8f83ff6f262","Type":"ContainerStarted","Data":"9457413abd1d53e7b5b26e58c680e15cb9a5f630c1a9d3bbc761814f3db9a2e6"} Jul 02 16:57:11.219921 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:11.219711 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:11.236779 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:11.236732 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" podStartSLOduration=1.236715157 podStartE2EDuration="1.236715157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:11.23437001 +0000 UTC m=+1150.870293213" watchObservedRunningTime="2026-07-02 16:57:11.236715157 +0000 UTC m=+1150.872638358" Jul 02 16:57:11.702169 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:11.702131 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-s68k5_1ee1956e-ed0e-460e-90f4-0231c5f4b46f/volume-data-source-validator/0.log" Jul 02 16:57:12.784489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:12.784456 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmb5r_781f91e6-cc13-49a2-a124-5af29a00c296/dns/0.log" Jul 02 16:57:12.810770 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:12.810737 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmb5r_781f91e6-cc13-49a2-a124-5af29a00c296/kube-rbac-proxy/0.log" Jul 02 16:57:12.944746 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:12.944719 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tjd45_bc7c6227-b11f-4fbe-ab73-bba7c6f80888/dns-node-resolver/0.log" Jul 02 16:57:13.569530 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:13.569504 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t6tvd_b33ccf49-eb8e-44fc-88cc-5f889ad9515b/node-ca/0.log" Jul 02 16:57:14.620068 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:14.620039 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-spw8x_44c773d3-044c-4ecd-8e8b-4402a2d630cd/discovery/0.log" Jul 02 16:57:14.669119 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:14.669091 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-rxj55_45f7eec3-0fc6-4697-80e9-0eaec554c187/kube-auth-proxy/0.log" Jul 02 16:57:14.724337 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:14.724296 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-npzp4_5ce56b64-f923-43f8-8b36-b67847cc3d68/payload-pre-processing/0.log" Jul 02 16:57:14.783553 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:14.783521 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7756654f9c-m96zj_297bc4ac-108f-4ecd-a48f-85c78933e417/router/0.log" Jul 02 16:57:15.417567 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:15.417536 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5khl7_b13050e8-2e3a-43b8-8bdf-7710128fb142/serve-healthcheck-canary/0.log" Jul 02 16:57:16.065329 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:16.065302 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9zg8_cd496151-7624-4dde-9e1e-8023c1c42457/kube-rbac-proxy/0.log" Jul 02 16:57:16.088937 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:16.088914 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9zg8_cd496151-7624-4dde-9e1e-8023c1c42457/exporter/0.log" Jul 02 16:57:16.114792 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:16.114764 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9zg8_cd496151-7624-4dde-9e1e-8023c1c42457/extractor/0.log" Jul 02 16:57:17.236177 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:17.236147 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-7fm5p" Jul 02 16:57:18.726140 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:18.726111 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c6fff57bd-5wph2_ecce4ee8-1631-4525-a3dd-3919fbcbef0d/maas-api/0.log" Jul 02 16:57:18.781287 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:18.781255 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86d56c6c64-x6249_14ba7b04-3f85-4d65-9172-3057a0b2e6b5/manager/0.log" Jul 02 16:57:18.808777 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:18.808743 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gvtw2_7506303a-781b-4f94-a5c8-455b49da85b6/server/0.log" Jul 02 16:57:18.878286 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:18.878247 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:18.909421 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:18.909387 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-gh6pt_9fbad091-1936-43d9-89b0-812b0a60932e/manager/0.log" Jul 02 16:57:18.930572 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:18.930548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-gh6pt_9fbad091-1936-43d9-89b0-812b0a60932e/copy-manifests/0.log" Jul 02 16:57:19.095801 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:19.095772 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2ckrt_bc230f8e-5dd7-4955-acc4-5518eadb6994/postgres/0.log" Jul 02 16:57:21.052777 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:21.052743 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-spw8x_44c773d3-044c-4ecd-8e8b-4402a2d630cd/discovery/0.log" Jul 02 16:57:21.088931 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:21.088897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-rxj55_45f7eec3-0fc6-4697-80e9-0eaec554c187/kube-auth-proxy/0.log" Jul 02 16:57:21.138410 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:21.138381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-npzp4_5ce56b64-f923-43f8-8b36-b67847cc3d68/payload-pre-processing/0.log" Jul 02 16:57:21.190979 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:21.190893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7756654f9c-m96zj_297bc4ac-108f-4ecd-a48f-85c78933e417/router/0.log" Jul 02 16:57:22.430714 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:22.430674 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-spw8x_44c773d3-044c-4ecd-8e8b-4402a2d630cd/discovery/0.log" Jul 02 16:57:22.464129 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:22.464100 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-rxj55_45f7eec3-0fc6-4697-80e9-0eaec554c187/kube-auth-proxy/0.log" Jul 02 16:57:22.506140 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:22.506104 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-npzp4_5ce56b64-f923-43f8-8b36-b67847cc3d68/payload-pre-processing/0.log" Jul 02 16:57:22.544996 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:22.544908 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7756654f9c-m96zj_297bc4ac-108f-4ecd-a48f-85c78933e417/router/0.log" Jul 02 16:57:25.577536 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:25.577501 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nwnt_62291666-a661-47cf-a1b8-095f89bd9e6f/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:26.155081 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:26.155045 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qrtkh_56116f10-8b55-417d-8f6e-19ee3a305460/kube-storage-version-migrator-operator/1.log" Jul 02 16:57:26.156603 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:26.156575 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qrtkh_56116f10-8b55-417d-8f6e-19ee3a305460/kube-storage-version-migrator-operator/0.log" Jul 02 16:57:27.192580 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.192543 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-95rxm_f59735cf-2ab8-456e-8264-74fef275a08a/kube-multus/0.log" Jul 02 16:57:27.215315 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.215289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/kube-multus-additional-cni-plugins/0.log" Jul 02 16:57:27.235853 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.235825 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/egress-router-binary-copy/0.log" Jul 02 16:57:27.257306 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.257279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/cni-plugins/0.log" Jul 02 16:57:27.278629 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.278607 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/bond-cni-plugin/0.log" Jul 02 16:57:27.300902 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.300871 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/routeoverride-cni/0.log" Jul 02 16:57:27.322417 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.322385 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/whereabouts-cni-bincopy/0.log" Jul 02 16:57:27.343327 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.343299 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9c7m_3d6e0ce3-8e52-4f9b-be08-416e8a6d249e/whereabouts-cni/0.log" Jul 02 16:57:27.823288 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.823252 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm4nb_da883743-1e69-40b4-a2a1-239b6548ba35/network-metrics-daemon/0.log" Jul 02 16:57:27.842489 ip-10-0-138-22 kubenswrapper[2560]: I0702 16:57:27.842451 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm4nb_da883743-1e69-40b4-a2a1-239b6548ba35/kube-rbac-proxy/0.log"